python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2406760 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2794744'] with mtr_portfolio_ids : ['22696244'] and first list_photo_ids : [] new path : /proc/2406760/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.3823230266571045 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 5 21:30:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-05 21:30:33.535281: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-05 21:30:33.571489: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-05 21:30:33.574718: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7a1c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-05 21:30:33.574772: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-05 21:30:33.578910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-05 21:30:33.870233: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x17357040 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-05 21:30:33.870305: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-05 21:30:33.873166: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-05 21:30:33.873765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-05 21:30:33.876939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-05 21:30:33.879774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-05 21:30:33.880625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-05 21:30:33.884322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-05 21:30:33.886126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-05 21:30:33.892676: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-05 21:30:33.896184: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-05 21:30:33.897172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-05 21:30:33.904638: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-05 21:30:33.904705: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-05 21:30:33.904717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-05 21:30:33.906846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6251 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-05 21:30:34.328740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-05 21:30:34.328993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-05 21:30:34.329028: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-05 21:30:34.329057: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-05 21:30:34.329079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-05 21:30:34.329100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-05 21:30:34.329126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-05 21:30:34.329156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-05 21:30:34.330381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-05 21:30:34.331996: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-05 21:30:34.332107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-05 21:30:34.332129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-05 21:30:34.332147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-05 21:30:34.332167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-05 21:30:34.332184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-05 21:30:34.332203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-05 21:30:34.332223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-05 21:30:34.333367: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-05 21:30:34.333428: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-05 21:30:34.333441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-05 21:30:34.333450: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-05 21:30:34.334636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6251 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-05 21:30:49.556283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-05 21:30:49.802640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-05 21:30:51.619717: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.620456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.621067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.621666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.622245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.622816: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.623405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.623479: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.624218: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.624247: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.631780: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.631908: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.632509: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.632535: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.639822: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.640002: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.640610: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.640633: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.668915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.669009: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.669623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.669650: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.675620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.675736: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.676329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.676355: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 21:30:51.707466: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.708146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.709970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.710634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.748443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.749071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.751223: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.751844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.786919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.787723: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.789765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.790373: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.798190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.798939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.800839: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.801454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.807786: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.808460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.810306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.810953: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.840987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.841684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.842258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.842832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.847604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.848254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.865031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.865699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.866265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.866824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.880592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.881315: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.881937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.882540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.887979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.888603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.893823: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.894450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.907276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.907976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.912373: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.912997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.913595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.914176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.915253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.915839: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.926885: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.927651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.928275: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.928851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.929435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.930035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.930604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.931185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.941548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.942221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.948934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:51.949558: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.014371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.015054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.024103: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.024945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.053723: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.055238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.056476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.057733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.064457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.065789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.067171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.068420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.073305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.073457: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-05 21:30:52.081238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.082007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.091937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.092634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.093390: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.093994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.094573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 21:30:52.095160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 Detection mask done ! Trying to reset tf kernel 2407414 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 174 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5621 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0007107257843017578 nb_pixel_total : 18274 time to create 1 rle with old method : 0.021791934967041016 length of segment : 130 time for calcul the mask position with numpy : 0.0006670951843261719 nb_pixel_total : 22642 time to create 1 rle with old method : 0.027176856994628906 length of segment : 194 time for calcul the mask position with numpy : 0.0008690357208251953 nb_pixel_total : 39664 time to create 1 rle with old method : 0.047850847244262695 length of segment : 180 time for calcul the mask position with numpy : 0.0005462169647216797 nb_pixel_total : 26126 time to create 1 rle with old method : 0.030507802963256836 length of segment : 177 time for calcul the mask position with numpy : 0.00024509429931640625 nb_pixel_total : 6772 time to create 1 rle with old method : 0.008679628372192383 length of segment : 72 time for calcul the mask position with numpy : 0.0012514591217041016 nb_pixel_total : 39661 time to create 1 rle with old method : 0.048790931701660156 length of segment : 294 time for calcul the mask position with numpy : 0.0009593963623046875 nb_pixel_total : 44070 time to create 1 rle with old method : 0.06029224395751953 length of segment : 229 time for calcul the mask position with numpy : 0.0007648468017578125 nb_pixel_total : 12165 time to create 1 rle with old method : 0.025157928466796875 length of segment : 138 time for calcul the mask position with numpy : 0.0015287399291992188 nb_pixel_total : 17965 time to create 1 rle with old method : 0.028378725051879883 length of segment : 136 time for calcul the mask position with numpy : 0.003278493881225586 nb_pixel_total : 134344 time to create 1 rle with old method : 0.15282940864562988 length of segment : 488 time for calcul the mask position with numpy : 0.0003616809844970703 nb_pixel_total : 15063 time to create 1 rle with old method : 0.01777482032775879 length of segment : 138 time for calcul the mask position with numpy : 0.005086183547973633 nb_pixel_total : 154250 time to create 1 rle with new method : 0.016229867935180664 length of segment : 624 time for calcul the mask position with numpy : 0.0005030632019042969 nb_pixel_total : 13244 time to create 1 rle with old method : 0.015636920928955078 length of segment : 139 time for calcul the mask position with numpy : 0.0011954307556152344 nb_pixel_total : 52746 time to create 1 rle with old method : 0.06113171577453613 length of segment : 301 time for calcul the mask position with numpy : 0.00047135353088378906 nb_pixel_total : 25908 time to create 1 rle with old method : 0.0305783748626709 length of segment : 165 time for calcul the mask position with numpy : 0.00070953369140625 nb_pixel_total : 36897 time to create 1 rle with old method : 0.04330110549926758 length of segment : 167 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 4840 time to create 1 rle with old method : 0.005963563919067383 length of segment : 77 time for calculnb_pixel_total : 47075 time to create 1 rle with old method : 0.055672407150268555 length of segment : 286 time for calcul the mask position with numpy : 0.0016436576843261719 nb_pixel_total : 38109 time to create 1 rle with old method : 0.04473447799682617 length of segment : 298 time for calcul the mask position with numpy : 0.0008857250213623047 nb_pixel_total : 18775 time to create 1 rle with old method : 0.02205371856689453 length of segment : 202 time for calcul the mask position with numpy : 0.006561279296875 nb_pixel_total : 192796 time to create 1 rle with new method : 0.010237455368041992 length of segment : 445 time for calcul the mask position with numpy : 0.0016663074493408203 nb_pixel_total : 25455 time to create 1 rle with old method : 0.02961277961730957 length of segment : 272 time for calcul the mask position with numpy : 0.0022902488708496094 nb_pixel_total : 103326 time to create 1 rle with old method : 0.12112903594970703 length of segment : 298 time for calcul the mask position with numpy : 0.002621173858642578 nb_pixel_total : 54369 time to create 1 rle with old method : 0.06406998634338379 length of segment : 343 time for calcul the mask position with numpy : 0.0015017986297607422 nb_pixel_total : 22415 time to create 1 rle with old method : 0.029552221298217773 length of segment : 234 time for calcul the mask position with numpy : 0.001283884048461914 nb_pixel_total : 20323 time to create 1 rle with old method : 0.023821592330932617 length of segment : 211 time for calcul the mask position with numpy : 0.004838228225708008 nb_pixel_total : 110715 time to create 1 rle with old method : 0.12737345695495605 length of segment : 340 time for calcul the mask position with numpy : 0.001399993896484375 nb_pixel_total : 32513 time to create 1 rle with old method : 0.0378422737121582 length of segment : 351 time for calcul the mask position with numpy : 0.0011146068572998047 nb_pixel_total : 30317 time to create 1 rle with old method : 0.03670334815979004 length of segment : 216 time for calcul the mask position with numpy : 0.0005137920379638672 nb_pixel_total : 10827 time to create 1 rle with old method : 0.012790441513061523 length of segment : 124 time for calcul the mask position with numpy : 0.0030639171600341797 nb_pixel_total : 123851 time to create 1 rle with old method : 0.14028167724609375 length of segment : 409 time for calcul the mask position with numpy : 0.008227109909057617 nb_pixel_total : 356957 time to create 1 rle with new method : 0.01641106605529785 length of segment : 867 time for calcul the mask position with numpy : 0.00040793418884277344 nb_pixel_total : 9945 time to create 1 rle with old method : 0.011728525161743164 length of segment : 153 time for calcul the mask position with numpy : 0.00034689903259277344 nb_pixel_total : 16642 time to create 1 rle with old method : 0.01966118812561035 length of segment : 145 time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 30322 time to create 1 rle with old method : 0.03546714782714844 length of segment : 378 time for calcul the mask position with numpy : 0.0014033317565917969 nb_pixel_total : 66806 time to create 1 rle with old method : 0.07806277275085449 length of segment : 217 time for calcul the mask position with numpy : 0.036837100982666016 nb_pixel_total : 585767 time to create 1 rle with new method : 0.23206806182861328 length of segment : 1517 time for calcul the mask position with numpy : 0.0021140575408935547 nb_pixel_total : 93602 time to create 1 rle with old method : 0.11464595794677734 length of segment : 499 time for calcul the mask position with numpy : 0.0013110637664794922 nb_pixel_total : 26416 time to create 1 rle with old method : 0.03373146057128906 length of segment : 189 time for calcul the mask position with numpy : 0.0028984546661376953 nb_pixel_total : 82697 time to create 1 rle with old method : 0.09465765953063965 length of segment : 615 time for calcul the mask position with numpy : 0.013780593872070312 nb_pixel_total : 331383 time to create 1 rle with new method : 0.04401350021362305 length of segment : 752 time for calcul the mask position with numpy : 0.0009248256683349609 nb_pixel_total : 20375 time to create 1 rle with old method : 0.025070667266845703 length of segment : 193 time for calcul the mask position with numpy : 0.0007495880126953125 nb_pixel_total : 23178 time to create 1 rle with old method : 0.03977847099304199 length of segment : 187 time for calcul the mask position with numpy : 0.003353118896484375 nb_pixel_total : 101002 time to create 1 rle with old method : 0.1169583797454834 length of segment : 511 time for calcul the mask position with numpy : 0.010227203369140625 nb_pixel_total : 288972 time to create 1 rle with new method : 0.02231001853942871 length of segment : 822 time for calcul the mask position with numpy : 0.013085365295410156 nb_pixel_total : 303793 time to create 1 rle with new method : 0.055387258529663086 length of segment : 630 time for calcul the mask position with numpy : 0.00628662109375 nb_pixel_total : 214921 time to create 1 rle with new method : 0.016958951950073242 length of segment : 527 time for calcul the mask position with numpy : 0.0016105175018310547 nb_pixel_total : 39998 time to create 1 rle with old method : 0.04721260070800781 length of segment : 259 time for calcul the mask position with numpy : 0.003451824188232422 nb_pixel_total : 86178 time to create 1 rle with old method : 0.10009908676147461 length of segment : 357 time for calcul the mask position with numpy : 0.0010142326354980469 nb_pixel_total : 23906 time to create 1 rle with old method : 0.028598308563232422 length of segment : 131 time for calcul the mask position with numpy : 0.008816957473754883 nb_pixel_total : 197922 time to create 1 rle with new method : 0.014131784439086914 length of segment : 859 time for calcul the mask position with numpy : 0.0025031566619873047 nb_pixel_total : 61908 time to create 1 rle with old method : 0.07608151435852051 length of segment : 352 time for calcul the mask position with numpy : 0.0005562305450439453 nb_pixel_total : 4744 time to create 1 rle with old method : 0.006062507629394531 length of segment : 98 time for calcul the mask position with numpy : 0.0007443428039550781 nb_pixel_total : 9661 time to create 1 rle with old method : 0.011803627014160156 length of segment : 141 time for calcul the mask position with numpy : 0.0007853507995605469 nb_pixel_total : 17640 time to create 1 rle with old method : 0.022644519805908203 length of segment : 105 time for calcul the mask position with numpy : 0.0009515285491943359 nb_pixel_total : 17793 time to create 1 rle with old method : 0.027715206146240234 length of segment : 165 time for calcul the mask position with numpy : 0.002046346664428711 nb_pixel_total : 35164 time to create 1 rle with old method : 0.04120612144470215 length of segment : 303 time for calcul the mask position with numpy : 0.01031184196472168 nb_pixel_total : 229360 time to create 1 rle with new method : 0.02376866340637207 length of segment : 690 time for calcul the mask position with numpy : 0.002009868621826172 nb_pixel_total : 43918 time to create 1 rle with old method : 0.052156925201416016 length of segment : 445 time for calcul the mask position with numpy : 0.0030074119567871094 nb_pixel_total : 45434 time to create 1 rle with old method : 0.05264425277709961 length of segment : 310 time for calcul the mask position with numpy : 0.003278017044067383 nb_pixel_total : 46346 time to create 1 rle with old method : 0.06133604049682617 length of segment : 404 time for calcul the mask position with numpy : 0.005300998687744141 nb_pixel_total : 140773 time to create 1 rle with old method : 0.16379833221435547 length of segment : 474 time for calcul the mask position with numpy : 0.0012094974517822266 nb_pixel_total : 21567 time to create 1 rle with old method : 0.025645017623901367 length of segment : 195 time for calcul the mask position with numpy : 0.0016090869903564453 nb_pixel_total : 24491 time to create 1 rle with old method : 0.029560565948486328 length of segment : 256 time for calcul the mask position with numpy : 0.0031173229217529297 nb_pixel_total : 71330 time to create 1 rle with old method : 0.08296775817871094 length of segment : 247 time for calcul the mask position with numpy : 0.0005626678466796875 nb_pixel_total : 13881 time to create 1 rle with old method : 0.01954817771911621 length of segment : 133 time for calcul the mask position with numpy : 0.0006556510925292969 nb_pixel_total : 15927 time to create 1 rle with old method : 0.018512487411499023 length of segment : 214 time for calcul the mask position with numpy : 0.005162239074707031 nb_pixel_total : 138922 time to create 1 rle with old method : 0.15817570686340332 length of segment : 534 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 17508 time to create 1 rle with old method : 0.020303964614868164 length of segment : 163 time for calcul the mask position with numpy : 0.0025224685668945312 nb_pixel_total : 59049 time to create 1 rle with old method : 0.0697479248046875 length of segment : 402 time for calcul the mask position with numpy : 0.00044226646423339844 nb_pixel_total : 9119 time to create 1 rle with old method : 0.011044502258300781 length of segment : 86 time for calcul the mask position with numpy : 0.002749204635620117 nb_pixel_total : 56322 time to create 1 rle with old method : 0.06460309028625488 length of segment : 387 time for calcul the mask position with numpy : 0.009446859359741211 nb_pixel_total : 236859 time to create 1 rle with new method : 0.021547555923461914 length of segment : 678 time for calcul the mask position with numpy : 0.0033228397369384766 nb_pixel_total : 155149 time to create 1 rle with new method : 0.008533239364624023 length of segment : 342 time for calcul the mask position with numpy : 0.017609119415283203 nb_pixel_total : 455738 time to create 1 rle with new method : 0.05055689811706543 length of segment : 933 time for calcul the mask position with numpy : 0.0010249614715576172 nb_pixel_total : 19660 time to create 1 rle with old method : 0.022910118103027344 length of segment : 230 time for calcul the mask position with numpy : 0.003214120864868164 nb_pixel_total : 50576 time to create 1 rle with old method : 0.06222248077392578 length of segment : 284 time for calcul the mask position with numpy : 0.0023894309997558594 nb_pixel_total : 66468 time to create 1 rle with old method : 0.07541537284851074 length of segment : 344 time for calcul the mask position with numpy : 0.0023412704467773438 nb_pixel_total : 51916 time to create 1 rle with old method : 0.06141471862792969 length of segment : 299 time for calcul the mask position with numpy : 0.006208181381225586 nb_pixel_total : 132626 time to create 1 rle with old method : 0.1612720489501953 length of segment : 674 time for calcul the mask position with numpy : 0.004800081253051758 nb_pixel_total : 120566 time to create 1 rle with old method : 0.14097237586975098 length of segment : 320 time for calcul the mask position with numpy : 0.012652158737182617 nb_pixel_total : 349116 time to create 1 rle with new method : 0.0360713005065918 length of segment : 598 time for calcul the mask position with numpy : 0.003152608871459961 nb_pixel_total : 99942 time to create 1 rle with old method : 0.11510896682739258 length of segment : 273 time for calcul the mask position with numpy : 0.004049062728881836 nb_pixel_total : 131211 time to create 1 rle with old method : 0.1524364948272705 length of segment : 452 time for calcul the mask position with numpy : 0.003950357437133789 nb_pixel_total : 97082 time to create 1 rle with old method : 0.11571311950683594 length of segment : 316 time for calcul the mask position with numpy : 0.0021157264709472656 nb_pixel_total : 59475 time to create 1 rle with old method : 0.06968355178833008 length of segment : 254 time for calcul the mask position with numpy : 0.006758928298950195 nb_pixel_total : 128227 time to create 1 rle with old method : 0.1808030605316162 length of segment : 591 time for calcul the mask position with numpy : 0.002506732940673828 nb_pixel_total : 42258 time to create 1 rle with old method : 0.04935503005981445 length of segment : 371 time for calcul the mask position with numpy : 0.0005259513854980469 nb_pixel_total : 8474 time to create 1 rle with old method : 0.010338544845581055 length of segment : 115 time for calcul the mask position with numpy : 0.0005025863647460938 nb_pixel_total : 10660 time to create 1 rle with old method : 0.012824296951293945 length of segment : 111 time for calcul the mask position with numpy : 0.0009529590606689453 nb_pixel_total : 17462 time to create 1 rle with old method : 0.0207064151763916 length of segment : 314 time for calcul the mask position with numpy : 0.003929853439331055 nb_pixel_total : 71156 time to create 1 rle with old method : 0.10386133193969727 length of segment : 394 time for calcul the mask position with numpy : 0.0016467571258544922 nb_pixel_total : 28129 time to create 1 rle with old method : 0.033406734466552734 length of segment : 282 time for calcul the mask position with numpy : 0.0012257099151611328 nb_pixel_total : 24474 time to create 1 rle with old method : 0.028798580169677734 length of segment : 335 time for calcul the mask position with numpy : 0.0027952194213867188 nb_pixel_total : 53676 time to create 1 rle with old method : 0.08008313179016113 length of segment : 241 time for calcul the mask position with numpy : 0.007178068161010742 nb_pixel_total : 204957 time to create 1 rle with new method : 0.012555360794067383 length of segment : 519 time for calcul the mask position with numpy : 0.004166364669799805 nb_pixel_total : 118310 time to create 1 rle with old method : 0.13452649116516113 length of segment : 366 time for calcul the mask position with numpy : 0.0006151199340820312 nb_pixel_total : 12547 time to create 1 rle with old method : 0.016715526580810547 length of segment : 125 time for calcul the mask position with numpy : 0.016616344451904297 nb_pixel_total : 577144 time to create 1 rle with new method : 0.1224968433380127 length of segment : 986 time for calcul the mask position with numpy : 0.0014531612396240234 nb_pixel_total : 32320 time to create 1 rle with old method : 0.04743623733520508 length of segment : 339 time for calcul the mask position with numpy : 0.00061798095703125 nb_pixel_total : 15086 time to create 1 rle with old method : 0.0184023380279541 length of segment : 115 time for calcul the mask position with numpy : 0.0008473396301269531 nb_pixel_total : 21201 time to create 1 rle with old method : 0.02658557891845703 length of segment : 184 time for calcul the mask position with numpy : 0.0018389225006103516 nb_pixel_total : 52810 time to create 1 rle with old method : 0.06792068481445312 length of segment : 305 time for calcul the mask position with numpy : 0.013142585754394531 nb_pixel_total : 256623 time to create 1 rle with new method : 0.038680076599121094 length of segment : 795 time for calcul the mask position with numpy : 0.0015077590942382812 nb_pixel_total : 39770 time to create 1 rle with old method : 0.05108213424682617 length of segment : 223 time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 19521 time to create 1 rle with old method : 0.023247957229614258 length of segment : 185 time for calcul the mask position with numpy : 0.004872560501098633 nb_pixel_total : 215933 time to create 1 rle with new method : 0.01288604736328125 length of segment : 572 time for calcul the mask position with numpy : 0.0006608963012695312 nb_pixel_total : 9844 time to create 1 rle with old method : 0.01177072525024414 length of segment : 183 time for calcul the mask position with numpy : 0.000537872314453125 nb_pixel_total : 12466 time to create 1 rle with old method : 0.015433788299560547 length of segment : 101 time for calcul the mask position with numpy : 0.0012593269348144531 nb_pixel_total : 34674 time to create 1 rle with old method : 0.03955650329589844 length of segment : 225 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 8574 time to create 1 rle with old method : 0.010391712188720703 length of segment : 104 time spent for convertir_results : 14.912518739700317 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 134 chid ids of type : 3594 Number RLEs to save : 46422 save missing photos in datou_result : time spend for datou_step_exec : 89.46641635894775 time spend to save output : 2.7568819522857666 total time spend for step 1 : 92.22329831123352 step2:crop_condition Mon May 5 21:32:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 134 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 88 About to insert : list_path_to_insert length 88 new photo from crops ! About to upload 88 photos upload in portfolio : 3736932 init cache_photo without model_param we have 88 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746473552_2406760 we have uploaded 88 photos in the portfolio 3736932 time of upload the photos Elapsed time : 23.946715831756592 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746473583_2406760 we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.1197352409362793 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746473588_2406760 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6559431552886963 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746473608_2406760 we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.656442403793335 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746473618_2406760 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5952818393707275 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356119400, 1356119341, 1356119336, 1356119331, 1356119291, 1356119285, 1356119280, 1356119277] Looping around the photos to save general results len do output : 134 /1356208104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356208424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119400', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119341', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119336', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119331', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119291', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119285', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119280', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119277', None, None, None, None, None, '2794744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 410 time used for this insertion : 0.030052900314331055 save_final save missing photos in datou_result : time spend for datou_step_exec : 96.80344009399414 time spend to save output : 0.03454446792602539 total time spend for step 2 : 96.83798456192017 step3:rle_unique_nms_with_priority Mon May 5 21:33:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 134 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 6.9871015548706055 time for calcul the mask position with numpy : 0.49062561988830566 nb_pixel_total : 6427352 time to create 1 rle with new method : 0.9394354820251465 time for calcul the mask position with numpy : 0.023145437240600586 nb_pixel_total : 25902 time to create 1 rle with old method : 0.029627561569213867 time for calcul the mask position with numpy : 0.023198604583740234 nb_pixel_total : 52746 time to create 1 rle with old method : 0.08253836631774902 time for calcul the mask position with numpy : 0.02527642250061035 nb_pixel_total : 13244 time to create 1 rle with old method : 0.015118598937988281 time for calcul the mask position with numpy : 0.023473024368286133 nb_pixel_total : 154250 time to create 1 rle with new method : 0.9075753688812256 time for calcul the mask position with numpy : 0.0222928524017334 nb_pixel_total : 15063 time to create 1 rle with old method : 0.017487764358520508 time for calcul the mask position with numpy : 0.023268938064575195 nb_pixel_total : 134344 time to create 1 rle with old method : 0.15381121635437012 time for calcul the mask position with numpy : 0.023090600967407227 nb_pixel_total : 17965 time to create 1 rle with old method : 0.020517826080322266 time for calcul the mask position with numpy : 0.022068500518798828 nb_pixel_total : 12165 time to create 1 rle with old method : 0.013870954513549805 time for calcul the mask position with numpy : 0.022925376892089844 nb_pixel_total : 44070 time to create 1 rle with old method : 0.05237078666687012 time for calcul the mask position with numpy : 0.031311750411987305 nb_pixel_total : 39661 time to create 1 rle with old method : 0.04826974868774414 time for calcul the mask position with numpy : 0.02397298812866211 nb_pixel_total : 6772 time to create 1 rle with old method : 0.007847785949707031 time for calcul the mask position with numpy : 0.023463726043701172 nb_pixel_total : 26126 time to create 1 rle with old method : 0.03019237518310547 time for calcul the mask position with numpy : 0.023114681243896484 nb_pixel_total : 39664 time to create 1 rle with old method : 0.04561138153076172 time for calcul the mask position with numpy : 0.022108078002929688 nb_pixel_total : 22642 time to create 1 rle with old method : 0.026243925094604492 time for calcul the mask position with numpy : 0.02308511734008789 nb_pixel_total : 18274 time to create 1 rle with old method : 0.021274328231811523 create new chi : 3.3247337341308594 time to delete rle : 0.023373126983642578 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8967 TO DO : save crop sub photo not yet done ! save time : 0.5763757228851318 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 6.875674486160278 time for calcul the mask position with numpy : 0.5282061100006104 nb_pixel_total : 5745503 time to create 1 rle with new method : 0.8869996070861816 time for calcul the mask position with numpy : 0.020749330520629883 nb_pixel_total : 31863 time to create 1 rle with old method : 0.035292625427246094 time for calcul the mask position with numpy : 0.024224042892456055 nb_pixel_total : 363489 time to create 1 rle with new method : 0.8277840614318848 time for calcul the mask position with numpy : 0.021548986434936523 nb_pixel_total : 12212 time to create 1 rle with old method : 0.01433110237121582 time for calcul the mask position with numpy : 0.031085729598999023 nb_pixel_total : 28264 time to create 1 rle with old method : 0.032706499099731445 time for calcul the mask position with numpy : 0.03511548042297363 nb_pixel_total : 38800 time to create 1 rle with old method : 0.044754981994628906 time for calcul the mask position with numpy : 0.03446817398071289 nb_pixel_total : 17113 time to create 1 rle with old method : 0.01969599723815918 time for calcul the mask position with numpy : 0.031119585037231445 nb_pixel_total : 18229 time to create 1 rle with old method : 0.021103382110595703 time for calcul the mask position with numpy : 0.03312230110168457 nb_pixel_total : 31931 time to create 1 rle with old method : 0.04618072509765625 time for calcul the mask position with numpy : 0.023894309997558594 nb_pixel_total : 70974 time to create 1 rle with old method : 0.09181976318359375 time for calcul the mask position with numpy : 0.02906346321105957 nb_pixel_total : 321199 time to create 1 rle with new method : 0.6318562030792236 time for calcul the mask position with numpy : 0.022270917892456055 nb_pixel_total : 21780 time to create 1 rle with old method : 0.024980783462524414 time for calcul the mask position with numpy : 0.023839712142944336 nb_pixel_total : 81150 time to create 1 rle with old method : 0.09210395812988281 time for calcul the mask position with numpy : 0.023733139038085938 nb_pixel_total : 161867 time to create 1 rle with new method : 1.070157527923584 time for calcul the mask position with numpy : 0.023315906524658203 nb_pixel_total : 26996 time to create 1 rle with old method : 0.03060126304626465 time for calcul the mask position with numpy : 0.022827863693237305 nb_pixel_total : 11541 time to create 1 rle with old method : 0.013153314590454102 time for calcul the mask position with numpy : 0.02720808982849121 nb_pixel_total : 25592 time to create 1 rle with old method : 0.02898573875427246 time for calcul the mask position with numpy : 0.025681734085083008 nb_pixel_total : 4840 time to create 1 rle with old method : 0.005563497543334961 time for calcul the mask position with numpy : 0.023829936981201172 nb_pixel_total : 36897 time to create 1 rle with old method : 0.048824310302734375 create new chi : 5.086381912231445 time to delete rle : 0.0021622180938720703 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 15280 TO DO : save crop sub photo not yet done ! save time : 1.0122966766357422 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 7.326303958892822 time for calcul the mask position with numpy : 0.6123940944671631 nb_pixel_total : 5671538 time to create 1 rle with new method : 0.849175214767456 time for calcul the mask position with numpy : 0.020853042602539062 nb_pixel_total : 32513 time to create 1 rle with old method : 0.03757166862487793 time for calcul the mask position with numpy : 0.023552894592285156 nb_pixel_total : 110715 time to create 1 rle with old method : 0.14053964614868164 time for calcul the mask position with numpy : 0.021490812301635742 nb_pixel_total : 20323 time to create 1 rle with old method : 0.023247718811035156 time for calcul the mask position with numpy : 0.0225675106048584 nb_pixel_total : 22415 time to create 1 rle with old method : 0.025274276733398438 time for calcul the mask position with numpy : 0.02203989028930664 nb_pixel_total : 54369 time to create 1 rle with old method : 0.06154179573059082 time for calcul the mask position with numpy : 0.023079395294189453 nb_pixel_total : 103121 time to create 1 rle with old method : 0.11867523193359375 time for calcul the mask position with numpy : 0.021227121353149414 nb_pixel_total : 25455 time to create 1 rle with old method : 0.029358863830566406 time for calcul the mask position with numpy : 0.022701025009155273 nb_pixel_total : 192796 time to create 1 rle with new method : 0.7614810466766357 time for calcul the mask position with numpy : 0.021524667739868164 nb_pixel_total : 18775 time to create 1 rle with old method : 0.021184682846069336 time for calcul the mask position with numpy : 0.02396392822265625 nb_pixel_total : 38109 time to create 1 rle with old method : 0.04408884048461914 time for calcul the mask position with numpy : 0.023743391036987305 nb_pixel_total : 47075 time to create 1 rle with old method : 0.05432915687561035 time for calcul the mask position with numpy : 0.02219080924987793 nb_pixel_total : 15870 time to create 1 rle with old method : 0.018308401107788086 time for calcul the mask position with numpy : 0.025376081466674805 nb_pixel_total : 31383 time to create 1 rle with old method : 0.05172014236450195 time for calcul the mask position with numpy : 0.0239105224609375 nb_pixel_total : 18500 time to create 1 rle with old method : 0.02093791961669922 time for calcul the mask position with numpy : 0.026036500930786133 nb_pixel_total : 565953 time to create 1 rle with new method : 0.7143433094024658 time for calcul the mask position with numpy : 0.022675752639770508 nb_pixel_total : 30770 time to create 1 rle with old method : 0.04246783256530762 time for calcul the mask position with numpy : 0.02497696876525879 nb_pixel_total : 22986 time to create 1 rle with old method : 0.030208110809326172 time for calcul the mask position with numpy : 0.023884296417236328 nb_pixel_total : 27574 time to create 1 rle with old method : 0.03514742851257324 create new chi : 4.193237543106079 time to delete rle : 0.002232789993286133 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 13505 TO DO : save crop sub photo not yet done ! save time : 0.8779797554016113 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.198164701461792 time for calcul the mask position with numpy : 0.5737888813018799 nb_pixel_total : 6419321 time to create 1 rle with new method : 0.7856464385986328 time for calcul the mask position with numpy : 0.021387815475463867 nb_pixel_total : 66806 time to create 1 rle with old method : 0.07670307159423828 time for calcul the mask position with numpy : 0.02133941650390625 nb_pixel_total : 30322 time to create 1 rle with old method : 0.03475475311279297 time for calcul the mask position with numpy : 0.021155834197998047 nb_pixel_total : 1894 time to create 1 rle with old method : 0.0023026466369628906 time for calcul the mask position with numpy : 0.02150559425354004 nb_pixel_total : 9945 time to create 1 rle with old method : 0.011459112167358398 time for calcul the mask position with numpy : 0.024571895599365234 nb_pixel_total : 356957 time to create 1 rle with new method : 0.47501039505004883 time for calcul the mask position with numpy : 0.02141547203063965 nb_pixel_total : 123851 time to create 1 rle with old method : 0.1416304111480713 time for calcul the mask position with numpy : 0.023405790328979492 nb_pixel_total : 10827 time to create 1 rle with old method : 0.01272892951965332 time for calcul the mask position with numpy : 0.022315502166748047 nb_pixel_total : 30317 time to create 1 rle with old method : 0.034781694412231445 create new chi : 2.3875997066497803 time to delete rle : 0.0009970664978027344 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 7004 TO DO : save crop sub photo not yet done ! save time : 0.4971621036529541 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 7.3384668827056885 time for calcul the mask position with numpy : 0.9914202690124512 nb_pixel_total : 4621808 time to create 1 rle with new method : 0.9887824058532715 time for calcul the mask position with numpy : 0.03707528114318848 nb_pixel_total : 4744 time to create 1 rle with old method : 0.0054340362548828125 time for calcul the mask position with numpy : 0.03582501411437988 nb_pixel_total : 61908 time to create 1 rle with old method : 0.06993865966796875 time for calcul the mask position with numpy : 0.03579378128051758 nb_pixel_total : 197922 time to create 1 rle with new method : 0.9121441841125488 time for calcul the mask position with numpy : 0.03683662414550781 nb_pixel_total : 6900 time to create 1 rle with old method : 0.00831747055053711 time for calcul the mask position with numpy : 0.036062002182006836 nb_pixel_total : 86178 time to create 1 rle with old method : 0.09836387634277344 time for calcul the mask position with numpy : 0.03671145439147949 nb_pixel_total : 39998 time to create 1 rle with old method : 0.04568839073181152 time for calcul the mask position with numpy : 0.0355677604675293 nb_pixel_total : 214917 time to create 1 rle with new method : 0.4761936664581299 time for calcul the mask position with numpy : 0.03304600715637207 nb_pixel_total : 303793 time to create 1 rle with new method : 0.9454996585845947 time for calcul the mask position with numpy : 0.03542613983154297 nb_pixel_total : 288972 time to create 1 rle with new method : 0.5927836894989014 time for calcul the mask position with numpy : 0.03173089027404785 nb_pixel_total : 101002 time to create 1 rle with old method : 0.11501073837280273 time for calcul the mask position with numpy : 0.021216154098510742 nb_pixel_total : 22637 time to create 1 rle with old method : 0.025949478149414062 time for calcul the mask position with numpy : 0.0213162899017334 nb_pixel_total : 20358 time to create 1 rle with old method : 0.02353358268737793 time for calcul the mask position with numpy : 0.023322582244873047 nb_pixel_total : 331383 time to create 1 rle with new method : 1.103614330291748 time for calcul the mask position with numpy : 0.038457632064819336 nb_pixel_total : 82697 time to create 1 rle with old method : 0.09714031219482422 time for calcul the mask position with numpy : 0.03689265251159668 nb_pixel_total : 26416 time to create 1 rle with old method : 0.03044748306274414 time for calcul the mask position with numpy : 0.036598920822143555 nb_pixel_total : 52840 time to create 1 rle with old method : 0.05946946144104004 time for calcul the mask position with numpy : 0.042893171310424805 nb_pixel_total : 585767 time to create 1 rle with new method : 0.8220345973968506 create new chi : 8.164904594421387 time to delete rle : 0.0038480758666992188 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 18422 TO DO : save crop sub photo not yet done ! save time : 1.2123908996582031 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 8.09369444847107 time for calcul the mask position with numpy : 0.4539971351623535 nb_pixel_total : 5714179 time to create 1 rle with new method : 0.7433648109436035 time for calcul the mask position with numpy : 0.03487062454223633 nb_pixel_total : 84997 time to create 1 rle with old method : 0.11071562767028809 time for calcul the mask position with numpy : 0.0410761833190918 nb_pixel_total : 236859 time to create 1 rle with new method : 0.6929256916046143 time for calcul the mask position with numpy : 0.03503608703613281 nb_pixel_total : 56322 time to create 1 rle with old method : 0.06407761573791504 time for calcul the mask position with numpy : 0.034395694732666016 nb_pixel_total : 9119 time to create 1 rle with old method : 0.010326147079467773 time for calcul the mask position with numpy : 0.03557252883911133 nb_pixel_total : 59049 time to create 1 rle with old method : 0.06734538078308105 time for calcul the mask position with numpy : 0.03765463829040527 nb_pixel_total : 17508 time to create 1 rle with old method : 0.02001476287841797 time for calcul the mask position with numpy : 0.038741111755371094 nb_pixel_total : 138922 time to create 1 rle with old method : 0.16256308555603027 time for calcul the mask position with numpy : 0.034364938735961914 nb_pixel_total : 15927 time to create 1 rle with old method : 0.018168926239013672 time for calcul the mask position with numpy : 0.03405356407165527 nb_pixel_total : 13881 time to create 1 rle with old method : 0.01577925682067871 time for calcul the mask position with numpy : 0.03571677207946777 nb_pixel_total : 71330 time to create 1 rle with old method : 0.08119344711303711 time for calcul the mask position with numpy : 0.0335545539855957 nb_pixel_total : 24491 time to create 1 rle with old method : 0.028082609176635742 time for calcul the mask position with numpy : 0.02086663246154785 nb_pixel_total : 21567 time to create 1 rle with old method : 0.024685382843017578 time for calcul the mask position with numpy : 0.0220947265625 nb_pixel_total : 140773 time to create 1 rle with old method : 0.1603689193725586 time for calcul the mask position with numpy : 0.02213764190673828 nb_pixel_total : 46346 time to create 1 rle with old method : 0.05250358581542969 time for calcul the mask position with numpy : 0.022587060928344727 nb_pixel_total : 45434 time to create 1 rle with old method : 0.059549570083618164 time for calcul the mask position with numpy : 0.02514362335205078 nb_pixel_total : 43918 time to create 1 rle with old method : 0.07402157783508301 time for calcul the mask position with numpy : 0.03600597381591797 nb_pixel_total : 229360 time to create 1 rle with new method : 0.6554312705993652 time for calcul the mask position with numpy : 0.03382158279418945 nb_pixel_total : 35164 time to create 1 rle with old method : 0.04005122184753418 time for calcul the mask position with numpy : 0.02992987632751465 nb_pixel_total : 17793 time to create 1 rle with old method : 0.020341157913208008 time for calcul the mask position with numpy : 0.033284664154052734 nb_pixel_total : 17640 time to create 1 rle with old method : 0.019966840744018555 time for calcul the mask position with numpy : 0.03276562690734863 nb_pixel_total : 9661 time to create 1 rle with old method : 0.011293888092041016 create new chi : 4.345215559005737 time to delete rle : 0.0024950504302978516 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 15424 TO DO : save crop sub photo not yet done ! save time : 0.9739198684692383 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 8.113450765609741 time for calcul the mask position with numpy : 0.4862802028656006 nb_pixel_total : 5109725 time to create 1 rle with new method : 0.5372433662414551 time for calcul the mask position with numpy : 0.020992040634155273 nb_pixel_total : 28129 time to create 1 rle with old method : 0.0319066047668457 time for calcul the mask position with numpy : 0.02106785774230957 nb_pixel_total : 71156 time to create 1 rle with old method : 0.08113932609558105 time for calcul the mask position with numpy : 0.020925045013427734 nb_pixel_total : 17462 time to create 1 rle with old method : 0.020137786865234375 time for calcul the mask position with numpy : 0.02078104019165039 nb_pixel_total : 10660 time to create 1 rle with old method : 0.01220846176147461 time for calcul the mask position with numpy : 0.024918794631958008 nb_pixel_total : 8474 time to create 1 rle with old method : 0.0097808837890625 time for calcul the mask position with numpy : 0.022181272506713867 nb_pixel_total : 42258 time to create 1 rle with old method : 0.050595998764038086 time for calcul the mask position with numpy : 0.02766871452331543 nb_pixel_total : 128227 time to create 1 rle with old method : 0.16821050643920898 time for calcul the mask position with numpy : 0.02420830726623535 nb_pixel_total : 59475 time to create 1 rle with old method : 0.06768941879272461 time for calcul the mask position with numpy : 0.022778034210205078 nb_pixel_total : 96889 time to create 1 rle with old method : 0.11722278594970703 time for calcul the mask position with numpy : 0.022968292236328125 nb_pixel_total : 131211 time to create 1 rle with old method : 0.14989471435546875 time for calcul the mask position with numpy : 0.023552656173706055 nb_pixel_total : 99908 time to create 1 rle with old method : 0.11328959465026855 time for calcul the mask position with numpy : 0.024801254272460938 nb_pixel_total : 349116 time to create 1 rle with new method : 0.5569665431976318 time for calcul the mask position with numpy : 0.02339959144592285 nb_pixel_total : 120566 time to create 1 rle with old method : 0.13710618019104004 time for calcul the mask position with numpy : 0.0223538875579834 nb_pixel_total : 132626 time to create 1 rle with old method : 0.1502668857574463 time for calcul the mask position with numpy : 0.022792577743530273 nb_pixel_total : 51916 time to create 1 rle with old method : 0.05962252616882324 time for calcul the mask position with numpy : 0.023503541946411133 nb_pixel_total : 66468 time to create 1 rle with old method : 0.07740640640258789 time for calcul the mask position with numpy : 0.024367332458496094 nb_pixel_total : 50576 time to create 1 rle with old method : 0.06664586067199707 time for calcul the mask position with numpy : 0.03438305854797363 nb_pixel_total : 19660 time to create 1 rle with old method : 0.022350311279296875 time for calcul the mask position with numpy : 0.03817486763000488 nb_pixel_total : 455738 time to create 1 rle with new method : 0.6794400215148926 create new chi : 4.149278402328491 time to delete rle : 0.0024611949920654297 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 16406 TO DO : save crop sub photo not yet done ! save time : 1.0609486103057861 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 7.758940696716309 time for calcul the mask position with numpy : 0.8084816932678223 nb_pixel_total : 5346512 time to create 1 rle with new method : 0.7951922416687012 time for calcul the mask position with numpy : 0.03473973274230957 nb_pixel_total : 8574 time to create 1 rle with old method : 0.009848833084106445 time for calcul the mask position with numpy : 0.03470420837402344 nb_pixel_total : 34674 time to create 1 rle with old method : 0.04209160804748535 time for calcul the mask position with numpy : 0.03716015815734863 nb_pixel_total : 12466 time to create 1 rle with old method : 0.014385461807250977 time for calcul the mask position with numpy : 0.03741621971130371 nb_pixel_total : 9844 time to create 1 rle with old method : 0.011511087417602539 time for calcul the mask position with numpy : 0.036617279052734375 nb_pixel_total : 215933 time to create 1 rle with new method : 1.0136747360229492 time for calcul the mask position with numpy : 0.03428483009338379 nb_pixel_total : 19521 time to create 1 rle with old method : 0.022300004959106445 time for calcul the mask position with numpy : 0.03462481498718262 nb_pixel_total : 39770 time to create 1 rle with old method : 0.0452883243560791 time for calcul the mask position with numpy : 0.036828041076660156 nb_pixel_total : 256415 time to create 1 rle with new method : 0.8153254985809326 time for calcul the mask position with numpy : 0.030362844467163086 nb_pixel_total : 52338 time to create 1 rle with old method : 0.06764078140258789 time for calcul the mask position with numpy : 0.034638404846191406 nb_pixel_total : 21201 time to create 1 rle with old method : 0.028900623321533203 time for calcul the mask position with numpy : 0.03142666816711426 nb_pixel_total : 15086 time to create 1 rle with old method : 0.017410755157470703 time for calcul the mask position with numpy : 0.022855281829833984 nb_pixel_total : 32320 time to create 1 rle with old method : 0.0368344783782959 time for calcul the mask position with numpy : 0.027264118194580078 nb_pixel_total : 571622 time to create 1 rle with new method : 0.8442156314849854 time for calcul the mask position with numpy : 0.032151222229003906 nb_pixel_total : 12547 time to create 1 rle with old method : 0.014370441436767578 time for calcul the mask position with numpy : 0.03546428680419922 nb_pixel_total : 118310 time to create 1 rle with old method : 0.14149045944213867 time for calcul the mask position with numpy : 0.03549838066101074 nb_pixel_total : 204957 time to create 1 rle with new method : 0.7251603603363037 time for calcul the mask position with numpy : 0.0370633602142334 nb_pixel_total : 53676 time to create 1 rle with old method : 0.06105375289916992 time for calcul the mask position with numpy : 0.03216242790222168 nb_pixel_total : 24474 time to create 1 rle with old method : 0.02786874771118164 create new chi : 6.277047634124756 time to delete rle : 0.0028810501098632812 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 13753 TO DO : save crop sub photo not yet done ! save time : 0.880803108215332 map_output_result : {1356119400: (0.0, 'Should be the crop_list due to order', 0), 1356119341: (0.0, 'Should be the crop_list due to order', 0), 1356119336: (0.0, 'Should be the crop_list due to order', 0), 1356119331: (0.0, 'Should be the crop_list due to order', 0), 1356119291: (0.0, 'Should be the crop_list due to order', 0), 1356119285: (0.0, 'Should be the crop_list due to order', 0), 1356119280: (0.0, 'Should be the crop_list due to order', 0), 1356119277: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356119400, 1356119341, 1356119336, 1356119331, 1356119291, 1356119285, 1356119280, 1356119277] Looping around the photos to save general results len do output : 8 /1356119400.Didn't retrieve data . /1356119341.Didn't retrieve data . /1356119336.Didn't retrieve data . /1356119331.Didn't retrieve data . /1356119291.Didn't retrieve data . /1356119285.Didn't retrieve data . /1356119280.Didn't retrieve data . /1356119277.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119400', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119341', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119336', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119331', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119291', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119285', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119280', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119277', None, None, None, None, None, '2794744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015712738037109375 save_final save missing photos in datou_result : time spend for datou_step_exec : 102.9727373123169 time spend to save output : 0.01609015464782715 total time spend for step 3 : 102.98882746696472 step4:ventilate_hashtags_in_portfolio Mon May 5 21:35:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22696244 get user id for portfolio 22696244 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22696244 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','background','carton','flou','autre','papier','pet_clair','metal','pehd','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22696244 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','background','carton','flou','autre','papier','pet_clair','metal','pehd','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22696244 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','background','carton','flou','autre','papier','pet_clair','metal','pehd','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22696456,22696457,22696458,22696459,22696460,22696461,22696462,22696463,22696464,22696465,22696466?tags=mal_croppe,background,carton,flou,autre,papier,pet_clair,metal,pehd,pet_fonce,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356119400, 1356119341, 1356119336, 1356119331, 1356119291, 1356119285, 1356119280, 1356119277] Looping around the photos to save general results len do output : 1 /22696244. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119400', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119341', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119336', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119331', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119291', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119285', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119280', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119277', None, None, None, None, None, '2794744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014568567276000977 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.801908016204834 time spend to save output : 0.015114307403564453 total time spend for step 4 : 0.8170223236083984 step5:final Mon May 5 21:35:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356119400: ('0.20116304551334419',), 1356119341: ('0.20116304551334419',), 1356119336: ('0.20116304551334419',), 1356119331: ('0.20116304551334419',), 1356119291: ('0.20116304551334419',), 1356119285: ('0.20116304551334419',), 1356119280: ('0.20116304551334419',), 1356119277: ('0.20116304551334419',)} new output for save of step final : {1356119400: ('0.20116304551334419',), 1356119341: ('0.20116304551334419',), 1356119336: ('0.20116304551334419',), 1356119331: ('0.20116304551334419',), 1356119291: ('0.20116304551334419',), 1356119285: ('0.20116304551334419',), 1356119280: ('0.20116304551334419',), 1356119277: ('0.20116304551334419',)} [1356119400, 1356119341, 1356119336, 1356119331, 1356119291, 1356119285, 1356119280, 1356119277] Looping around the photos to save general results len do output : 8 /1356119400.Didn't retrieve data . /1356119341.Didn't retrieve data . /1356119336.Didn't retrieve data . /1356119331.Didn't retrieve data . /1356119291.Didn't retrieve data . /1356119285.Didn't retrieve data . /1356119280.Didn't retrieve data . /1356119277.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119400', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119341', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119336', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119331', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119291', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119285', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119280', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119277', None, None, None, None, None, '2794744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01574087142944336 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14485669136047363 time spend to save output : 0.016255855560302734 total time spend for step 5 : 0.16111254692077637 step6:blur_detection Mon May 5 21:35:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63.jpg resize: (2160, 3264) 1356119400 -0.7029036102518486 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019.jpg resize: (2160, 3264) 1356119341 -2.024561845896738 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb.jpg resize: (2160, 3264) 1356119336 -0.03512448692053991 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a.jpg resize: (2160, 3264) 1356119331 0.4466040217041486 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b.jpg resize: (2160, 3264) 1356119291 -1.0283299902602876 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430.jpg resize: (2160, 3264) 1356119285 -0.5758223064592981 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932.jpg resize: (2160, 3264) 1356119280 -4.798689583579145 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567.jpg resize: (2160, 3264) 1356119277 0.00019098980998914756 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604394_0.png resize: (136, 194) 1356208104 -2.224335847969942 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604398_0.png resize: (138, 134) 1356208105 -1.0465364443036385 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604389_0.png resize: (177, 189) 1356208106 -0.7689150770272355 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604397_0.png resize: (585, 408) 1356208107 -0.764723981608028 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604386_0.png resize: (130, 204) 1356208108 -0.7361530498079305 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604393_0.png resize: (138, 127) 1356208109 -1.0806378970627488 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604392_0.png resize: (229, 260) 1356208110 0.34375953336647597 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604395_0.png resize: (488, 328) 1356208111 -0.3743588482226579 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604400_0.png resize: (147, 251) 1356208112 -0.653732739945113 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604391_0.png resize: (289, 209) 1356208113 -0.9869343762684734 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604390_0.png resize: (72, 114) 1356208114 2.5571379030951396 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604387_0.png resize: (194, 178) 1356208115 -0.4107799116889951 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604409_0.png resize: (1231, 520) 1356208116 -0.963808224969901 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604411_0.png resize: (321, 134) 1356208117 -1.529168741642569 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604405_0.png resize: (212, 212) 1356208118 -1.3589818263495215 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604413_0.png resize: (237, 120) 1356208119 -1.3726044974495988 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604402_0.png resize: (75, 83) 1356208120 0.4328376777433228 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604412_0.png resize: (191, 129) 1356208121 -1.7664598698868836 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604404_0.png resize: (174, 108) 1356208122 -2.3123841840981667 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604407_0.png resize: (416, 549) 1356208123 -1.1990636382228448 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604415_0.png resize: (158, 204) 1356208124 0.7706576193815249 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604401_0.png resize: (167, 309) 1356208125 -0.5791185432265837 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604414_0.png resize: (341, 198) 1356208126 -1.6058040390552757 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604416_0.png resize: (146, 170) 1356208127 -2.9120307729408834 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604408_0.png resize: (172, 179) 1356208128 -1.3773864545053374 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604403_0.png resize: (208, 176) 1356208129 -0.647998994203863 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604430_0.png resize: (270, 189) 1356208130 -1.9750147452675342 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604423_0.png resize: (149, 160) 1356208131 -0.9867153132577183 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604424_0.png resize: (278, 160) 1356208133 -0.3052510792199069 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604429_0.png resize: (445, 537) 1356208134 -1.0774533289056787 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604433_0.png resize: (232, 182) 1356208135 -2.191401936178597 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604421_0.png resize: (199, 213) 1356208136 -0.07395386108353566 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604436_0.png resize: (188, 239) 1356208137 -2.0710718791217944 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604420_0.png resize: (147, 232) 1356208138 -1.2872015768944272 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604427_0.png resize: (298, 203) 1356208139 -0.21848189318661976 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604425_0.png resize: (181, 125) 1356208140 -0.854738213622422 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604422_0.png resize: (1137, 677) 1356208142 -0.8368394331935918 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604419_0.png resize: (234, 195) 1356208143 -1.2172651157545458 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604440_0.png resize: (813, 589) 1356208144 -1.0773556971772467 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604442_0.png resize: (144, 215) 1356208145 -1.8847925097475593 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604443_0.png resize: (317, 168) 1356208146 -1.3120558925476997 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604438_0.png resize: (124, 123) 1356208147 -0.41111555111383935 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604444_0.png resize: (204, 373) 1356208148 0.9301266715969277 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604437_0.png resize: (216, 263) 1356208149 -1.248945704165109 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604445_0.png resize: (1285, 748) 1356208150 -0.9011643391829173 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604451_0.png resize: (154, 242) 1356208151 -1.9769025858303382 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604446_0.png resize: (421, 380) 1356208152 -1.8588818403905136 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604447_0.png resize: (177, 173) 1356208153 0.371933503797232 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604452_0.png resize: (510, 291) 1356208154 -0.6290701141308725 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604461_0.png resize: (98, 72) 1356208155 -1.230976749049349 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604456_0.png resize: (259, 251) 1356208156 -1.0406192284404459 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604470_0.png resize: (472, 392) 1356208157 -0.05200168212288981 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604467_0.png resize: (425, 189) 1356208158 -1.973002212803541 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604479_0.png resize: (85, 169) 1356208159 -1.3476614723395508 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604466_0.png resize: (685, 511) 1356208160 -0.589215158381215 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604477_0.png resize: (163, 163) 1356208161 -1.1373616469240935 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604465_0.png resize: (303, 198) 1356208162 -0.8754628496551695 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604475_0.png resize: (200, 109) 1356208163 -0.8144395034456438 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604478_0.png resize: (325, 262) 1356208164 -1.778182853787687 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604464_0.png resize: (165, 144) 1356208165 0.25711249895420774 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604463_0.png resize: (104, 194) 1356208166 2.4520230549867157 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604468_0.png resize: (303, 258) 1356208167 -1.7011145638079999 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604473_0.png resize: (245, 538) 1356208168 0.09264020443623976 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604462_0.png resize: (139, 118) 1356208169 -1.2530997942846174 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604469_0.png resize: (353, 286) 1356208170 -0.05086613274849461 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604476_0.png resize: (403, 517) 1356208171 -1.2817553543997844 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604474_0.png resize: (117, 183) 1356208172 -0.015800336308315784 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604471_0.png resize: (195, 250) 1356208173 -1.0260392333702446 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604489_0.png resize: (284, 580) 1356208174 -1.7729804149295394 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604494_0.png resize: (254, 300) 1356208175 -2.4633382531231565 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604486_0.png resize: (329, 282) 1356208176 -3.2447632312502614 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604484_0.png resize: (228, 126) 1356208177 -2.720559676493757 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604497_0.png resize: (115, 115) 1356208178 -1.8134692823846421 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604485_0.png resize: (187, 495) 1356208179 -4.238896344878041 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604499_0.png resize: (244, 121) 1356208180 -0.4469307560592139 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604487_0.png resize: (286, 283) 1356208181 -3.638180986374095 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604508_0.png resize: (337, 124) 1356208182 -1.2726266196707663 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604502_0.png resize: (318, 131) 1356208183 -1.546726550396766 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604504_0.png resize: (465, 643) 1356208184 0.18770233119390567 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604507_0.png resize: (970, 808) 1356208185 0.6908391441642167 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604506_0.png resize: (125, 141) 1356208186 -0.08861022964283122 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604510_0.png resize: (184, 166) 1356208187 0.752590880904431 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604519_0.png resize: (104, 134) 1356208188 -1.003354986909109 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604509_0.png resize: (115, 173) 1356208189 -1.139765791175266 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604516_0.png resize: (183, 108) 1356208190 -1.3766004842630934 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604518_0.png resize: (192, 273) 1356208191 -3.177583357562111 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604513_0.png resize: (218, 257) 1356208192 -1.80671493388688 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604517_0.png resize: (92, 238) 1356208193 -1.2770650037712827 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604396_0.png resize: (137, 156) 1356208196 -0.6524290463107683 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604428_0.png resize: (189, 149) 1356208197 -1.3867490245927325 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604434_0.png resize: (196, 201) 1356208198 -0.614250990173618 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604441_0.png resize: (153, 131) 1356208199 -2.0452585614786507 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604459_0.png resize: (859, 540) 1356208200 -1.1843128558725675 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604488_0.png resize: (673, 260) 1356208202 -1.3999575386653842 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604483_0.png resize: (797, 948) 1356208203 -1.265580493402954 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604512_0.png resize: (700, 656) 1356208204 -1.03083943898985 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604515_0.png resize: (572, 615) 1356208205 -0.3371865596794897 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604514_0.png resize: (180, 209) 1356208207 -0.9878436027658511 treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604439_0.png resize: (407, 375) 1356208223 -1.4263556903767418 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604388_0.png resize: (174, 295) 1356208388 -2.9181421849330236 treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604399_0.png resize: (297, 293) 1356208389 -2.194847541071541 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604406_0.png resize: (492, 437) 1356208390 -0.9636045858462905 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604418_0.png resize: (263, 213) 1356208391 -0.14444687252149027 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604410_0.png resize: (282, 311) 1356208392 0.3317259729788673 treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604417_0.png resize: (925, 457) 1356208393 -1.4497868934123443 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604432_0.png resize: (342, 248) 1356208394 -0.34471921851415 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604435_0.png resize: (340, 422) 1356208395 -1.6324601081305805 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604431_0.png resize: (292, 416) 1356208396 0.41259768259401247 treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604426_0.png resize: (284, 206) 1356208397 -2.2130816792432 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604448_0.png resize: (435, 269) 1356208398 -2.2420682869878554 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604455_0.png resize: (518, 691) 1356208399 -1.2892057751693604 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604450_0.png resize: (126, 371) 1356208400 -3.430660446906376 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604454_0.png resize: (611, 757) 1356208401 -0.8870304963593576 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604457_0.png resize: (357, 429) 1356208402 -1.4966523616119176 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604449_0.png resize: (752, 798) 1356208403 -1.8547836708125536 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604460_0.png resize: (322, 334) 1356208404 -1.137206804231736 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604453_0.png resize: (742, 608) 1356208405 -1.1755447986707206 treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604458_0.png resize: (111, 365) 1356208406 -2.097738344082313 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604480_0.png resize: (274, 379) 1356208407 -2.95046157463568 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604482_0.png resize: (299, 813) 1356208408 -0.5188012014118069 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604481_0.png resize: (428, 961) 1356208409 0.4498724386162032 treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604472_0.png resize: (188, 280) 1356208410 -1.4824104592844145 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604492_0.png resize: (406, 371) 1356208411 -1.1316116921381116 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604501_0.png resize: (277, 148) 1356208412 -3.5429658214067734 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604500_0.png resize: (394, 329) 1356208413 -3.809893702820353 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604490_0.png resize: (549, 830) 1356208414 -4.932129703583087 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604491_0.png resize: (270, 563) 1356208415 -2.872039121994855 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604493_0.png resize: (316, 376) 1356208416 -3.0102836206744534 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604495_0.png resize: (588, 274) 1356208417 -4.427572112647675 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604496_0.png resize: (346, 204) 1356208418 -3.0708646643786404 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604511_0.png resize: (259, 354) 1356208419 -1.5389258661442309 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604503_0.png resize: (238, 277) 1356208421 -2.4420083780964745 treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604505_0.png resize: (313, 550) 1356208422 -1.7769842068480708 treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604498_0.png resize: (111, 111) 1356208424 -0.7615841436104368 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 142 time used for this insertion : 0.018076419830322266 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 142 time used for this insertion : 0.0371556282043457 save missing photos in datou_result : time spend for datou_step_exec : 38.35521936416626 time spend to save output : 0.06120157241821289 total time spend for step 6 : 38.41642093658447 step7:brightness Mon May 5 21:36:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63.jpg treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019.jpg treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb.jpg treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a.jpg treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b.jpg treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430.jpg treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932.jpg treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567.jpg treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604394_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604398_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604389_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604397_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604386_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604393_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604392_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604395_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604400_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604391_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604390_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604387_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604409_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604411_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604405_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604413_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604402_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604412_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604404_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604407_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604415_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604401_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604414_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604416_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604408_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604403_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604430_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604423_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604424_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604429_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604433_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604421_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604436_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604420_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604427_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604425_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604422_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604419_0.png treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604440_0.png treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604442_0.png treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604443_0.png treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604438_0.png treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604444_0.png treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604437_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604445_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604451_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604446_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604447_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604452_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604461_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604456_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604470_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604467_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604479_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604466_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604477_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604465_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604475_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604478_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604464_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604463_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604468_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604473_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604462_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604469_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604476_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604474_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604471_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604489_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604494_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604486_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604484_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604497_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604485_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604499_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604487_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604508_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604502_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604504_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604507_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604506_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604510_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604519_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604509_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604516_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604518_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604513_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604517_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604396_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604428_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604434_0.png treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604441_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604459_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604488_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604483_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604512_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604515_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604514_0.png treat image : temp/1746473428_2406760_1356119331_4f16aa0524e01560aa52c93f411e1c5a_rle_crop_3785604439_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604388_0.png treat image : temp/1746473428_2406760_1356119400_5b21edc7731b4a082dc8bff538004d63_rle_crop_3785604399_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604406_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604418_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604410_0.png treat image : temp/1746473428_2406760_1356119341_36783351bcc28e45f8067a7ec5dfa019_rle_crop_3785604417_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604432_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604435_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604431_0.png treat image : temp/1746473428_2406760_1356119336_5da882819e269878da1f224c92e6dffb_rle_crop_3785604426_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604448_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604455_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604450_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604454_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604457_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604449_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604460_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604453_0.png treat image : temp/1746473428_2406760_1356119291_a1129bdecc5e9d870a4b6bdfa8e6501b_rle_crop_3785604458_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604480_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604482_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604481_0.png treat image : temp/1746473428_2406760_1356119285_74fcb85438bf18d74a8098cbff5ec430_rle_crop_3785604472_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604492_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604501_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604500_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604490_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604491_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604493_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604495_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604496_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604511_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604503_0.png treat image : temp/1746473428_2406760_1356119277_dd8955df8c484df76d37b48209f7e567_rle_crop_3785604505_0.png treat image : temp/1746473428_2406760_1356119280_0bda29538d538cb5db40471b8af36932_rle_crop_3785604498_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 142 time used for this insertion : 0.020467281341552734 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 142 time used for this insertion : 0.03593301773071289 save missing photos in datou_result : time spend for datou_step_exec : 8.462554931640625 time spend to save output : 0.06150937080383301 total time spend for step 7 : 8.524064302444458 step8:velours_tree Mon May 5 21:36:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.26227569580078125 time spend to save output : 5.412101745605469e-05 total time spend for step 8 : 0.2623298168182373 step9:send_mail_cod Mon May 5 21:36:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22696244_05-05-2025_21_36_10.pdf 22696456 imagette226964561746473770 22696457 imagette226964571746473770 22696458 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette226964581746473770 22696459 imagette226964591746473772 22696460 change filename to text .imagette226964601746473772 22696461 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette226964611746473772 22696462 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette226964621746473774 22696463 change filename to text .imagette226964631746473776 22696464 imagette226964641746473776 22696465 imagette226964651746473776 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22696244 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22696456,22696457,22696458,22696459,22696460,22696461,22696462,22696463,22696464,22696465,22696466?tags=mal_croppe,background,carton,flou,autre,papier,pet_clair,metal,pehd,pet_fonce,environnement args[1356119400] : ((1356119400, -0.7029036102518486, 492688767), (1356119400, -0.031737045287318355, 2107752395), '0.20116304551334419') We are sending mail with results at report@fotonower.com args[1356119341] : ((1356119341, -2.024561845896738, 492609224), (1356119341, -0.057141318020896226, 2107752395), '0.20116304551334419') We are sending mail with results at report@fotonower.com args[1356119336] : ((1356119336, -0.03512448692053991, 492688767), (1356119336, 0.06936201263479025, 2107752395), '0.20116304551334419') We are sending mail with results at report@fotonower.com args[1356119331] : ((1356119331, 0.4466040217041486, 492688767), (1356119331, 0.1982781978109172, 2107752395), '0.20116304551334419') We are sending mail with results at report@fotonower.com args[1356119291] : ((1356119291, -1.0283299902602876, 492688767), (1356119291, -0.14916190389431686, 496442774), '0.20116304551334419') We are sending mail with results at report@fotonower.com args[1356119285] : ((1356119285, -0.5758223064592981, 492688767), (1356119285, 0.21357463197688548, 2107752395), '0.20116304551334419') We are sending mail with results at report@fotonower.com args[1356119280] : ((1356119280, -4.798689583579145, 492609224), (1356119280, 0.027427820412672593, 2107752395), '0.20116304551334419') We are sending mail with results at report@fotonower.com args[1356119277] : ((1356119277, 0.00019098980998914756, 492688767), (1356119277, 0.19456223749408294, 2107752395), '0.20116304551334419') We are sending mail with results at report@fotonower.com refus_total : 0.20116304551334419 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22696244 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22696244_05-05-2025_21_36_10.pdf results_Auto_P22696244_05-05-2025_21_36_10.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22696244_05-05-2025_21_36_10.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22696244','results_Auto_P22696244_05-05-2025_21_36_10.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22696244_05-05-2025_21_36_10.pdf','pdf','','0.75','0.20116304551334419') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22696244

https://www.fotonower.com/image?json=false&list_photos_id=1356119400
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356119341
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356119336
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356119331
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356119291
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356119285
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356119280
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356119277
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 20.12%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/22696458?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22696460?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22696461?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22696462?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22696463?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22696244_05-05-2025_21_36_10.pdf.

Lien vers velours :https://www.fotonower.com/velours/22696456,22696457,22696458,22696459,22696460,22696461,22696462,22696463,22696464,22696465,22696466?tags=mal_croppe,background,carton,flou,autre,papier,pet_clair,metal,pehd,pet_fonce,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 05 May 2025 19:36:20 GMT Content-Length: 0 Connection: close X-Message-Id: oheN707ESni-SNgSZCPrXg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356119400, 1356119341, 1356119336, 1356119331, 1356119291, 1356119285, 1356119280, 1356119277] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119400', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119341', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119336', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119331', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119291', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119285', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119280', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119277', None, None, None, None, None, '2794744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.017328977584838867 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.045221328735352 time spend to save output : 0.017559289932250977 total time spend for step 9 : 10.062780618667603 step10:split_time_score Mon May 5 21:36:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05052025 22696244 Nombre de photos uploadées : 8 / 23040 (0%) 05052025 22696244 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 05052025 22696244 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00048089027404785156 elapsed_time : insert_dashboard_record_day_entry 0.029027462005615234 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665577 order by id desc limit 1 Qualite : 0.1154510393782547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22665578_05-05-2025_10_32_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665578 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22665578 AND mptpi.`type`=3726 To do Qualite : 0.1367117136127342 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22665580_05-05-2025_10_03_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665580 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22665580 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693050 order by id desc limit 1 Qualite : 0.03367098560088278 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22665582_05-05-2025_09_50_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665582 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22665582 AND mptpi.`type`=3726 To do Qualite : 0.12861591172138048 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22665584_05-05-2025_10_07_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22665584 AND mptpi.`type`=3594 To do Qualite : 0.21952639910130706 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22668130_05-05-2025_10_58_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22668130 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22668130 AND mptpi.`type`=3594 To do Qualite : 0.14740190202238304 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22681570_05-05-2025_16_18_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22681570 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22681570 AND mptpi.`type`=3594 To do Qualite : 0.1483229648919753 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22681571_05-05-2025_16_30_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22681571 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22681571 AND mptpi.`type`=3594 To do Qualite : 0.03398469992757866 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22674313_05-05-2025_13_22_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22674313 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22674313 AND mptpi.`type`=3726 To do Qualite : 0.10720160269213415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22681585_05-05-2025_16_22_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22681585 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22681585 AND mptpi.`type`=3726 To do Qualite : 0.12522235607092008 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22681586_05-05-2025_16_14_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22681586 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22681586 AND mptpi.`type`=3726 To do Qualite : 0.1549933406522331 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22693079_05-05-2025_20_49_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693079 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22693079 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22696242 order by id desc limit 1 Qualite : 0.20116304551334419 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22696244_05-05-2025_21_36_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22696244 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22696244 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693096 order by id desc limit 1 Qualite : 0.06624270358129877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22693110_05-05-2025_21_35_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693110 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22693110 AND mptpi.`type`=3726 To do Qualite : 0.19012396110707647 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22693112_05-05-2025_20_16_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22693112 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356119400, 1356119341, 1356119336, 1356119331, 1356119291, 1356119285, 1356119280, 1356119277] Looping around the photos to save general results len do output : 1 /22696244Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119400', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119341', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119336', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119331', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119291', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119285', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119280', None, None, None, None, None, '2794744') ('3318', None, None, None, None, None, None, None, '2794744') ('3318', '22696244', '1356119277', None, None, None, None, None, '2794744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014213085174560547 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.424245834350586 time spend to save output : 0.014482259750366211 total time spend for step 10 : 4.438728094100952 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 157.53user 141.77system 5:59.59elapsed 83%CPU (0avgtext+0avgdata 3853908maxresident)k 1708480inputs+104632outputs (22172major+12779641minor)pagefaults 0swaps