python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2298333 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2758901'] with mtr_portfolio_ids : ['22396721'] and first list_photo_ids : [] new path : /proc/2298333/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downUsing TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-24 20:20:46.624438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 20:20:46.853802: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-24 20:20:49.078506: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.078574: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.085088: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.085114: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.136084: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.136134: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.178629: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.178671: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.230154: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.230199: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-24 20:20:49.232469: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.37G (1471021056 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.559640: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-04-24 20:20:49.601801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.602948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.604472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.605475: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.616051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.616680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.617285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.617854: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.618418: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.619039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.633743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.634341: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.684718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.685308: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.693264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.693853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.716357: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.717201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.718001: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.718789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.722946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.723516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.724081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.724615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.726273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.726289: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-24 20:20:49.735923: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.736461: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.745449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.746002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.746561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.747125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.747725: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-24 20:20:49.748314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.87G (2007891968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 Detection mask done ! Trying to reset tf kernel 2299121 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 423 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1616 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001806020736694336 nb_pixel_total : 49681 time to create 1 rle with old method : 0.08787751197814941 length of segment : 171 time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 12882 time to create 1 rle with old method : 0.022099018096923828 length of segment : 138 time for calcul the mask position with numpy : 0.0003249645233154297 nb_pixel_total : 18158 time to create 1 rle with old method : 0.030551910400390625 length of segment : 106 time for calcul the mask position with numpy : 0.0006060600280761719 nb_pixel_total : 26058 time to create 1 rle with old method : 0.03891181945800781 length of segment : 192 time for calcul the mask position with numpy : 0.00021839141845703125 nb_pixel_total : 7337 time to create 1 rle with old method : 0.009133338928222656 length of segment : 93 time for calcul the mask position with numpy : 0.0001633167266845703 nb_pixel_total : 4957 time to create 1 rle with old method : 0.006318092346191406 length of segment : 74 time for calcul the mask position with numpy : 0.001905202865600586 nb_pixel_total : 56116 time to create 1 rle with old method : 0.0674135684967041 length of segment : 454 time for calcul the mask position with numpy : 0.0004596710205078125 nb_pixel_total : 24539 time to create 1 rle with old method : 0.029364347457885742 length of segment : 172 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 38721 time to create 1 rle with old method : 0.04676556587219238 length of segment : 217 time for calcul the mask position with numpy : 0.0006844997406005859 nb_pixel_total : 44259 time to create 1 rle with old method : 0.05436086654663086 length of segment : 255 time for calcul the mask position with numpy : 0.0005247592926025391 nb_pixel_total : 27337 time to create 1 rle with old method : 0.03208494186401367 length of segment : 210 time for calcul the mask position with numpy : 0.0014982223510742188 nb_pixel_total : 71684 time to create 1 rle with old method : 0.08320283889770508 length of segment : 311 time for calcul the mask position with numpy : 0.0002586841583251953 nb_pixel_total : 5901 time to create 1 rle with old method : 0.007792949676513672 length of segment : 91 time for calcul the mask position with numpy : 0.004965543746948242 nb_pixel_total : 126684 time to create 1 rle with old method : 0.14825892448425293 length of segment : 461 time for calcul the mask position with numpy : 0.0007097721099853516 nb_pixel_total : 29283 time to create 1 rle with old method : 0.03447365760803223 length of segment : 193 time for calcul the mask position with numpy : 0.0002536773681640625 nb_pixel_total : 6580 time to create 1 rle with old method : 0.008264303207397461 length of segment : 141 time for calcul the mask position with numpy : 0.00026297569274902344 nb_pixel_total : 12415 time to create 1 rle with old method : 0.01539754867553711 length of segment : 87 time for calcul the mask position with numpy : 0.0030469894409179688 nb_pixel_total : 87776 time to create 1 rle with old method : 0.11590814590454102 length of segment : 239 time for calcul the mask position with numpy : 0.0008800029754638672 nb_pixel_total : 37323 time to create 1 rle with old method : 0.049349069595336914 length of segment : 284 time for calcul the mask position with numpy : 0.0009779930114746094 nb_pixel_total : 39443 time to create 1 rle with old method : 0.05535078048706055 length of segment : 202 time for calcul the mask position with numpy : 0.00115203857421875 nb_pixel_total : 28798 time to create 1 rle with old method : 0.04186081886291504 length of segment : 228 time for calcul the mask position with numpy : 0.0011229515075683594 nb_pixel_total : 38107 time to create 1 rle with old method : 0.049104928970336914 length of segment : 215 time for calcul the mask position with numpy : 0.0006999969482421875 nb_pixel_total : 16989 time to create 1 rle with old method : 0.02302694320678711 length of segment : 109 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 10142 time to create 1 rle with old method : 0.012599945068359375 length of segment : 73 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 17901 time to create 1 rle with old method : 0.02136373519897461 length of segment : 264 time for calcul the mask position with numpy : 0.0009660720825195312 nb_pixel_total : 37448 time to create 1 rle with old method : 0.04849576950073242 length of segment : 261 time for calcul the mask position with numpy : 0.002032041549682617 nb_pixel_total : 41287 time to create 1 rle with old method : 0.04892134666442871 length of segment : 239 time for calcul the mask position with numpy : 0.0004982948303222656 nb_pixel_total : 12437 time to create 1 rle with old method : 0.01516413688659668 length of segment : 85 time for calcul the mask position with numpy : 0.0020482540130615234 nb_pixel_total : 51480 time to create 1 rle with old method : 0.06026196479797363 length of segment : 280 time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 7788 time to create 1 rle with old method : 0.009593009948730469 length of segment : 123 time for calcul the mask position with numpy : 0.0007493495941162109 nb_pixel_total : 11624 time to create 1 rle with old method : 0.014181852340698242 length of segment : 154 time for calcul the mask position with numpy : 0.0019898414611816406 nb_pixel_total : 42911 time to create 1 rle with old method : 0.05475759506225586 length of segment : 305 time for calcul the mask position with numpy : 0.0012917518615722656 nb_pixel_total : 19842 time to create 1 rle with old method : 0.032614707946777344 length of segment : 244 time for calcul the mask position with numpy : 0.0023801326751708984 nb_pixel_total : 37273 time to create 1 rle with old method : 0.050296783447265625 length of segment : 387 time for calcul the mask position with numpy : 0.0007114410400390625 nb_pixel_total : 7029 time to create 1 rle with old method : 0.012294530868530273 length of segment : 87 time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 15760 time to create 1 rle with old method : 0.02667689323425293 length of segment : 158 time for calcul the mask position with numpy : 0.0009706020355224609 nb_pixel_total : 19661 time to create 1 rle with old method : 0.023516416549682617 length of segment : 117 time for calcul the mask position with numpy : 0.0013780593872070312 nb_pixel_total : 26333 time to create 1 rle with old method : 0.03174448013305664 length of segment : 224 time for calcul the mask position with numpy : 0.0018050670623779297 nb_pixel_total : 18770 time to create 1 rle with old method : 0.022637128829956055 length of segment : 405 time for calcul the mask position with numpy : 0.013987541198730469 nb_pixel_total : 297719 time to create 1 rle with new method : 0.02852177619934082 length of segment : 811 time for calcul the mask position with numpy : 0.00048613548278808594 nb_pixel_total : 12227 time to create 1 rle with old method : 0.01492929458618164 length of segment : 147 time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 3237 time to create 1 rle with old method : 0.004079103469848633 length of segment : 60 time for calcul the mask position with numpy : 0.00031566619873046875 nb_pixel_total : 8113 time to create 1 rle with old method : 0.009998798370361328 length of segment : 96 time for calcul the mask position with numpy : 0.00024056434631347656 nb_pixel_total : 5151 time to create 1 rle with old method : 0.006402492523193359 length of segment : 71 time for calcul the mask position with numpy : 0.00022459030151367188 nb_pixel_total : 2715 time to create 1 rle with old method : 0.003535032272338867 length of segment : 47 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 15968 time to create 1 rle with old method : 0.021384477615356445 length of segment : 110 time for calcul the mask position with numpy : 0.0009214878082275391 nb_pixel_total : 15760 time to create 1 rle with old method : 0.026580810546875 length of segment : 194 time for calcul the mask position with numpy : 0.0008463859558105469 nb_pixel_total : 19862 time to create 1 rle with old method : 0.023656606674194336 length of segment : 165 time for calcul the mask position with numpy : 0.0004711151123046875 nb_pixel_total : 11477 time to create 1 rle with old method : 0.0139617919921875 length of segment : 101 time for calcul the mask position with numpy : 0.005582094192504883 nb_pixel_total : 161371 time to create 1 rle with new method : 0.014537572860717773 length of segment : 561 time for calcul the mask position with numpy : 0.0019099712371826172 nb_pixel_total : 83807 time to create 1 rle with old method : 0.09943032264709473 length of segment : 288 time for calcul the mask position with numpy : 0.0005807876586914062 nb_pixel_total : 10621 time to create 1 rle with old method : 0.015316963195800781 length of segment : 95 time for calcul the mask position with numpy : 0.0030829906463623047 nb_pixel_total : 114449 time to create 1 rle with old method : 0.14080238342285156 length of segment : 413 time for calcul the mask position with numpy : 0.0004334449768066406 nb_pixel_total : 11996 time to create 1 rle with old method : 0.01645684242248535 length of segment : 89 time for calcul the mask position with numpy : 0.002768278121948242 nb_pixel_total : 100591 time to create 1 rle with old method : 0.12787342071533203 length of segment : 383 time for calcul the mask position with numpy : 0.0008194446563720703 nb_pixel_total : 22485 time to create 1 rle with old method : 0.027141094207763672 length of segment : 179 time for calcul the mask position with numpy : 0.0010662078857421875 nb_pixel_total : 27872 time to create 1 rle with old method : 0.047913312911987305 length of segment : 215 time for calcul the mask position with numpy : 0.002435922622680664 nb_pixel_total : 74820 time to create 1 rle with old method : 0.08802390098571777 length of segment : 290 time for calcul the mask position with numpy : 0.0010955333709716797 nb_pixel_total : 32669 time to create 1 rle with old method : 0.04155874252319336 length of segment : 305 time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 7680 time to create 1 rle with old method : 0.009250402450561523 length of segment : 139 time for calcul the mask position with numpy : 0.0017480850219726562 nb_pixel_total : 40482 time to create 1 rle with old method : 0.05332756042480469 length of segment : 378 time for calcul the mask position with numpy : 0.0030252933502197266 nb_pixel_total : 119042 time to create 1 rle with old method : 0.18869972229003906 length of segment : 402 time for calcul the mask position with numpy : 0.0062029361724853516 nb_pixel_total : 219260 time to create 1 rle with new method : 0.015186071395874023 length of segment : 577 time for calcul the mask position with numpy : 0.006063222885131836 nb_pixel_total : 220893 time to create 1 rle with new method : 0.012451887130737305 length of segment : 635 time for calcul the mask position with numpy : 0.0010347366333007812 nb_pixel_total : 39327 time to create 1 rle with old method : 0.05536460876464844 length of segment : 274 time for calcul the mask position with numpy : 0.002341747283935547 nb_pixel_total : 41780 time to create 1 rle with old method : 0.05442476272583008 length of segment : 291 time for calcul the mask position with numpy : 0.004525661468505859 nb_pixel_total : 69675 time to create 1 rle with old method : 0.09883618354797363 length of segment : 343 time for calcul the mask position with numpy : 0.008271217346191406 nb_pixel_total : 138403 time to create 1 rle with old method : 0.17858266830444336 length of segment : 415 time for calcul the mask position with numpy : 0.0008263587951660156 nb_pixel_total : 20623 time to create 1 rle with old method : 0.02469921112060547 length of segment : 123 time for calcul the mask position with numpy : 0.0026700496673583984 nb_pixel_total : 64985 time to create 1 rle with old method : 0.0772695541381836 length of segment : 327 time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 7816 time to create 1 rle with old method : 0.009724140167236328 length of segment : 120 time for calcul the mask position with numpy : 0.001767873764038086 nb_pixel_total : 28660 time to create 1 rle with old method : 0.03458118438720703 length of segment : 172 time for calcul the mask position with numpy : 0.0015544891357421875 nb_pixel_total : 36802 time to create 1 rle with old method : 0.051000118255615234 length of segment : 190 time for calcul the mask position with numpy : 0.0017969608306884766 nb_pixel_total : 31738 time to create 1 rle with old method : 0.054144859313964844 length of segment : 187 time for calcul the mask position with numpy : 0.0019371509552001953 nb_pixel_total : 51396 time to create 1 rle with old method : 0.08658480644226074 length of segment : 165 time for calcul the mask position with numpy : 0.0024378299713134766 nb_pixel_total : 47196 time to create 1 rle with old method : 0.0751039981842041 length of segment : 368 time for calcul the mask position with numpy : 0.0007181167602539062 nb_pixel_total : 8191 time to create 1 rle with old method : 0.012859344482421875 length of segment : 128 time for calcul the mask position with numpy : 0.0014183521270751953 nb_pixel_total : 24989 time to create 1 rle with old method : 0.03479266166687012 length of segment : 194 time for calcul the mask position with numpy : 0.001626729965209961 nb_pixel_total : 35877 time to create 1 rle with old method : 0.04998421669006348 length of segment : 204 time for calcul the mask position with numpy : 0.0027437210083007812 nb_pixel_total : 80556 time to create 1 rle with old method : 0.09387445449829102 length of segment : 409 time for calcul the mask position with numpy : 0.0012142658233642578 nb_pixel_total : 24843 time to create 1 rle with old method : 0.02961277961730957 length of segment : 196 time for calcul the mask position with numpy : 0.004241228103637695 nb_pixel_total : 119475 time to create 1 rle with old method : 0.1500101089477539 length of segment : 360 time for calcul the mask position with numpy : 0.0008146762847900391 nb_pixel_total : 19794 time to create 1 rle with old method : 0.034352779388427734 length of segment : 122 time for calcul the mask position with numpy : 0.0019638538360595703 nb_pixel_total : 42770 time to create 1 rle with old method : 0.05019712448120117 length of segment : 328 time for calcul the mask position with numpy : 0.0025424957275390625 nb_pixel_total : 55311 time to create 1 rle with old method : 0.06817388534545898 length of segment : 308 time for calcul the mask position with numpy : 0.018804550170898438 nb_pixel_total : 328348 time to create 1 rle with new method : 0.020011186599731445 length of segment : 665 time for calcul the mask position with numpy : 0.0010094642639160156 nb_pixel_total : 19044 time to create 1 rle with old method : 0.022381305694580078 length of segment : 181 time for calcul the mask position with numpy : 0.001253366470336914 nb_pixel_total : 31357 time to create 1 rle with old method : 0.03725099563598633 length of segment : 246 time for calcul the mask position with numpy : 0.00038242340087890625 nb_pixel_total : 10242 time to create 1 rle with old method : 0.012115240097045898 length of segment : 100 time for calcul the mask position with numpy : 0.0008540153503417969 nb_pixel_total : 21410 time to create 1 rle with old method : 0.025298118591308594 length of segment : 177 time for calcul the mask position with numpy : 0.003224611282348633 nb_pixel_total : 93111 time to create 1 rle with old method : 0.10756850242614746 length of segment : 475 time for calcul the mask position with numpy : 0.0007202625274658203 nb_pixel_total : 14264 time to create 1 rle with old method : 0.024036884307861328 length of segment : 185 time for calcul the mask position with numpy : 0.0010044574737548828 nb_pixel_total : 26356 time to create 1 rle with old method : 0.030492067337036133 length of segment : 225 time for calcul the mask position with numpy : 0.0020372867584228516 nb_pixel_total : 45098 time to create 1 rle with old method : 0.05187368392944336 length of segment : 392 time for calcul the mask position with numpy : 0.003408193588256836 nb_pixel_total : 104276 time to create 1 rle with old method : 0.1216423511505127 length of segment : 291 time for calcul the mask position with numpy : 0.0036008358001708984 nb_pixel_total : 109848 time to create 1 rle with old method : 0.12729930877685547 length of segment : 343 time for calcul the mask position with numpy : 0.0009295940399169922 nb_pixel_total : 25287 time to create 1 rle with old method : 0.0299532413482666 length of segment : 253 time for calcul the mask position with numpy : 0.0009293556213378906 nb_pixel_total : 25533 time to create 1 rle with old method : 0.03216361999511719 length of segment : 217 time for calcul the mask position with numpy : 0.0018877983093261719 nb_pixel_total : 62687 time to create 1 rle with old method : 0.0723121166229248 length of segment : 397 time for calcul the mask position with numpy : 0.0007851123809814453 nb_pixel_total : 20169 time to create 1 rle with old method : 0.023960351943969727 length of segment : 171 time for calcul the mask position with numpy : 0.0011777877807617188 nb_pixel_total : 26572 time to create 1 rle with old method : 0.03150486946105957 length of segment : 305 time for calcul the mask position with numpy : 0.051613569259643555 nb_pixel_total : 591165 time to create 1 rle with new method : 0.052773475646972656 length of segment : 931 time for calcul the mask position with numpy : 0.0027923583984375 nb_pixel_total : 61987 time to create 1 rle with old method : 0.07309556007385254 length of segment : 351 time for calcul the mask position with numpy : 0.01196432113647461 nb_pixel_total : 298666 time to create 1 rle with new method : 0.027156352996826172 length of segment : 725 time for calcul the mask position with numpy : 0.0005564689636230469 nb_pixel_total : 16888 time to create 1 rle with old method : 0.020667314529418945 length of segment : 83 time for calcul the mask position with numpy : 0.00035500526428222656 nb_pixel_total : 14378 time to create 1 rle with old method : 0.017239093780517578 length of segment : 119 time for calcul the mask position with numpy : 0.0004665851593017578 nb_pixel_total : 27003 time to create 1 rle with old method : 0.03416800498962402 length of segment : 197 time for calcul the mask position with numpy : 0.0007033348083496094 nb_pixel_total : 16747 time to create 1 rle with old method : 0.020419836044311523 length of segment : 140 time for calcul the mask position with numpy : 0.0002720355987548828 nb_pixel_total : 5705 time to create 1 rle with old method : 0.0069010257720947266 length of segment : 82 time for calcul the mask position with numpy : 0.001110076904296875 nb_pixel_total : 28080 time to create 1 rle with old method : 0.033223867416381836 length of segment : 187 time for calcul the mask position with numpy : 0.0009474754333496094 nb_pixel_total : 19371 time to create 1 rle with old method : 0.02272939682006836 length of segment : 198 time for calcul the mask position with numpy : 0.0014140605926513672 nb_pixel_total : 30893 time to create 1 rle with old method : 0.03710365295410156 length of segment : 233 time for calcul the mask position with numpy : 0.0012636184692382812 nb_pixel_total : 75608 time to create 1 rle with old method : 0.08928632736206055 length of segment : 472 time for calcul the mask position with numpy : 0.0014977455139160156 nb_pixel_total : 37970 time to create 1 rle with old method : 0.04479241371154785 length of segment : 319 time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 6015 time to create 1 rle with old method : 0.007486820220947266 length of segment : 66 time for calcul the mask position with numpy : 0.0010607242584228516 nb_pixel_total : 26045 time to create 1 rle with old method : 0.03183794021606445 length of segment : 151 time for calcul the mask position with numpy : 0.00956869125366211 nb_pixel_total : 319181 time to create 1 rle with new method : 0.017432212829589844 length of segment : 708 time for calcul the mask position with numpy : 0.008620500564575195 nb_pixel_total : 279018 time to create 1 rle with new method : 0.014741897583007812 length of segment : 665 time for calcul the mask position with numpy : 0.004231452941894531 nb_pixel_total : 118624 time to create 1 rle with old method : 0.16214394569396973 length of segment : 572 time for calcul the mask position with numpy : 0.0008885860443115234 nb_pixel_total : 24946 time to create 1 rle with old method : 0.029856204986572266 length of segment : 188 time for calcul the mask position with numpy : 0.0015463829040527344 nb_pixel_total : 45108 time to create 1 rle with old method : 0.054044246673583984 length of segment : 247 time for calcul the mask position with numpy : 0.009404182434082031 nb_pixel_total : 308551 time to create 1 rle with new method : 0.22810077667236328 length of segment : 730 time for calcul the mask position with numpy : 0.006849527359008789 nb_pixel_total : 251641 time to create 1 rle with new method : 0.014796733856201172 length of segment : 458 time for calcul the mask position with numpy : 0.00048828125 nb_pixel_total : 17227 time to create 1 rle with old method : 0.020902395248413086 length of segment : 235 time for calcul the mask position with numpy : 0.0004239082336425781 nb_pixel_total : 7665 time to create 1 rle with old method : 0.013406038284301758 length of segment : 76 time for calcul the mask position with numpy : 0.009708881378173828 nb_pixel_total : 263016 time to create 1 rle with new method : 0.017677783966064453 length of segment : 688 time for calcul the mask position with numpy : 0.0003662109375 nb_pixel_total : 12275 time to create 1 rle with old method : 0.015261650085449219 length of segment : 159 time for calcul the mask position with numpy : 0.0006775856018066406 nb_pixel_total : 18846 time to create 1 rle with old method : 0.022770404815673828 length of segment : 185 time for calcul the mask position with numpy : 0.00091552734375 nb_pixel_total : 28901 time to create 1 rle with old method : 0.03524017333984375 length of segment : 174 time for calcul the mask position with numpy : 0.000797271728515625 nb_pixel_total : 17401 time to create 1 rle with old method : 0.030233383178710938 length of segment : 160 time for calcul the mask position with numpy : 0.000904083251953125 nb_pixel_total : 28738 time to create 1 rle with old method : 0.0370328426361084 length of segment : 177 time for calcul the mask position with numpy : 0.33440399169921875 nb_pixel_total : 690053 time to create 1 rle with new method : 0.05977964401245117 length of segment : 1221 time for calcul the mask position with numpy : 0.002969980239868164 nb_pixel_total : 124998 time to create 1 rle with old method : 0.15006303787231445 length of segment : 521 time for calcul the mask position with numpy : 0.00036597251892089844 nb_pixel_total : 6025 time to create 1 rle with old method : 0.0075643062591552734 length of segment : 88 time for calcul the mask position with numpy : 0.0005731582641601562 nb_pixel_total : 12962 time to create 1 rle with old method : 0.016599178314208984 length of segment : 139 time for calcul the mask position with numpy : 0.0013461112976074219 nb_pixel_total : 33461 time to create 1 rle with old method : 0.03971123695373535 length of segment : 224 time for calcul the mask position with numpy : 0.0012192726135253906 nb_pixel_total : 22468 time to create 1 rle with old method : 0.0326542854309082 length of segment : 231 time for calcul the mask position with numpy : 0.0034580230712890625 nb_pixel_total : 77006 time to create 1 rle with old method : 0.09243917465209961 length of segment : 449 time for calcul the mask position with numpy : 0.0017061233520507812 nb_pixel_total : 34048 time to create 1 rle with old method : 0.040201425552368164 length of segment : 333 time for calcul the mask position with numpy : 0.002504587173461914 nb_pixel_total : 57818 time to create 1 rle with old method : 0.07171463966369629 length of segment : 308 time for calcul the mask position with numpy : 0.0004487037658691406 nb_pixel_total : 7271 time to create 1 rle with old method : 0.008873939514160156 length of segment : 117 time for calcul the mask position with numpy : 0.001256704330444336 nb_pixel_total : 26981 time to create 1 rle with old method : 0.032723426818847656 length of segment : 202 time for calcul the mask position with numpy : 0.0006918907165527344 nb_pixel_total : 12893 time to create 1 rle with old method : 0.01727890968322754 length of segment : 126 time for calcul the mask position with numpy : 0.0006613731384277344 nb_pixel_total : 24754 time to create 1 rle with old method : 0.029198646545410156 length of segment : 285 time for calcul the mask position with numpy : 0.0008084774017333984 nb_pixel_total : 20817 time to create 1 rle with old method : 0.024975061416625977 length of segment : 247 time for calcul the mask position with numpy : 0.00036334991455078125 nb_pixel_total : 14435 time to create 1 rle with old method : 0.01766204833984375 length of segment : 125 time for calcul the mask position with numpy : 0.0020999908447265625 nb_pixel_total : 74441 time to create 1 rle with old method : 0.09575366973876953 length of segment : 372 time for calcul the mask position with numpy : 0.003979206085205078 nb_pixel_total : 149100 time to create 1 rle with old method : 0.18356919288635254 length of segment : 446 time for calcul the mask position with numpy : 0.0016515254974365234 nb_pixel_total : 39880 time to create 1 rle with old method : 0.05003476142883301 length of segment : 245 time for calcul the mask position with numpy : 0.00597691535949707 nb_pixel_total : 252452 time to create 1 rle with new method : 0.013868570327758789 length of segment : 773 time for calcul the mask position with numpy : 0.0019216537475585938 nb_pixel_total : 41829 time to create 1 rle with old method : 0.0512537956237793 length of segment : 425 time spent for convertir_results : 15.112388610839844 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 151 chid ids of type : 3594 Number RLEs to save : 41200 save missing photos in datou_result : time spend for datou_step_exec : 84.63571882247925 time spend to save output : 2.616981029510498 total time spend for step 1 : 87.25269985198975 step2:crop_condition Thu Apr 24 20:21:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 151 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 94 About to insert : list_path_to_insert length 94 new photo from crops ! About to upload 94 photos upload in portfolio : 3736932 init cache_photo without model_param we have 94 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745518937_2298333 we have uploaded 94 photos in the portfolio 3736932 time of upload the photos Elapsed time : 24.522204637527466 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745518970_2298333 we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.585729360580444 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745518976_2298333 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0013842582702637 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3736932 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745518993_2298333 we have uploaded 32 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.776103258132935 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745519009_2298333 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5773017406463623 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745519011_2298333 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5302519798278809 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745519013_2298333 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5515792369842529 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1353441848, 1353441792, 1353441756, 1353441239, 1353428479, 1353428477, 1353428421, 1353428415, 1353428365, 1353428364] Looping around the photos to save general results len do output : 151 /1353452337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353452679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441848', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441792', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441756', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441239', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428479', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428477', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428421', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428415', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428365', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428364', None, None, None, None, None, '2758901') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 463 time used for this insertion : 0.029213905334472656 save_final save missing photos in datou_result : time spend for datou_step_exec : 96.18498301506042 time spend to save output : 0.03368043899536133 total time spend for step 2 : 96.21866345405579 step3:rle_unique_nms_with_priority Thu Apr 24 20:23:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 151 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 6.28264856338501 time for calcul the mask position with numpy : 0.6547276973724365 nb_pixel_total : 6740195 time to create 1 rle with new method : 0.750612735748291 time for calcul the mask position with numpy : 0.049213409423828125 nb_pixel_total : 27337 time to create 1 rle with old method : 0.03203725814819336 time for calcul the mask position with numpy : 0.0426945686340332 nb_pixel_total : 44259 time to create 1 rle with old method : 0.05150961875915527 time for calcul the mask position with numpy : 0.0296630859375 nb_pixel_total : 38721 time to create 1 rle with old method : 0.04601788520812988 time for calcul the mask position with numpy : 0.030806779861450195 nb_pixel_total : 24539 time to create 1 rle with old method : 0.04210329055786133 time for calcul the mask position with numpy : 0.026105403900146484 nb_pixel_total : 56116 time to create 1 rle with old method : 0.06906890869140625 time for calcul the mask position with numpy : 0.02467799186706543 nb_pixel_total : 4957 time to create 1 rle with old method : 0.005922079086303711 time for calcul the mask position with numpy : 0.024287939071655273 nb_pixel_total : 7337 time to create 1 rle with old method : 0.011136770248413086 time for calcul the mask position with numpy : 0.02514958381652832 nb_pixel_total : 26058 time to create 1 rle with old method : 0.03048849105834961 time for calcul the mask position with numpy : 0.023284912109375 nb_pixel_total : 18158 time to create 1 rle with old method : 0.021564483642578125 time for calcul the mask position with numpy : 0.023017406463623047 nb_pixel_total : 12882 time to create 1 rle with old method : 0.01598501205444336 time for calcul the mask position with numpy : 0.02435469627380371 nb_pixel_total : 49681 time to create 1 rle with old method : 0.062044620513916016 create new chi : 2.161792278289795 time to delete rle : 0.016783475875854492 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 6324 TO DO : save crop sub photo not yet done ! save time : 0.41233134269714355 nb_obj : 28 nb_hashtags : 4 time to prepare the origin masks : 3.74762225151062 time for calcul the mask position with numpy : 0.4106416702270508 nb_pixel_total : 6177589 time to create 1 rle with new method : 0.5634353160858154 time for calcul the mask position with numpy : 0.028948068618774414 nb_pixel_total : 1038 time to create 1 rle with old method : 0.0012614727020263672 time for calcul the mask position with numpy : 0.029984235763549805 nb_pixel_total : 37323 time to create 1 rle with old method : 0.04567694664001465 time for calcul the mask position with numpy : 0.03476762771606445 nb_pixel_total : 5901 time to create 1 rle with old method : 0.006960153579711914 time for calcul the mask position with numpy : 0.029257774353027344 nb_pixel_total : 39443 time to create 1 rle with old method : 0.0458073616027832 time for calcul the mask position with numpy : 0.030899763107299805 nb_pixel_total : 17901 time to create 1 rle with old method : 0.021880626678466797 time for calcul the mask position with numpy : 0.029143333435058594 nb_pixel_total : 26333 time to create 1 rle with old method : 0.033968210220336914 time for calcul the mask position with numpy : 0.029171228408813477 nb_pixel_total : 42884 time to create 1 rle with old method : 0.049431562423706055 time for calcul the mask position with numpy : 0.02904486656188965 nb_pixel_total : 11624 time to create 1 rle with old method : 0.013637542724609375 time for calcul the mask position with numpy : 0.03173398971557617 nb_pixel_total : 19661 time to create 1 rle with old method : 0.03373527526855469 time for calcul the mask position with numpy : 0.0336306095123291 nb_pixel_total : 38107 time to create 1 rle with old method : 0.044492483139038086 time for calcul the mask position with numpy : 0.02925848960876465 nb_pixel_total : 6580 time to create 1 rle with old method : 0.007818460464477539 time for calcul the mask position with numpy : 0.0317537784576416 nb_pixel_total : 126684 time to create 1 rle with old method : 0.16048026084899902 time for calcul the mask position with numpy : 0.03465580940246582 nb_pixel_total : 37448 time to create 1 rle with old method : 0.044088125228881836 time for calcul the mask position with numpy : 0.029574155807495117 nb_pixel_total : 10142 time to create 1 rle with old method : 0.012076616287231445 time for calcul the mask position with numpy : 0.029752492904663086 nb_pixel_total : 7788 time to create 1 rle with old method : 0.009330987930297852 time for calcul the mask position with numpy : 0.03133058547973633 nb_pixel_total : 51480 time to create 1 rle with old method : 0.061759233474731445 time for calcul the mask position with numpy : 0.03379368782043457 nb_pixel_total : 28798 time to create 1 rle with old method : 0.037453413009643555 time for calcul the mask position with numpy : 0.031345367431640625 nb_pixel_total : 71684 time to create 1 rle with old method : 0.09744882583618164 time for calcul the mask position with numpy : 0.030611276626586914 nb_pixel_total : 15760 time to create 1 rle with old method : 0.018889427185058594 time for calcul the mask position with numpy : 0.033611297607421875 nb_pixel_total : 29283 time to create 1 rle with old method : 0.03763747215270996 time for calcul the mask position with numpy : 0.029344558715820312 nb_pixel_total : 41287 time to create 1 rle with old method : 0.05537867546081543 time for calcul the mask position with numpy : 0.031116247177124023 nb_pixel_total : 12415 time to create 1 rle with old method : 0.014794588088989258 time for calcul the mask position with numpy : 0.030584096908569336 nb_pixel_total : 37273 time to create 1 rle with old method : 0.04707503318786621 time for calcul the mask position with numpy : 0.030285358428955078 nb_pixel_total : 12437 time to create 1 rle with old method : 0.016286611557006836 time for calcul the mask position with numpy : 0.029740333557128906 nb_pixel_total : 18770 time to create 1 rle with old method : 0.02294182777404785 time for calcul the mask position with numpy : 0.0311887264251709 nb_pixel_total : 16989 time to create 1 rle with old method : 0.021469593048095703 time for calcul the mask position with numpy : 0.03009319305419922 nb_pixel_total : 19842 time to create 1 rle with old method : 0.024797439575195312 time for calcul the mask position with numpy : 0.036605119705200195 nb_pixel_total : 87776 time to create 1 rle with old method : 0.19092726707458496 create new chi : 3.063864231109619 time to delete rle : 0.002134084701538086 batch 1 Loaded 57 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 13982 TO DO : save crop sub photo not yet done ! save time : 0.8234653472900391 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.701913595199585 time for calcul the mask position with numpy : 0.5848042964935303 nb_pixel_total : 6721078 time to create 1 rle with new method : 0.5726737976074219 time for calcul the mask position with numpy : 0.02221965789794922 nb_pixel_total : 2715 time to create 1 rle with old method : 0.0032777786254882812 time for calcul the mask position with numpy : 0.03339385986328125 nb_pixel_total : 5151 time to create 1 rle with old method : 0.006046295166015625 time for calcul the mask position with numpy : 0.029808759689331055 nb_pixel_total : 8113 time to create 1 rle with old method : 0.009473323822021484 time for calcul the mask position with numpy : 0.029590129852294922 nb_pixel_total : 3237 time to create 1 rle with old method : 0.003805875778198242 time for calcul the mask position with numpy : 0.02116680145263672 nb_pixel_total : 12227 time to create 1 rle with old method : 0.014571905136108398 time for calcul the mask position with numpy : 0.023931026458740234 nb_pixel_total : 297719 time to create 1 rle with new method : 0.8293023109436035 create new chi : 2.2435548305511475 time to delete rle : 0.0007190704345703125 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4624 TO DO : save crop sub photo not yet done ! save time : 0.3443944454193115 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 5.483266353607178 time for calcul the mask position with numpy : 0.48294663429260254 nb_pixel_total : 6454290 time to create 1 rle with new method : 0.9983162879943848 time for calcul the mask position with numpy : 0.021001338958740234 nb_pixel_total : 27872 time to create 1 rle with old method : 0.031032562255859375 time for calcul the mask position with numpy : 0.020391464233398438 nb_pixel_total : 22485 time to create 1 rle with old method : 0.02529168128967285 time for calcul the mask position with numpy : 0.020458698272705078 nb_pixel_total : 100591 time to create 1 rle with old method : 0.11169648170471191 time for calcul the mask position with numpy : 0.021134376525878906 nb_pixel_total : 11996 time to create 1 rle with old method : 0.013619661331176758 time for calcul the mask position with numpy : 0.021744966506958008 nb_pixel_total : 114140 time to create 1 rle with old method : 0.12845611572265625 time for calcul the mask position with numpy : 0.025849103927612305 nb_pixel_total : 10621 time to create 1 rle with old method : 0.012411355972290039 time for calcul the mask position with numpy : 0.02178049087524414 nb_pixel_total : 83807 time to create 1 rle with old method : 0.11462974548339844 time for calcul the mask position with numpy : 0.023441553115844727 nb_pixel_total : 161371 time to create 1 rle with new method : 0.4493095874786377 time for calcul the mask position with numpy : 0.021046161651611328 nb_pixel_total : 11477 time to create 1 rle with old method : 0.013438940048217773 time for calcul the mask position with numpy : 0.02225470542907715 nb_pixel_total : 19862 time to create 1 rle with old method : 0.023268699645996094 time for calcul the mask position with numpy : 0.02255845069885254 nb_pixel_total : 15760 time to create 1 rle with old method : 0.018520116806030273 time for calcul the mask position with numpy : 0.02192068099975586 nb_pixel_total : 15968 time to create 1 rle with old method : 0.018653392791748047 create new chi : 2.770550012588501 time to delete rle : 0.0013282299041748047 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7730 TO DO : save crop sub photo not yet done ! save time : 0.4923415184020996 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.9685027599334717 time for calcul the mask position with numpy : 0.7283685207366943 nb_pixel_total : 6298665 time to create 1 rle with new method : 0.7937531471252441 time for calcul the mask position with numpy : 0.021694183349609375 nb_pixel_total : 36729 time to create 1 rle with old method : 0.04259538650512695 time for calcul the mask position with numpy : 0.022998332977294922 nb_pixel_total : 220893 time to create 1 rle with new method : 0.7068836688995361 time for calcul the mask position with numpy : 0.02211594581604004 nb_pixel_total : 219260 time to create 1 rle with new method : 0.4675726890563965 time for calcul the mask position with numpy : 0.02336263656616211 nb_pixel_total : 119042 time to create 1 rle with old method : 0.1419966220855713 time for calcul the mask position with numpy : 0.020884990692138672 nb_pixel_total : 40482 time to create 1 rle with old method : 0.044901371002197266 time for calcul the mask position with numpy : 0.02199721336364746 nb_pixel_total : 7680 time to create 1 rle with old method : 0.010895490646362305 time for calcul the mask position with numpy : 0.02330803871154785 nb_pixel_total : 32669 time to create 1 rle with old method : 0.03996562957763672 time for calcul the mask position with numpy : 0.02458047866821289 nb_pixel_total : 74820 time to create 1 rle with old method : 0.09106230735778809 create new chi : 3.3366053104400635 time to delete rle : 0.0011186599731445312 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7960 TO DO : save crop sub photo not yet done ! save time : 0.5060954093933105 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 8.388062477111816 time for calcul the mask position with numpy : 0.3636765480041504 nb_pixel_total : 5756384 time to create 1 rle with new method : 1.0064074993133545 time for calcul the mask position with numpy : 0.02543497085571289 nb_pixel_total : 19044 time to create 1 rle with old method : 0.028170347213745117 time for calcul the mask position with numpy : 0.023108243942260742 nb_pixel_total : 328348 time to create 1 rle with new method : 0.5906174182891846 time for calcul the mask position with numpy : 0.022379159927368164 nb_pixel_total : 55311 time to create 1 rle with old method : 0.06641650199890137 time for calcul the mask position with numpy : 0.025829076766967773 nb_pixel_total : 42770 time to create 1 rle with old method : 0.04970598220825195 time for calcul the mask position with numpy : 0.023844480514526367 nb_pixel_total : 19794 time to create 1 rle with old method : 0.022571325302124023 time for calcul the mask position with numpy : 0.02299189567565918 nb_pixel_total : 119475 time to create 1 rle with old method : 0.13671875 time for calcul the mask position with numpy : 0.021761655807495117 nb_pixel_total : 24843 time to create 1 rle with old method : 0.028466463088989258 time for calcul the mask position with numpy : 0.022090435028076172 nb_pixel_total : 80556 time to create 1 rle with old method : 0.12769198417663574 time for calcul the mask position with numpy : 0.026045560836791992 nb_pixel_total : 35877 time to create 1 rle with old method : 0.041175127029418945 time for calcul the mask position with numpy : 0.02380847930908203 nb_pixel_total : 24989 time to create 1 rle with old method : 0.028037071228027344 time for calcul the mask position with numpy : 0.03149056434631348 nb_pixel_total : 8191 time to create 1 rle with old method : 0.010322332382202148 time for calcul the mask position with numpy : 0.02803778648376465 nb_pixel_total : 47196 time to create 1 rle with old method : 0.058824777603149414 time for calcul the mask position with numpy : 0.02632927894592285 nb_pixel_total : 51396 time to create 1 rle with old method : 0.08070063591003418 time for calcul the mask position with numpy : 0.025107622146606445 nb_pixel_total : 31738 time to create 1 rle with old method : 0.054111480712890625 time for calcul the mask position with numpy : 0.03801560401916504 nb_pixel_total : 36802 time to create 1 rle with old method : 0.04535794258117676 time for calcul the mask position with numpy : 0.04204988479614258 nb_pixel_total : 28660 time to create 1 rle with old method : 0.0442202091217041 time for calcul the mask position with numpy : 0.04041695594787598 nb_pixel_total : 3400 time to create 1 rle with old method : 0.004099607467651367 time for calcul the mask position with numpy : 0.050008535385131836 nb_pixel_total : 64985 time to create 1 rle with old method : 0.09888410568237305 time for calcul the mask position with numpy : 0.0381166934967041 nb_pixel_total : 20623 time to create 1 rle with old method : 0.03451681137084961 time for calcul the mask position with numpy : 0.03716588020324707 nb_pixel_total : 138403 time to create 1 rle with old method : 0.18801116943359375 time for calcul the mask position with numpy : 0.041843414306640625 nb_pixel_total : 69675 time to create 1 rle with old method : 0.1213688850402832 time for calcul the mask position with numpy : 0.042337656021118164 nb_pixel_total : 41780 time to create 1 rle with old method : 0.06345343589782715 create new chi : 4.046308279037476 time to delete rle : 0.002773284912109375 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 13646 TO DO : save crop sub photo not yet done ! save time : 0.9124927520751953 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 6.880650043487549 time for calcul the mask position with numpy : 0.7575609683990479 nb_pixel_total : 5842865 time to create 1 rle with new method : 0.7884550094604492 time for calcul the mask position with numpy : 0.04015302658081055 nb_pixel_total : 591165 time to create 1 rle with new method : 1.3079421520233154 time for calcul the mask position with numpy : 0.036957502365112305 nb_pixel_total : 26572 time to create 1 rle with old method : 0.03065204620361328 time for calcul the mask position with numpy : 0.03494095802307129 nb_pixel_total : 20169 time to create 1 rle with old method : 0.023441791534423828 time for calcul the mask position with numpy : 0.03722715377807617 nb_pixel_total : 62687 time to create 1 rle with old method : 0.08825969696044922 time for calcul the mask position with numpy : 0.03103351593017578 nb_pixel_total : 25533 time to create 1 rle with old method : 0.029690980911254883 time for calcul the mask position with numpy : 0.03350472450256348 nb_pixel_total : 25287 time to create 1 rle with old method : 0.037091970443725586 time for calcul the mask position with numpy : 0.03615450859069824 nb_pixel_total : 109848 time to create 1 rle with old method : 0.13100934028625488 time for calcul the mask position with numpy : 0.023168087005615234 nb_pixel_total : 104276 time to create 1 rle with old method : 0.14658474922180176 time for calcul the mask position with numpy : 0.022133588790893555 nb_pixel_total : 45098 time to create 1 rle with old method : 0.05253028869628906 time for calcul the mask position with numpy : 0.020911216735839844 nb_pixel_total : 26356 time to create 1 rle with old method : 0.03054046630859375 time for calcul the mask position with numpy : 0.022054433822631836 nb_pixel_total : 14264 time to create 1 rle with old method : 0.018336772918701172 time for calcul the mask position with numpy : 0.026170015335083008 nb_pixel_total : 93111 time to create 1 rle with old method : 0.11691951751708984 time for calcul the mask position with numpy : 0.023197174072265625 nb_pixel_total : 21410 time to create 1 rle with old method : 0.03551769256591797 time for calcul the mask position with numpy : 0.02537822723388672 nb_pixel_total : 10242 time to create 1 rle with old method : 0.01270151138305664 time for calcul the mask position with numpy : 0.022716760635375977 nb_pixel_total : 31357 time to create 1 rle with old method : 0.03649020195007324 create new chi : 4.140888452529907 time to delete rle : 0.0020551681518554688 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 11575 TO DO : save crop sub photo not yet done ! save time : 0.7121870517730713 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 10.101442575454712 time for calcul the mask position with numpy : 0.738156795501709 nb_pixel_total : 4840382 time to create 1 rle with new method : 0.7019805908203125 time for calcul the mask position with numpy : 0.03647422790527344 nb_pixel_total : 12275 time to create 1 rle with old method : 0.014217853546142578 time for calcul the mask position with numpy : 0.03766584396362305 nb_pixel_total : 263016 time to create 1 rle with new method : 0.7803845405578613 time for calcul the mask position with numpy : 0.03530144691467285 nb_pixel_total : 7665 time to create 1 rle with old method : 0.00898432731628418 time for calcul the mask position with numpy : 0.0358128547668457 nb_pixel_total : 17227 time to create 1 rle with old method : 0.020018339157104492 time for calcul the mask position with numpy : 0.038515567779541016 nb_pixel_total : 251641 time to create 1 rle with new method : 0.6114003658294678 time for calcul the mask position with numpy : 0.03676033020019531 nb_pixel_total : 308412 time to create 1 rle with new method : 1.3880739212036133 time for calcul the mask position with numpy : 0.03608536720275879 nb_pixel_total : 45108 time to create 1 rle with old method : 0.05178523063659668 time for calcul the mask position with numpy : 0.04106307029724121 nb_pixel_total : 24946 time to create 1 rle with old method : 0.02846980094909668 time for calcul the mask position with numpy : 0.034111738204956055 nb_pixel_total : 118624 time to create 1 rle with old method : 0.1618502140045166 time for calcul the mask position with numpy : 0.03710365295410156 nb_pixel_total : 279018 time to create 1 rle with new method : 0.7151081562042236 time for calcul the mask position with numpy : 0.035211801528930664 nb_pixel_total : 319181 time to create 1 rle with new method : 0.41048741340637207 time for calcul the mask position with numpy : 0.033495187759399414 nb_pixel_total : 26045 time to create 1 rle with old method : 0.029871463775634766 time for calcul the mask position with numpy : 0.025641202926635742 nb_pixel_total : 6015 time to create 1 rle with old method : 0.00872945785522461 time for calcul the mask position with numpy : 0.02309560775756836 nb_pixel_total : 37970 time to create 1 rle with old method : 0.04836297035217285 time for calcul the mask position with numpy : 0.03404736518859863 nb_pixel_total : 30893 time to create 1 rle with old method : 0.035385847091674805 time for calcul the mask position with numpy : 0.03388833999633789 nb_pixel_total : 19371 time to create 1 rle with old method : 0.026386499404907227 time for calcul the mask position with numpy : 0.03619551658630371 nb_pixel_total : 28080 time to create 1 rle with old method : 0.03465008735656738 time for calcul the mask position with numpy : 0.04107260704040527 nb_pixel_total : 5705 time to create 1 rle with old method : 0.007686614990234375 time for calcul the mask position with numpy : 0.03699493408203125 nb_pixel_total : 16747 time to create 1 rle with old method : 0.01991438865661621 time for calcul the mask position with numpy : 0.030342578887939453 nb_pixel_total : 14378 time to create 1 rle with old method : 0.016764163970947266 time for calcul the mask position with numpy : 0.04011416435241699 nb_pixel_total : 16888 time to create 1 rle with old method : 0.01959395408630371 time for calcul the mask position with numpy : 0.0342710018157959 nb_pixel_total : 298666 time to create 1 rle with new method : 0.7667124271392822 time for calcul the mask position with numpy : 0.03332972526550293 nb_pixel_total : 61987 time to create 1 rle with old method : 0.07064104080200195 create new chi : 7.705976247787476 time to delete rle : 0.004495859146118164 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 16870 TO DO : save crop sub photo not yet done ! save time : 1.1199562549591064 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 2.9148242473602295 time for calcul the mask position with numpy : 0.5945780277252197 nb_pixel_total : 6141303 time to create 1 rle with new method : 0.7012262344360352 time for calcul the mask position with numpy : 0.034798622131347656 nb_pixel_total : 124998 time to create 1 rle with old method : 0.14322352409362793 time for calcul the mask position with numpy : 0.041665077209472656 nb_pixel_total : 690053 time to create 1 rle with new method : 0.7915465831756592 time for calcul the mask position with numpy : 0.03618478775024414 nb_pixel_total : 28738 time to create 1 rle with old method : 0.03343033790588379 time for calcul the mask position with numpy : 0.03493857383728027 nb_pixel_total : 17401 time to create 1 rle with old method : 0.020269155502319336 time for calcul the mask position with numpy : 0.02430272102355957 nb_pixel_total : 28901 time to create 1 rle with old method : 0.03335881233215332 time for calcul the mask position with numpy : 0.021061182022094727 nb_pixel_total : 18846 time to create 1 rle with old method : 0.021787643432617188 create new chi : 2.5931053161621094 time to delete rle : 0.001180410385131836 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 7036 TO DO : save crop sub photo not yet done ! save time : 0.4957587718963623 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 7.078221321105957 time for calcul the mask position with numpy : 0.9205381870269775 nb_pixel_total : 6153494 time to create 1 rle with new method : 0.7612564563751221 time for calcul the mask position with numpy : 0.0352632999420166 nb_pixel_total : 41829 time to create 1 rle with old method : 0.04793906211853027 time for calcul the mask position with numpy : 0.0374908447265625 nb_pixel_total : 252452 time to create 1 rle with new method : 0.40932345390319824 time for calcul the mask position with numpy : 0.034969329833984375 nb_pixel_total : 39880 time to create 1 rle with old method : 0.045787811279296875 time for calcul the mask position with numpy : 0.03590869903564453 nb_pixel_total : 149100 time to create 1 rle with old method : 0.17530417442321777 time for calcul the mask position with numpy : 0.03416919708251953 nb_pixel_total : 74441 time to create 1 rle with old method : 0.08376407623291016 time for calcul the mask position with numpy : 0.02704024314880371 nb_pixel_total : 2540 time to create 1 rle with old method : 0.0030739307403564453 time for calcul the mask position with numpy : 0.02123093605041504 nb_pixel_total : 20817 time to create 1 rle with old method : 0.023772239685058594 time for calcul the mask position with numpy : 0.021498680114746094 nb_pixel_total : 24754 time to create 1 rle with old method : 0.027978897094726562 time for calcul the mask position with numpy : 0.021320104598999023 nb_pixel_total : 12893 time to create 1 rle with old method : 0.014994621276855469 time for calcul the mask position with numpy : 0.02143716812133789 nb_pixel_total : 26981 time to create 1 rle with old method : 0.030942916870117188 time for calcul the mask position with numpy : 0.028471708297729492 nb_pixel_total : 7271 time to create 1 rle with old method : 0.008408784866333008 time for calcul the mask position with numpy : 0.03363656997680664 nb_pixel_total : 57818 time to create 1 rle with old method : 0.06545376777648926 time for calcul the mask position with numpy : 0.033693552017211914 nb_pixel_total : 34048 time to create 1 rle with old method : 0.03926491737365723 time for calcul the mask position with numpy : 0.03499603271484375 nb_pixel_total : 77006 time to create 1 rle with old method : 0.08867430686950684 time for calcul the mask position with numpy : 0.03371858596801758 nb_pixel_total : 22468 time to create 1 rle with old method : 0.025857925415039062 time for calcul the mask position with numpy : 0.032619476318359375 nb_pixel_total : 33461 time to create 1 rle with old method : 0.0380396842956543 time for calcul the mask position with numpy : 0.036515235900878906 nb_pixel_total : 12962 time to create 1 rle with old method : 0.015060901641845703 time for calcul the mask position with numpy : 0.022270679473876953 nb_pixel_total : 6025 time to create 1 rle with old method : 0.00702977180480957 create new chi : 3.441469192504883 time to delete rle : 0.002227783203125 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12332 TO DO : save crop sub photo not yet done ! save time : 0.7781405448913574 map_output_result : {1353441848: (0.0, 'Should be the crop_list due to order', 0), 1353441792: (0.0, 'Should be the crop_list due to order', 0), 1353441756: (0.0, 'Should be the crop_list due to order', 0), 1353441239: (0.0, 'Should be the crop_list due to order', 0), 1353428479: (0.0, 'Should be the crop_list due to order', 0), 1353428477: (0.0, 'Should be the crop_list due to order', 0), 1353428421: (0.0, 'Should be the crop_list due to order', 0), 1353428415: (0.0, 'Should be the crop_list due to order', 0), 1353428365: (0.0, 'Should be the crop_list due to order', 0), 1353428364: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1353441848, 1353441792, 1353441756, 1353441239, 1353428479, 1353428477, 1353428421, 1353428415, 1353428365, 1353428364] Looping around the photos to save general results len do output : 10 /1353441848.Didn't retrieve data . /1353441792.Didn't retrieve data . /1353441756.Didn't retrieve data . /1353441239.Didn't retrieve data . /1353428479.Didn't retrieve data . /1353428477.Didn't retrieve data . /1353428421.Didn't retrieve data . /1353428415.Didn't retrieve data . /1353428365.Didn't retrieve data . /1353428364.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441848', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441792', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441756', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441239', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428479', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428477', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428421', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428415', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428365', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428364', None, None, None, None, None, '2758901') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.015979528427124023 save_final save missing photos in datou_result : time spend for datou_step_exec : 101.84974431991577 time spend to save output : 0.01663804054260254 total time spend for step 3 : 101.86638236045837 step4:ventilate_hashtags_in_portfolio Thu Apr 24 20:25:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22396721 get user id for portfolio 22396721 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22396721 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','background','pet_fonce','autre','flou','environnement','metal','pehd','carton','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22396721 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','background','pet_fonce','autre','flou','environnement','metal','pehd','carton','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22396721 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','background','pet_fonce','autre','flou','environnement','metal','pehd','carton','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22397022,22397023,22397024,22397025,22397026,22397027,22397028,22397029,22397030,22397031,22397032?tags=papier,pet_clair,background,pet_fonce,autre,flou,environnement,metal,pehd,carton,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1353441848, 1353441792, 1353441756, 1353441239, 1353428479, 1353428477, 1353428421, 1353428415, 1353428365, 1353428364] Looping around the photos to save general results len do output : 1 /22396721. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441848', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441792', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441756', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441239', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428479', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428477', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428421', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428415', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428365', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428364', None, None, None, None, None, '2758901') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01763629913330078 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.692190408706665 time spend to save output : 0.01882171630859375 total time spend for step 4 : 1.7110121250152588 step5:final Thu Apr 24 20:25:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1353441848: ('0.13299057904411762',), 1353441792: ('0.13299057904411762',), 1353441756: ('0.13299057904411762',), 1353441239: ('0.13299057904411762',), 1353428479: ('0.13299057904411762',), 1353428477: ('0.13299057904411762',), 1353428421: ('0.13299057904411762',), 1353428415: ('0.13299057904411762',), 1353428365: ('0.13299057904411762',), 1353428364: ('0.13299057904411762',)} new output for save of step final : {1353441848: ('0.13299057904411762',), 1353441792: ('0.13299057904411762',), 1353441756: ('0.13299057904411762',), 1353441239: ('0.13299057904411762',), 1353428479: ('0.13299057904411762',), 1353428477: ('0.13299057904411762',), 1353428421: ('0.13299057904411762',), 1353428415: ('0.13299057904411762',), 1353428365: ('0.13299057904411762',), 1353428364: ('0.13299057904411762',)} [1353441848, 1353441792, 1353441756, 1353441239, 1353428479, 1353428477, 1353428421, 1353428415, 1353428365, 1353428364] Looping around the photos to save general results len do output : 10 /1353441848.Didn't retrieve data . /1353441792.Didn't retrieve data . /1353441756.Didn't retrieve data . /1353441239.Didn't retrieve data . /1353428479.Didn't retrieve data . /1353428477.Didn't retrieve data . /1353428421.Didn't retrieve data . /1353428415.Didn't retrieve data . /1353428365.Didn't retrieve data . /1353428364.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441848', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441792', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441756', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441239', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428479', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428477', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428421', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428415', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428365', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428364', None, None, None, None, None, '2758901') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014518260955810547 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13158154487609863 time spend to save output : 0.015060186386108398 total time spend for step 5 : 0.14664173126220703 step6:blur_detection Thu Apr 24 20:25:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580.jpg resize: (2160, 3264) 1353441848 -0.3446810488499565 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db.jpg resize: (2160, 3264) 1353441792 -2.7118440220597027 treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90.jpg resize: (2160, 3264) 1353441756 1.3077177740542878 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de.jpg resize: (2160, 3264) 1353441239 1.538790514379782 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e.jpg resize: (2160, 3264) 1353428479 -1.125484961536628 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa.jpg resize: (2160, 3264) 1353428477 -2.0254325043364503 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676.jpg resize: (2160, 3264) 1353428421 -1.6392585546578486 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27.jpg resize: (2160, 3264) 1353428415 -2.4865685979107552 treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e.jpg resize: (2160, 3264) 1353428365 -0.13125530627287688 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e.jpg resize: (2160, 3264) 1353428364 -1.5199432529432608 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950437_0.png resize: (236, 242) 1353452337 -0.5827189146916968 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950433_0.png resize: (73, 91) 1353452339 0.3363284039946947 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950434_0.png resize: (378, 279) 1353452340 -0.6279387140645355 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950429_0.png resize: (138, 151) 1353452341 -0.6198936910140008 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950428_0.png resize: (161, 388) 1353452343 -2.692950805658039 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950438_0.png resize: (210, 211) 1353452344 -0.7329712721964731 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950435_0.png resize: (169, 196) 1353452345 -0.10614326382333969 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950432_0.png resize: (93, 114) 1353452346 0.39054195658207735 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950430_0.png resize: (106, 228) 1353452348 -1.6417860786931875 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950443_0.png resize: (100, 115) 1353452349 -2.1757612214706037 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950457_0.png resize: (119, 78) 1353452350 0.4364794349179301 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950463_0.png resize: (157, 130) 1353452352 -1.474328469108266 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950456_0.png resize: (241, 315) 1353452353 -1.77299673397741 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950453_0.png resize: (222, 258) 1353452354 -1.5731344687321247 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950448_0.png resize: (228, 189) 1353452355 -0.9812164555690732 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950440_0.png resize: (91, 104) 1353452357 -1.557735912700128 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950451_0.png resize: (72, 156) 1353452358 -0.2810855209010194 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950452_0.png resize: (239, 108) 1353452359 -1.2156754576864681 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950465_0.png resize: (180, 203) 1353452361 -2.0854642041866924 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950460_0.png resize: (242, 124) 1353452362 -1.3239615887317613 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950466_0.png resize: (297, 214) 1353452363 -1.4673843120936856 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950449_0.png resize: (198, 278) 1353452366 -1.9980543791129652 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950442_0.png resize: (192, 216) 1353452367 -1.7133916694900275 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950450_0.png resize: (109, 217) 1353452369 -1.4702456382471754 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950458_0.png resize: (141, 120) 1353452370 -1.4026579806041581 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950464_0.png resize: (115, 254) 1353452372 -3.1842329561574125 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950444_0.png resize: (85, 169) 1353452373 0.9370269157816252 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950455_0.png resize: (85, 196) 1353452374 0.29395703746857893 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950441_0.png resize: (410, 484) 1353452376 -1.6025748373701973 treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950469_0.png resize: (59, 75) 1353452377 0.2810238569970632 treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950471_0.png resize: (71, 103) 1353452378 -1.0875764002994823 treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950472_0.png resize: (46, 75) 1353452380 0.7418002245198527 treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950470_0.png resize: (94, 125) 1353452381 -1.6109802255062855 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950484_0.png resize: (213, 187) 1353452382 -0.8920105241058796 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950483_0.png resize: (179, 228) 1353452383 -1.2626578612413895 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950475_0.png resize: (165, 140) 1353452385 1.179346631728149 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950474_0.png resize: (194, 120) 1353452386 -0.2576989226372064 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950479_0.png resize: (90, 186) 1353452387 -1.4160736007100974 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950489_0.png resize: (401, 359) 1353452389 -0.6153592070494679 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950488_0.png resize: (333, 206) 1353452390 -0.6651239182178104 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950486_0.png resize: (305, 142) 1353452391 -1.375485351046009 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950487_0.png resize: (139, 73) 1353452393 -0.5278084596201669 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950503_0.png resize: (365, 159) 1353452394 -1.3440429284020956 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950493_0.png resize: (282, 253) 1353452396 -1.4774684665188322 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950510_0.png resize: (118, 241) 1353452398 -1.9187493737364654 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950497_0.png resize: (313, 307) 1353452399 -1.9779094177392988 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950498_0.png resize: (120, 153) 1353452400 -2.301399120484579 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950504_0.png resize: (120, 125) 1353452401 -2.6099647354845197 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950511_0.png resize: (328, 168) 1353452403 -1.0100707109053435 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950496_0.png resize: (120, 219) 1353452404 0.5625962006128844 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950514_0.png resize: (181, 152) 1353452405 -0.3949971413667373 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950499_0.png resize: (140, 292) 1353452407 -1.3787326116144014 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950501_0.png resize: (187, 233) 1353452408 -0.34500565164205677 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950494_0.png resize: (338, 317) 1353452409 -2.7020471987189327 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950505_0.png resize: (193, 202) 1353452411 -0.4466444250165537 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950509_0.png resize: (352, 424) 1353452412 -1.3489316814664194 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950524_0.png resize: (235, 159) 1353452413 -1.3201477387232992 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950520_0.png resize: (224, 167) 1353452415 -1.2263245874027169 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950515_0.png resize: (225, 222) 1353452416 -1.5638284471268955 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950521_0.png resize: (320, 308) 1353452417 -1.6275961181214447 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950518_0.png resize: (555, 322) 1353452418 0.08291164166828877 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950528_0.png resize: (261, 140) 1353452420 -1.252967554351193 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950519_0.png resize: (185, 101) 1353452421 0.6641070975717747 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950516_0.png resize: (100, 130) 1353452422 -0.6270061190749098 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950538_0.png resize: (198, 153) 1353452424 -1.5309466130631442 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950536_0.png resize: (80, 81) 1353452425 1.5917081749856041 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950548_0.png resize: (247, 297) 1353452426 -1.5187384420010002 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950532_0.png resize: (81, 235) 1353452427 -0.7513427695436867 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950537_0.png resize: (182, 225) 1353452429 -2.1442624646366175 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950530_0.png resize: (307, 302) 1353452430 0.0901307209864302 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950535_0.png resize: (140, 154) 1353452431 -1.3086556342010327 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950546_0.png resize: (406, 426) 1353452433 -2.3664117733657415 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950547_0.png resize: (188, 169) 1353452434 1.2103998192555157 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950554_0.png resize: (158, 115) 1353452435 0.6300999921631978 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950551_0.png resize: (166, 158) 1353452437 -2.0712875013640777 treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950559_0.png resize: (1173, 832) 1353452438 0.17270848971403194 treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950557_0.png resize: (160, 173) 1353452439 -0.6395231828297359 treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950555_0.png resize: (185, 147) 1353452441 0.17301158446667056 treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950556_0.png resize: (174, 252) 1353452442 -1.2596325376166617 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950575_0.png resize: (446, 434) 1353452443 -0.9316198479841233 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950565_0.png resize: (449, 369) 1353452444 -1.073707122860327 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950568_0.png resize: (117, 86) 1353452445 -0.45754668751935595 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950574_0.png resize: (372, 247) 1353452446 -1.2897637143332268 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950567_0.png resize: (300, 347) 1353452447 1.8090501210561014 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950573_0.png resize: (121, 161) 1353452448 -1.204078642553751 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950566_0.png resize: (322, 212) 1353452449 -2.8352156706845557 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950572_0.png resize: (212, 144) 1353452450 -1.6404754790012475 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950562_0.png resize: (135, 128) 1353452451 0.45093933946207443 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950571_0.png resize: (284, 134) 1353452452 -0.6105898129086365 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950569_0.png resize: (189, 205) 1353452453 -0.6045272503028031 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950570_0.png resize: (126, 143) 1353452454 -0.45396920939821794 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950564_0.png resize: (213, 156) 1353452455 -1.116182216953186 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950578_0.png resize: (422, 127) 1353452456 -2.0438405089782448 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950561_0.png resize: (87, 81) 1353452457 -0.968387933662267 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950439_0.png resize: (311, 341) 1353452488 -1.76552956208284 treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950467_0.png resize: (746, 595) 1353452489 -0.2717670804111651 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950476_0.png resize: (100, 129) 1353452490 2.829623179739255 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950473_0.png resize: (110, 173) 1353452492 1.1157816751590086 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950481_0.png resize: (89, 186) 1353452493 -0.4217251308923914 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950491_0.png resize: (570, 485) 1353452494 -1.3040707432626475 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950506_0.png resize: (160, 313) 1353452495 -1.4905445351723008 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950517_0.png resize: (173, 188) 1353452496 -1.1811048112132472 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950549_0.png resize: (648, 702) 1353452497 -1.037943787088078 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950531_0.png resize: (548, 740) 1353452498 -3.1538419720902042 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950534_0.png resize: (197, 161) 1353452499 -2.4305977716000235 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950543_0.png resize: (146, 275) 1353452500 -1.2424626440885156 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950540_0.png resize: (232, 500) 1353452501 -3.6909396879300025 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950533_0.png resize: (118, 171) 1353452502 -2.948384908036588 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950542_0.png resize: (66, 109) 1353452503 2.2086758129071535 treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950558_0.png resize: (171, 230) 1353452505 -0.6739319687844152 treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950560_0.png resize: (496, 397) 1353452508 -0.6951992038993575 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950576_0.png resize: (245, 246) 1353452509 -1.5896081937529067 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950563_0.png resize: (224, 203) 1353452510 -0.4503009626950452 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950482_0.png resize: (381, 364) 1353452516 -0.021886301443145673 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950431_0.png resize: (192, 206) 1353452568 -3.351109757628913 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950445_0.png resize: (238, 589) 1353452569 -2.292185519017347 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950446_0.png resize: (283, 170) 1353452570 -3.638193362260271 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950462_0.png resize: (73, 113) 1353452572 0.8039191746486964 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950447_0.png resize: (178, 312) 1353452573 -2.9325056980013398 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950454_0.png resize: (206, 312) 1353452574 -2.4755262917849805 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950461_0.png resize: (326, 159) 1353452576 -1.5422866260586312 treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950468_0.png resize: (146, 131) 1353452577 0.06797379532670016 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950478_0.png resize: (286, 364) 1353452578 -0.04382227829585937 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950480_0.png resize: (409, 407) 1353452579 -0.5728481654786602 treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950477_0.png resize: (476, 482) 1353452581 -0.5939572349029346 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950485_0.png resize: (290, 379) 1353452582 -0.8223197071525425 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950492_0.png resize: (273, 219) 1353452583 -1.428967261348983 treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950490_0.png resize: (575, 485) 1353452585 -1.356815026808429 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950513_0.png resize: (658, 645) 1353452586 -2.096470719360258 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950507_0.png resize: (361, 311) 1353452587 -1.6076518200974366 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950495_0.png resize: (321, 733) 1353452589 -2.4061423016262835 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950502_0.png resize: (146, 593) 1353452590 -1.4457015839086123 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950500_0.png resize: (182, 258) 1353452591 -0.6908344074029021 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950508_0.png resize: (196, 189) 1353452592 -1.2079608523516212 treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950512_0.png resize: (223, 428) 1353452594 -2.9055368760138367 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950526_0.png resize: (395, 193) 1353452595 -0.544690964657427 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950525_0.png resize: (201, 156) 1353452596 -1.3937977785372477 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950523_0.png resize: (343, 458) 1353452598 -1.9822578974771676 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950527_0.png resize: (171, 145) 1353452599 -0.3704332760946398 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950522_0.png resize: (262, 550) 1353452600 -2.177401949745643 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950544_0.png resize: (694, 583) 1353452601 -0.6979153131603015 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950541_0.png resize: (319, 152) 1353452603 -1.6279833964601964 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950550_0.png resize: (456, 770) 1353452604 -3.111358191476308 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950545_0.png resize: (662, 610) 1353452605 -2.6958471781657853 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950553_0.png resize: (574, 637) 1353452607 -3.1043293802282257 treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950577_0.png resize: (502, 626) 1353452608 -1.6648863409034917 treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950529_0.png resize: (931, 897) 1353452647 -1.2574118550507047 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950539_0.png resize: (225, 196) 1353452649 -1.2637178109009168 treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950552_0.png resize: (76, 123) 1353452650 -1.6782454320633384 treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950459_0.png resize: (305, 163) 1353452663 -0.9034708287640879 treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950436_0.png resize: (201, 235) 1353452679 -0.9606884809837546 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 161 time used for this insertion : 0.02225637435913086 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 161 time used for this insertion : 0.035280466079711914 save missing photos in datou_result : time spend for datou_step_exec : 36.511250495910645 time spend to save output : 0.06372642517089844 total time spend for step 6 : 36.57497692108154 step7:brightness Thu Apr 24 20:25:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580.jpg treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db.jpg treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90.jpg treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de.jpg treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e.jpg treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa.jpg treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676.jpg treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27.jpg treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e.jpg treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e.jpg treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950437_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950433_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950434_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950429_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950428_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950438_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950435_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950432_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950430_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950443_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950457_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950463_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950456_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950453_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950448_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950440_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950451_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950452_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950465_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950460_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950466_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950449_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950442_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950450_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950458_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950464_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950444_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950455_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950441_0.png treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950469_0.png treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950471_0.png treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950472_0.png treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950470_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950484_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950483_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950475_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950474_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950479_0.png treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950489_0.png treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950488_0.png treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950486_0.png treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950487_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950503_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950493_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950510_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950497_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950498_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950504_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950511_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950496_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950514_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950499_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950501_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950494_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950505_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950509_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950524_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950520_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950515_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950521_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950518_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950528_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950519_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950516_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950538_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950536_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950548_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950532_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950537_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950530_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950535_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950546_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950547_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950554_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950551_0.png treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950559_0.png treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950557_0.png treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950555_0.png treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950556_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950575_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950565_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950568_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950574_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950567_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950573_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950566_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950572_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950562_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950571_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950569_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950570_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950564_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950578_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950561_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950439_0.png treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950467_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950476_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950473_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950481_0.png treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950491_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950506_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950517_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950549_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950531_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950534_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950543_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950540_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950533_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950542_0.png treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950558_0.png treat image : temp/1745518829_2298333_1353428365_4922143f7362ba73b30aa5f9e012670e_rle_crop_3767950560_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950576_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950563_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950482_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950431_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950445_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950446_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950462_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950447_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950454_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950461_0.png treat image : temp/1745518829_2298333_1353441756_6ca1537a081d884991e36578a0d5ed90_rle_crop_3767950468_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950478_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950480_0.png treat image : temp/1745518829_2298333_1353441239_23425c3bb115ac61271a90c0ad4e77de_rle_crop_3767950477_0.png treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950485_0.png treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950492_0.png treat image : temp/1745518829_2298333_1353428479_453925c926390555fffe9bd2e0eb5d8e_rle_crop_3767950490_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950513_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950507_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950495_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950502_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950500_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950508_0.png treat image : temp/1745518829_2298333_1353428477_32e7f44d9b96a4e7e733b3ea843f90aa_rle_crop_3767950512_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950526_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950525_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950523_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950527_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950522_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950544_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950541_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950550_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950545_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950553_0.png treat image : temp/1745518829_2298333_1353428364_5b2b0a92e6ba1f0c55b9de9f20f4476e_rle_crop_3767950577_0.png treat image : temp/1745518829_2298333_1353428421_04ef96ead350b52de6c83ee732d51676_rle_crop_3767950529_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950539_0.png treat image : temp/1745518829_2298333_1353428415_496696d8b91cf0ec6f061ab158b28a27_rle_crop_3767950552_0.png treat image : temp/1745518829_2298333_1353441792_76c868e2a78dabeed87412141cee17db_rle_crop_3767950459_0.png treat image : temp/1745518829_2298333_1353441848_c9a88fde8bf14b0c61a93cd72f2d9580_rle_crop_3767950436_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 161 time used for this insertion : 0.017632246017456055 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 161 time used for this insertion : 0.03800535202026367 save missing photos in datou_result : time spend for datou_step_exec : 9.007282972335815 time spend to save output : 0.06129312515258789 total time spend for step 7 : 9.068576097488403 step8:velours_tree Thu Apr 24 20:26:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2855794429779053 time spend to save output : 5.555152893066406e-05 total time spend for step 8 : 0.28563499450683594 step9:send_mail_cod Thu Apr 24 20:26:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22396721_24-04-2025_20_26_03.pdf 22397022 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223970221745519163 22397023 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223970231745519165 22397024 imagette223970241745519166 22397025 change filename to text .imagette223970251745519166 22397026 change filename to text .change filename to text .change filename to text .imagette223970261745519167 22397027 imagette223970271745519167 22397029 change filename to text .imagette223970291745519167 22397030 change filename to text .imagette223970301745519167 22397031 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223970311745519167 22397032 imagette223970321745519168 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22396721 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22397022,22397023,22397024,22397025,22397026,22397027,22397028,22397029,22397030,22397031,22397032?tags=papier,pet_clair,background,pet_fonce,autre,flou,environnement,metal,pehd,carton,mal_croppe args[1353441848] : ((1353441848, -0.3446810488499565, 492688767), (1353441848, 0.10988251353388881, 2107752395), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353441792] : ((1353441792, -2.7118440220597027, 492609224), (1353441792, -0.20298460076840133, 496442774), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353441756] : ((1353441756, 1.3077177740542878, 492688767), (1353441756, -0.0779753093037016, 496442774), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353441239] : ((1353441239, 1.538790514379782, 492688767), (1353441239, 0.16905286251304313, 2107752395), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353428479] : ((1353428479, -1.125484961536628, 492688767), (1353428479, 0.008859051769155907, 2107752395), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353428477] : ((1353428477, -2.0254325043364503, 492609224), (1353428477, 0.10517396262932444, 2107752395), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353428421] : ((1353428421, -1.6392585546578486, 492688767), (1353428421, 0.019430187312875137, 2107752395), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353428415] : ((1353428415, -2.4865685979107552, 492609224), (1353428415, -0.253115687763914, 496442774), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353428365] : ((1353428365, -0.13125530627287688, 492688767), (1353428365, -0.342213420472388, 496442774), '0.13299057904411762') We are sending mail with results at report@fotonower.com args[1353428364] : ((1353428364, -1.5199432529432608, 492688767), (1353428364, 0.04714001088824995, 2107752395), '0.13299057904411762') We are sending mail with results at report@fotonower.com refus_total : 0.13299057904411762 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22396721 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22396721_24-04-2025_20_26_03.pdf results_Auto_P22396721_24-04-2025_20_26_03.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22396721_24-04-2025_20_26_03.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22396721','results_Auto_P22396721_24-04-2025_20_26_03.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22396721_24-04-2025_20_26_03.pdf','pdf','','0.94','0.13299057904411762') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22396721

https://www.fotonower.com/image?json=false&list_photos_id=1353441848
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353441792
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353441756
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3077177740542878)
https://www.fotonower.com/image?json=false&list_photos_id=1353441239
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.538790514379782)
https://www.fotonower.com/image?json=false&list_photos_id=1353428479
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353428477
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353428421
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353428415
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353428365
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353428364
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.30%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/22397022?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22397023?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22397025?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22397026?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22397029?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22397030?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22397031?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22396721_24-04-2025_20_26_03.pdf.

Lien vers velours :https://www.fotonower.com/velours/22397022,22397023,22397024,22397025,22397026,22397027,22397028,22397029,22397030,22397031,22397032?tags=papier,pet_clair,background,pet_fonce,autre,flou,environnement,metal,pehd,carton,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 24 Apr 2025 18:26:12 GMT Content-Length: 0 Connection: close X-Message-Id: d1mThGgeTbGTensj3fkolw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1353441848, 1353441792, 1353441756, 1353441239, 1353428479, 1353428477, 1353428421, 1353428415, 1353428365, 1353428364] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441848', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441792', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441756', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441239', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428479', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428477', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428421', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428415', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428365', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428364', None, None, None, None, None, '2758901') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01625204086303711 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.068419933319092 time spend to save output : 0.016496658325195312 total time spend for step 9 : 9.084916591644287 step10:split_time_score Thu Apr 24 20:26:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24042025 22396721 Nombre de photos uploadées : 10 / 23040 (0%) 24042025 22396721 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 24042025 22396721 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 3.337860107421875e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004763603210449219 elapsed_time : insert_dashboard_record_day_entry 0.027903318405151367 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15991931890933772 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22375561_24-04-2025_08_54_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22375561 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22375561 AND mptpi.`type`=3594 To do Qualite : 0.04825650604752327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22381160_24-04-2025_13_29_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22381160 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22381160 AND mptpi.`type`=3726 To do Qualite : 0.14264551885569046 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22380034_24-04-2025_12_29_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22380034 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22380034 AND mptpi.`type`=3594 To do Qualite : 0.14242511602441907 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22381162_24-04-2025_13_37_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22381162 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22381162 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22396716 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22396717 order by id desc limit 1 Qualite : 0.037089267553703925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22390901_24-04-2025_18_01_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22390901 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22390901 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22396719 order by id desc limit 1 Qualite : 0.13299057904411762 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22396721_24-04-2025_20_26_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22396721 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22396721 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24042025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1353441848, 1353441792, 1353441756, 1353441239, 1353428479, 1353428477, 1353428421, 1353428415, 1353428365, 1353428364] Looping around the photos to save general results len do output : 1 /22396721Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441848', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441792', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441756', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353441239', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428479', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428477', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428421', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428415', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428365', None, None, None, None, None, '2758901') ('3318', None, None, None, None, None, None, None, '2758901') ('3318', '22396721', '1353428364', None, None, None, None, None, '2758901') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01372981071472168 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.146371841430664 time spend to save output : 0.014029264450073242 total time spend for step 10 : 3.1604011058807373 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 155.51user 135.79system 5:51.34elapsed 82%CPU (0avgtext+0avgdata 4594988maxresident)k 1747496inputs+106792outputs (18222major+13896170minor)pagefaults 0swaps