python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 857173 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2675593'] with mtr_portfolio_ids : ['21504489'] and first list_photo_ids : [] new path : /proc/857173/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.1813945770263672 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Mar 17 22:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5304 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-17 22:20:33.378202: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-17 22:20:33.403149: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-17 22:20:33.404891: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8918000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-17 22:20:33.404941: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-17 22:20:33.407638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-17 22:20:33.643557: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1c12a190 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-17 22:20:33.643615: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-17 22:20:33.644725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-17 22:20:33.645128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-17 22:20:33.648190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-17 22:20:33.651258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-17 22:20:33.651647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-17 22:20:33.655393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-17 22:20:33.656956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-17 22:20:33.663025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-17 22:20:33.664152: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-17 22:20:33.664236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-17 22:20:33.664818: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-17 22:20:33.664833: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-17 22:20:33.664841: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-17 22:20:33.665802: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4843 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-17 22:20:33.911044: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-17 22:20:33.911149: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-17 22:20:33.911177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-17 22:20:33.911203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-17 22:20:33.911228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-17 22:20:33.911252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-17 22:20:33.911276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-17 22:20:33.911299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-17 22:20:33.912587: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-17 22:20:33.913653: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-17 22:20:33.913693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-17 22:20:33.913712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-17 22:20:33.913729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-17 22:20:33.913746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-17 22:20:33.913762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-17 22:20:33.913779: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-17 22:20:33.913796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-17 22:20:33.914961: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-17 22:20:33.914993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-17 22:20:33.915005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-17 22:20:33.915014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-17 22:20:33.916213: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4843 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-17 22:20:44.516602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-17 22:20:44.696588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-17 22:20:46.141308: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:46.142064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:46.142764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.097118: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-03-17 22:20:47.165434: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.165513: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.166270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.166287: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.172590: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.172612: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.173329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.173343: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.219875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.219961: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.220681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.220696: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.221419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.221433: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.222143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.222157: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.230066: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.230085: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.230799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.230814: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-17 22:20:47.246346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.247416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.248420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.249482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.254038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.255131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.256200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.256936: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.258023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.258038: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-03-17 22:20:47.268096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.268808: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.277710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.278420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.279149: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.279858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.280571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-17 22:20:47.281275: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 73 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 71 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 54 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 43 Detection mask done ! Trying to reset tf kernel 857537 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4332 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006418228149414062 nb_pixel_total : 14398 time to create 1 rle with old method : 0.0169064998626709 length of segment : 133 time for calcul the mask position with numpy : 0.011669635772705078 nb_pixel_total : 98108 time to create 1 rle with old method : 0.13746118545532227 length of segment : 250 time for calcul the mask position with numpy : 0.003396749496459961 nb_pixel_total : 135391 time to create 1 rle with old method : 0.1933269500732422 length of segment : 299 time for calcul the mask position with numpy : 0.1832265853881836 nb_pixel_total : 354667 time to create 1 rle with new method : 0.14933466911315918 length of segment : 673 time for calcul the mask position with numpy : 0.0005550384521484375 nb_pixel_total : 15275 time to create 1 rle with old method : 0.018665313720703125 length of segment : 174 time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 15127 time to create 1 rle with old method : 0.017948627471923828 length of segment : 132 time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 5543 time to create 1 rle with old method : 0.007333517074584961 length of segment : 40 time for calcul the mask position with numpy : 0.004522085189819336 nb_pixel_total : 241326 time to create 1 rle with new method : 0.024486541748046875 length of segment : 529 time for calcul the mask position with numpy : 0.0014293193817138672 nb_pixel_total : 35358 time to create 1 rle with old method : 0.04453325271606445 length of segment : 275 time for calcul the mask position with numpy : 0.0018737316131591797 nb_pixel_total : 40154 time to create 1 rle with old method : 0.047693490982055664 length of segment : 298 time for calcul the mask position with numpy : 0.06815648078918457 nb_pixel_total : 95116 time to create 1 rle with old method : 0.1177980899810791 length of segment : 698 time for calcul the mask position with numpy : 0.00043082237243652344 nb_pixel_total : 11484 time to create 1 rle with old method : 0.014224767684936523 length of segment : 140 time for calcul the mask position with numpy : 0.0009293556213378906 nb_pixel_total : 18588 time to create 1 rle with old method : 0.022505998611450195 length of segment : 227 time for calcul the mask position with numpy : 0.004056453704833984 nb_pixel_total : 105500 time to create 1 rle with old method : 0.1282334327697754 length of segment : 327 time for calcul the mask position with numpy : 0.002695322036743164 nb_pixel_total : 110040 time to create 1 rle with old method : 0.16704702377319336 length of segment : 331 time for calcul the mask position with numpy : 0.0003771781921386719 nb_pixel_total : 10542 time to create 1 rle with old method : 0.013179302215576172 length of segment : 119 time for calcul the mask position with numpy : 0.03384089469909668 nb_pixel_total : 20279 time to create 1 rle with old method : 0.032204389572143555 length of segment : 156 time for calcul the mask position with numpy : 0.007100820541381836 nb_pixel_total : 6306 time to create 1 rle with old method : 0.008223295211791992 length of segment : 120 time for calcul the mask position with numpy : 0.0005104541778564453 nb_pixel_total : 12491 time to create 1 rle with old method : 0.015742063522338867 length of segment : 101 time for calcul the mask position with numpy : 0.5062777996063232 nb_pixel_total : 380956 time to create 1 rle with new method : 0.1859283447265625 length of segment : 723 time for calcul the mask position with numpy : 0.030686378479003906 nb_pixel_total : 20990 time to create 1 rle with old method : 0.03479266166687012 length of segment : 168 time for calcul the mask position with numpy : 0.008854389190673828 nb_pixel_total : 13820 time to create 1 rle with old method : 0.015916109085083008 length of segment : 122 time for calcul the mask position with numpy : 0.43250083923339844 nb_pixel_total : 202168 time to create 1 rle with new method : 0.014128684997558594 length of segment : 540 time for calcul the mask position with numpy : 0.039759159088134766 nb_pixel_total : 56119 time to create 1 rle with old method : 0.07130813598632812 length of segment : 391 time for calcul the mask position with numpy : 0.11843204498291016 nb_pixel_total : 151148 time to create 1 rle with new method : 0.011358261108398438 length of segment : 726 time for calcul the mask position with numpy : 0.12451791763305664 nb_pixel_total : 122037 time to create 1 rle with old method : 0.15114378929138184 length of segment : 355 time for calcul the mask position with numpy : 0.03564000129699707 nb_pixel_total : 98596 time to create 1 rle with old method : 0.1234438419342041 length of segment : 407 time for calcul the mask position with numpy : 0.5243985652923584 nb_pixel_total : 648068 time to create 1 rle with new method : 0.05145716667175293 length of segment : 929 time for calcul the mask position with numpy : 0.08980345726013184 nb_pixel_total : 97755 time to create 1 rle with old method : 0.11959123611450195 length of segment : 423 time for calcul the mask position with numpy : 0.008629560470581055 nb_pixel_total : 27985 time to create 1 rle with old method : 0.03636765480041504 length of segment : 169 time for calcul the mask position with numpy : 0.011750459671020508 nb_pixel_total : 32567 time to create 1 rle with old method : 0.04358792304992676 length of segment : 183 time for calcul the mask position with numpy : 0.009516477584838867 nb_pixel_total : 16989 time to create 1 rle with old method : 0.023171663284301758 length of segment : 163 time for calcul the mask position with numpy : 0.07215476036071777 nb_pixel_total : 58680 time to create 1 rle with old method : 0.06910324096679688 length of segment : 331 time for calcul the mask position with numpy : 0.12131881713867188 nb_pixel_total : 140385 time to create 1 rle with old method : 0.15515589714050293 length of segment : 282 time for calcul the mask position with numpy : 0.05326390266418457 nb_pixel_total : 98405 time to create 1 rle with old method : 0.11929440498352051 length of segment : 349 time for calcul the mask position with numpy : 0.0564274787902832 nb_pixel_total : 41841 time to create 1 rle with old method : 0.054932355880737305 length of segment : 315 time for calcul the mask position with numpy : 0.0006926059722900391 nb_pixel_total : 13787 time to create 1 rle with old method : 0.01700878143310547 length of segment : 108 time for calcul the mask position with numpy : 0.03641963005065918 nb_pixel_total : 31710 time to create 1 rle with old method : 0.04025530815124512 length of segment : 188 time for calcul the mask position with numpy : 0.06638360023498535 nb_pixel_total : 75278 time to create 1 rle with old method : 0.09462594985961914 length of segment : 261 time for calcul the mask position with numpy : 0.2787597179412842 nb_pixel_total : 105124 time to create 1 rle with old method : 0.13724517822265625 length of segment : 821 time for calcul the mask position with numpy : 0.2007756233215332 nb_pixel_total : 100405 time to create 1 rle with old method : 0.13152551651000977 length of segment : 435 time for calcul the mask position with numpy : 0.12905001640319824 nb_pixel_total : 54149 time to create 1 rle with old method : 0.06179070472717285 length of segment : 389 time for calcul the mask position with numpy : 0.19267773628234863 nb_pixel_total : 122739 time to create 1 rle with old method : 0.1397693157196045 length of segment : 614 time for calcul the mask position with numpy : 0.1607828140258789 nb_pixel_total : 92283 time to create 1 rle with old method : 0.10495257377624512 length of segment : 408 time for calcul the mask position with numpy : 0.6261463165283203 nb_pixel_total : 297543 time to create 1 rle with new method : 0.08876252174377441 length of segment : 986 time for calcul the mask position with numpy : 0.254741907119751 nb_pixel_total : 269719 time to create 1 rle with new method : 0.016739368438720703 length of segment : 491 time for calcul the mask position with numpy : 0.18257713317871094 nb_pixel_total : 392411 time to create 1 rle with new method : 0.046915292739868164 length of segment : 1226 time for calcul the mask position with numpy : 0.4879186153411865 nb_pixel_total : 743700 time to create 1 rle with new method : 0.12021303176879883 length of segment : 944 time for calcul the mask position with numpy : 0.019100427627563477 nb_pixel_total : 379065 time to create 1 rle with new method : 0.02447032928466797 length of segment : 757 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 9608 time to create 1 rle with old method : 0.011155843734741211 length of segment : 176 time for calcul the mask position with numpy : 0.0710442066192627 nb_pixel_total : 76365 time to create 1 rle with old method : 0.08751749992370605 length of segment : 330 time for calcul the mask position with numpy : 0.04425477981567383 nb_pixel_total : 49660 time to create 1 rle with old method : 0.058550357818603516 length of segment : 231 time for calcul the mask position with numpy : 0.057889699935913086 nb_pixel_total : 19270 time to create 1 rle with old method : 0.026018619537353516 length of segment : 331 time for calcul the mask position with numpy : 0.022090673446655273 nb_pixel_total : 735479 time to create 1 rle with new method : 0.06706428527832031 length of segment : 907 time for calcul the mask position with numpy : 0.43878841400146484 nb_pixel_total : 230739 time to create 1 rle with new method : 0.013190746307373047 length of segment : 440 time for calcul the mask position with numpy : 0.0005233287811279297 nb_pixel_total : 16692 time to create 1 rle with old method : 0.02030205726623535 length of segment : 252 time for calcul the mask position with numpy : 0.16074538230895996 nb_pixel_total : 43241 time to create 1 rle with old method : 0.052257537841796875 length of segment : 287 time for calcul the mask position with numpy : 0.11397075653076172 nb_pixel_total : 6873 time to create 1 rle with old method : 0.01391291618347168 length of segment : 124 time for calcul the mask position with numpy : 1.5869591236114502 nb_pixel_total : 413050 time to create 1 rle with new method : 0.053442955017089844 length of segment : 1057 time for calcul the mask position with numpy : 0.06369662284851074 nb_pixel_total : 3272 time to create 1 rle with old method : 0.007081270217895508 length of segment : 78 time for calcul the mask position with numpy : 0.01872396469116211 nb_pixel_total : 268876 time to create 1 rle with new method : 0.015092611312866211 length of segment : 439 time for calcul the mask position with numpy : 0.11638188362121582 nb_pixel_total : 26700 time to create 1 rle with old method : 0.03739595413208008 length of segment : 208 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 13893 time to create 1 rle with old method : 0.017756938934326172 length of segment : 154 time for calcul the mask position with numpy : 0.008628368377685547 nb_pixel_total : 149284 time to create 1 rle with old method : 0.17302179336547852 length of segment : 392 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 2462 time to create 1 rle with old method : 0.003123044967651367 length of segment : 69 time for calcul the mask position with numpy : 0.0010721683502197266 nb_pixel_total : 64822 time to create 1 rle with old method : 0.07723498344421387 length of segment : 206 time for calcul the mask position with numpy : 0.027268409729003906 nb_pixel_total : 24462 time to create 1 rle with old method : 0.03616619110107422 length of segment : 218 time for calcul the mask position with numpy : 0.013728857040405273 nb_pixel_total : 13463 time to create 1 rle with old method : 0.019765138626098633 length of segment : 117 time for calcul the mask position with numpy : 0.38776397705078125 nb_pixel_total : 26805 time to create 1 rle with old method : 0.034215450286865234 length of segment : 244 time for calcul the mask position with numpy : 0.6593022346496582 nb_pixel_total : 37084 time to create 1 rle with old method : 0.04575753211975098 length of segment : 254 time for calcul the mask position with numpy : 0.502403736114502 nb_pixel_total : 25774 time to create 1 rle with old method : 0.03431367874145508 length of segment : 196 time for calcul the mask position with numpy : 0.5562927722930908 nb_pixel_total : 31865 time to create 1 rle with old method : 0.04127979278564453 length of segment : 368 time for calcul the mask position with numpy : 0.6926414966583252 nb_pixel_total : 34463 time to create 1 rle with old method : 0.04720497131347656 length of segment : 415 time for calcul the mask position with numpy : 0.010644674301147461 nb_pixel_total : 4437 time to create 1 rle with old method : 0.009964704513549805 length of segment : 56 time for calcul the mask position with numpy : 0.29152488708496094 nb_pixel_total : 25330 time to create 1 rle with old method : 0.03244972229003906 length of segment : 230 time for calcul the mask position with numpy : 0.2498304843902588 nb_pixel_total : 22118 time to create 1 rle with old method : 0.03241276741027832 length of segment : 151 time for calcul the mask position with numpy : 0.16066336631774902 nb_pixel_total : 19178 time to create 1 rle with old method : 0.028066158294677734 length of segment : 179 time for calcul the mask position with numpy : 0.04537796974182129 nb_pixel_total : 4629 time to create 1 rle with old method : 0.008831262588500977 length of segment : 79 time for calcul the mask position with numpy : 1.1288866996765137 nb_pixel_total : 141427 time to create 1 rle with old method : 0.18526649475097656 length of segment : 451 time for calcul the mask position with numpy : 0.3609459400177002 nb_pixel_total : 59314 time to create 1 rle with old method : 0.07089042663574219 length of segment : 203 time for calcul the mask position with numpy : 0.6007232666015625 nb_pixel_total : 97873 time to create 1 rle with old method : 0.1165611743927002 length of segment : 612 time for calcul the mask position with numpy : 0.023217201232910156 nb_pixel_total : 33828 time to create 1 rle with old method : 0.04522109031677246 length of segment : 426 time for calcul the mask position with numpy : 0.04696393013000488 nb_pixel_total : 23682 time to create 1 rle with old method : 0.028003215789794922 length of segment : 299 time for calcul the mask position with numpy : 0.032570600509643555 nb_pixel_total : 29673 time to create 1 rle with old method : 0.03820514678955078 length of segment : 181 time for calcul the mask position with numpy : 0.024762630462646484 nb_pixel_total : 34401 time to create 1 rle with old method : 0.04200911521911621 length of segment : 292 time for calcul the mask position with numpy : 0.029633283615112305 nb_pixel_total : 62208 time to create 1 rle with old method : 0.07530999183654785 length of segment : 303 time for calcul the mask position with numpy : 0.016814708709716797 nb_pixel_total : 13765 time to create 1 rle with old method : 0.021787405014038086 length of segment : 137 time for calcul the mask position with numpy : 0.0372312068939209 nb_pixel_total : 27128 time to create 1 rle with old method : 0.03493165969848633 length of segment : 238 time for calcul the mask position with numpy : 0.08501672744750977 nb_pixel_total : 39015 time to create 1 rle with old method : 0.047126054763793945 length of segment : 218 time for calcul the mask position with numpy : 0.02105259895324707 nb_pixel_total : 15239 time to create 1 rle with old method : 0.020864009857177734 length of segment : 140 time for calcul the mask position with numpy : 0.00811004638671875 nb_pixel_total : 22041 time to create 1 rle with old method : 0.02811145782470703 length of segment : 212 time for calcul the mask position with numpy : 0.03510284423828125 nb_pixel_total : 25880 time to create 1 rle with old method : 0.032227277755737305 length of segment : 219 time for calcul the mask position with numpy : 0.05917668342590332 nb_pixel_total : 28279 time to create 1 rle with old method : 0.03959774971008301 length of segment : 311 time for calcul the mask position with numpy : 0.002584218978881836 nb_pixel_total : 9955 time to create 1 rle with old method : 0.01636791229248047 length of segment : 170 time for calcul the mask position with numpy : 0.007173061370849609 nb_pixel_total : 6249 time to create 1 rle with old method : 0.009621620178222656 length of segment : 184 time for calcul the mask position with numpy : 0.047545433044433594 nb_pixel_total : 30676 time to create 1 rle with old method : 0.04019904136657715 length of segment : 202 time for calcul the mask position with numpy : 0.4589250087738037 nb_pixel_total : 366192 time to create 1 rle with new method : 0.03645610809326172 length of segment : 644 time for calcul the mask position with numpy : 0.0008676052093505859 nb_pixel_total : 3498 time to create 1 rle with old method : 0.0041730403900146484 length of segment : 60 time for calcul the mask position with numpy : 0.3603861331939697 nb_pixel_total : 292076 time to create 1 rle with new method : 0.028538227081298828 length of segment : 765 time for calcul the mask position with numpy : 0.023784637451171875 nb_pixel_total : 26771 time to create 1 rle with old method : 0.036540985107421875 length of segment : 208 time for calcul the mask position with numpy : 0.003813028335571289 nb_pixel_total : 9879 time to create 1 rle with old method : 0.012777090072631836 length of segment : 132 time for calcul the mask position with numpy : 0.0047571659088134766 nb_pixel_total : 12394 time to create 1 rle with old method : 0.016920804977416992 length of segment : 126 time for calcul the mask position with numpy : 0.013631820678710938 nb_pixel_total : 9192 time to create 1 rle with old method : 0.0162503719329834 length of segment : 139 time for calcul the mask position with numpy : 0.19402194023132324 nb_pixel_total : 125325 time to create 1 rle with old method : 0.15674114227294922 length of segment : 622 time for calcul the mask position with numpy : 0.0077588558197021484 nb_pixel_total : 5548 time to create 1 rle with old method : 0.010847806930541992 length of segment : 67 time for calcul the mask position with numpy : 0.029604434967041016 nb_pixel_total : 36602 time to create 1 rle with old method : 0.047920942306518555 length of segment : 229 time for calcul the mask position with numpy : 0.00740814208984375 nb_pixel_total : 5480 time to create 1 rle with old method : 0.0074253082275390625 length of segment : 66 time for calcul the mask position with numpy : 0.05934429168701172 nb_pixel_total : 46423 time to create 1 rle with old method : 0.06009054183959961 length of segment : 264 time for calcul the mask position with numpy : 0.06858587265014648 nb_pixel_total : 32113 time to create 1 rle with old method : 0.0430300235748291 length of segment : 276 time for calcul the mask position with numpy : 0.08098530769348145 nb_pixel_total : 81275 time to create 1 rle with old method : 0.09218573570251465 length of segment : 389 time for calcul the mask position with numpy : 0.08457589149475098 nb_pixel_total : 107059 time to create 1 rle with old method : 0.12268567085266113 length of segment : 218 time for calcul the mask position with numpy : 0.003427267074584961 nb_pixel_total : 18360 time to create 1 rle with old method : 0.021375656127929688 length of segment : 243 time for calcul the mask position with numpy : 0.14152789115905762 nb_pixel_total : 122297 time to create 1 rle with old method : 0.13759756088256836 length of segment : 432 time for calcul the mask position with numpy : 0.01414036750793457 nb_pixel_total : 43127 time to create 1 rle with old method : 0.05162191390991211 length of segment : 343 time for calcul the mask position with numpy : 0.0020322799682617188 nb_pixel_total : 30056 time to create 1 rle with old method : 0.03696179389953613 length of segment : 295 time for calcul the mask position with numpy : 0.0015549659729003906 nb_pixel_total : 44125 time to create 1 rle with old method : 0.054759979248046875 length of segment : 226 time for calcul the mask position with numpy : 0.002429485321044922 nb_pixel_total : 52095 time to create 1 rle with old method : 0.06084775924682617 length of segment : 166 time for calcul the mask position with numpy : 0.2617335319519043 nb_pixel_total : 149193 time to create 1 rle with old method : 0.16823244094848633 length of segment : 632 time for calcul the mask position with numpy : 0.001451730728149414 nb_pixel_total : 5090 time to create 1 rle with old method : 0.005795001983642578 length of segment : 107 time for calcul the mask position with numpy : 0.027823686599731445 nb_pixel_total : 34540 time to create 1 rle with old method : 0.04121804237365723 length of segment : 169 time for calcul the mask position with numpy : 0.048661231994628906 nb_pixel_total : 33416 time to create 1 rle with old method : 0.03924965858459473 length of segment : 275 time for calcul the mask position with numpy : 0.0005769729614257812 nb_pixel_total : 9953 time to create 1 rle with old method : 0.01166844367980957 length of segment : 88 time for calcul the mask position with numpy : 0.023676395416259766 nb_pixel_total : 169915 time to create 1 rle with new method : 0.010916709899902344 length of segment : 485 time for calcul the mask position with numpy : 0.0002884864807128906 nb_pixel_total : 3407 time to create 1 rle with old method : 0.00404810905456543 length of segment : 77 time for calcul the mask position with numpy : 0.006693363189697266 nb_pixel_total : 17861 time to create 1 rle with old method : 0.022699832916259766 length of segment : 237 time for calcul the mask position with numpy : 0.005079984664916992 nb_pixel_total : 6741 time to create 1 rle with old method : 0.008556127548217773 length of segment : 95 time for calcul the mask position with numpy : 0.0006072521209716797 nb_pixel_total : 11315 time to create 1 rle with old method : 0.012951850891113281 length of segment : 128 time for calcul the mask position with numpy : 0.005738973617553711 nb_pixel_total : 13563 time to create 1 rle with old method : 0.01819634437561035 length of segment : 218 time for calcul the mask position with numpy : 0.0037949085235595703 nb_pixel_total : 22919 time to create 1 rle with old method : 0.028430938720703125 length of segment : 192 time for calcul the mask position with numpy : 0.006805419921875 nb_pixel_total : 81111 time to create 1 rle with old method : 0.10094475746154785 length of segment : 525 time for calcul the mask position with numpy : 0.05405402183532715 nb_pixel_total : 20322 time to create 1 rle with old method : 0.02481222152709961 length of segment : 212 time for calcul the mask position with numpy : 0.19879937171936035 nb_pixel_total : 124024 time to create 1 rle with old method : 0.13180112838745117 length of segment : 539 time for calcul the mask position with numpy : 0.008075237274169922 nb_pixel_total : 38239 time to create 1 rle with old method : 0.043447256088256836 length of segment : 193 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 9389 time to create 1 rle with old method : 0.010225534439086914 length of segment : 180 time for calcul the mask position with numpy : 0.013722658157348633 nb_pixel_total : 78210 time to create 1 rle with old method : 0.08816766738891602 length of segment : 326 time for calcul the mask position with numpy : 0.003016233444213867 nb_pixel_total : 21685 time to create 1 rle with old method : 0.02440476417541504 length of segment : 173 time for calcul the mask position with numpy : 0.1303708553314209 nb_pixel_total : 126002 time to create 1 rle with old method : 0.13891053199768066 length of segment : 700 time for calcul the mask position with numpy : 0.002592325210571289 nb_pixel_total : 47423 time to create 1 rle with old method : 0.05341625213623047 length of segment : 291 time for calcul the mask position with numpy : 0.03157162666320801 nb_pixel_total : 63404 time to create 1 rle with old method : 0.07672286033630371 length of segment : 416 time for calcul the mask position with numpy : 0.0006215572357177734 nb_pixel_total : 14598 time to create 1 rle with old method : 0.016765832901000977 length of segment : 164 time for calcul the mask position with numpy : 0.25791382789611816 nb_pixel_total : 230182 time to create 1 rle with new method : 0.012851476669311523 length of segment : 782 time for calcul the mask position with numpy : 0.003785848617553711 nb_pixel_total : 75632 time to create 1 rle with old method : 0.08488821983337402 length of segment : 252 time for calcul the mask position with numpy : 0.00092315673828125 nb_pixel_total : 23645 time to create 1 rle with old method : 0.026975631713867188 length of segment : 189 time for calcul the mask position with numpy : 0.0017762184143066406 nb_pixel_total : 11382 time to create 1 rle with old method : 0.012970447540283203 length of segment : 143 time for calcul the mask position with numpy : 0.013752937316894531 nb_pixel_total : 27590 time to create 1 rle with old method : 0.036345481872558594 length of segment : 174 time for calcul the mask position with numpy : 0.08223319053649902 nb_pixel_total : 78253 time to create 1 rle with old method : 0.08965563774108887 length of segment : 515 time for calcul the mask position with numpy : 0.0004677772521972656 nb_pixel_total : 12977 time to create 1 rle with old method : 0.015144824981689453 length of segment : 218 time for calcul the mask position with numpy : 0.00047087669372558594 nb_pixel_total : 10157 time to create 1 rle with old method : 0.011456012725830078 length of segment : 109 time for calcul the mask position with numpy : 0.0007114410400390625 nb_pixel_total : 11620 time to create 1 rle with old method : 0.014014244079589844 length of segment : 126 time for calcul the mask position with numpy : 0.005681276321411133 nb_pixel_total : 178176 time to create 1 rle with new method : 0.006088733673095703 length of segment : 366 time for calcul the mask position with numpy : 0.0009291172027587891 nb_pixel_total : 12170 time to create 1 rle with old method : 0.013217687606811523 length of segment : 127 time for calcul the mask position with numpy : 0.07769203186035156 nb_pixel_total : 60330 time to create 1 rle with old method : 0.07048320770263672 length of segment : 278 time for calcul the mask position with numpy : 0.0007319450378417969 nb_pixel_total : 14377 time to create 1 rle with old method : 0.01639556884765625 length of segment : 142 time for calcul the mask position with numpy : 0.15260100364685059 nb_pixel_total : 123008 time to create 1 rle with old method : 0.1397240161895752 length of segment : 667 time for calcul the mask position with numpy : 0.002751588821411133 nb_pixel_total : 13589 time to create 1 rle with old method : 0.01715087890625 length of segment : 118 time for calcul the mask position with numpy : 0.0005025863647460938 nb_pixel_total : 16210 time to create 1 rle with old method : 0.019001483917236328 length of segment : 160 time for calcul the mask position with numpy : 0.020743608474731445 nb_pixel_total : 32506 time to create 1 rle with old method : 0.038202524185180664 length of segment : 176 time for calcul the mask position with numpy : 0.00030112266540527344 nb_pixel_total : 4729 time to create 1 rle with old method : 0.005879878997802734 length of segment : 66 time for calcul the mask position with numpy : 0.04455709457397461 nb_pixel_total : 52136 time to create 1 rle with old method : 0.05993771553039551 length of segment : 406 time for calcul the mask position with numpy : 0.001810312271118164 nb_pixel_total : 36169 time to create 1 rle with old method : 0.04011058807373047 length of segment : 251 time for calcul the mask position with numpy : 0.0010347366333007812 nb_pixel_total : 15268 time to create 1 rle with old method : 0.018000364303588867 length of segment : 275 time for calcul the mask position with numpy : 0.0003991127014160156 nb_pixel_total : 7435 time to create 1 rle with old method : 0.008373498916625977 length of segment : 94 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 5364 time to create 1 rle with old method : 0.006551504135131836 length of segment : 99 time for calcul the mask position with numpy : 0.0017893314361572266 nb_pixel_total : 15911 time to create 1 rle with old method : 0.018079757690429688 length of segment : 210 time for calcul the mask position with numpy : 0.011557579040527344 nb_pixel_total : 27889 time to create 1 rle with old method : 0.03502845764160156 length of segment : 283 time for calcul the mask position with numpy : 0.24884533882141113 nb_pixel_total : 426087 time to create 1 rle with new method : 0.04358363151550293 length of segment : 1301 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 4589 time to create 1 rle with old method : 0.005367755889892578 length of segment : 123 time for calcul the mask position with numpy : 0.0017161369323730469 nb_pixel_total : 27717 time to create 1 rle with old method : 0.03185534477233887 length of segment : 253 time for calcul the mask position with numpy : 0.0015349388122558594 nb_pixel_total : 13388 time to create 1 rle with old method : 0.014856338500976562 length of segment : 115 time for calcul the mask position with numpy : 0.0010330677032470703 nb_pixel_total : 27719 time to create 1 rle with old method : 0.03233909606933594 length of segment : 201 time for calcul the mask position with numpy : 0.0007216930389404297 nb_pixel_total : 16587 time to create 1 rle with old method : 0.017972946166992188 length of segment : 242 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 4424 time to create 1 rle with old method : 0.0054399967193603516 length of segment : 69 time for calcul the mask position with numpy : 0.0007495880126953125 nb_pixel_total : 16239 time to create 1 rle with old method : 0.018527507781982422 length of segment : 183 time for calcul the mask position with numpy : 0.0009853839874267578 nb_pixel_total : 28271 time to create 1 rle with old method : 0.03079962730407715 length of segment : 198 time for calcul the mask position with numpy : 0.00029397010803222656 nb_pixel_total : 9818 time to create 1 rle with old method : 0.011709928512573242 length of segment : 83 time for calcul the mask position with numpy : 0.002682924270629883 nb_pixel_total : 74171 time to create 1 rle with old method : 0.08712291717529297 length of segment : 323 time for calcul the mask position with numpy : 0.0008366107940673828 nb_pixel_total : 24536 time to create 1 rle with old method : 0.028333425521850586 length of segment : 299 time for calcul the mask position with numpy : 0.0016875267028808594 nb_pixel_total : 81999 time to create 1 rle with old method : 0.0947573184967041 length of segment : 437 time for calcul the mask position with numpy : 0.002483844757080078 nb_pixel_total : 72486 time to create 1 rle with old method : 0.0773477554321289 length of segment : 475 time for calcul the mask position with numpy : 0.0008490085601806641 nb_pixel_total : 43734 time to create 1 rle with old method : 0.0480959415435791 length of segment : 293 time for calcul the mask position with numpy : 0.0008611679077148438 nb_pixel_total : 37684 time to create 1 rle with old method : 0.04070878028869629 length of segment : 219 time for calcul the mask position with numpy : 0.0004191398620605469 nb_pixel_total : 12947 time to create 1 rle with old method : 0.014913320541381836 length of segment : 161 time for calcul the mask position with numpy : 0.0011630058288574219 nb_pixel_total : 43444 time to create 1 rle with old method : 0.04886221885681152 length of segment : 365 time for calcul the mask position with numpy : 0.002432584762573242 nb_pixel_total : 99422 time to create 1 rle with old method : 0.10883831977844238 length of segment : 661 time for calcul the mask position with numpy : 0.001058340072631836 nb_pixel_total : 45519 time to create 1 rle with old method : 0.05077171325683594 length of segment : 241 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 13792 time to create 1 rle with old method : 0.015021562576293945 length of segment : 129 time for calcul the mask position with numpy : 0.0007333755493164062 nb_pixel_total : 43450 time to create 1 rle with old method : 0.045609235763549805 length of segment : 339 time for calcul the mask position with numpy : 0.0005602836608886719 nb_pixel_total : 19942 time to create 1 rle with old method : 0.024583816528320312 length of segment : 105 time for calcul the mask position with numpy : 0.00037479400634765625 nb_pixel_total : 10785 time to create 1 rle with old method : 0.012488842010498047 length of segment : 157 time for calcul the mask position with numpy : 0.0016198158264160156 nb_pixel_total : 65745 time to create 1 rle with old method : 0.07234835624694824 length of segment : 273 time for calcul the mask position with numpy : 0.005274295806884766 nb_pixel_total : 163954 time to create 1 rle with new method : 0.014090776443481445 length of segment : 618 time for calcul the mask position with numpy : 0.0026521682739257812 nb_pixel_total : 119482 time to create 1 rle with old method : 0.13282275199890137 length of segment : 670 time for calcul the mask position with numpy : 0.0012769699096679688 nb_pixel_total : 39011 time to create 1 rle with old method : 0.042081356048583984 length of segment : 926 time for calcul the mask position with numpy : 0.002028942108154297 nb_pixel_total : 104443 time to create 1 rle with old method : 0.11548900604248047 length of segment : 684 time for calcul the mask position with numpy : 0.0011315345764160156 nb_pixel_total : 43844 time to create 1 rle with old method : 0.05166459083557129 length of segment : 449 time for calcul the mask position with numpy : 0.0024366378784179688 nb_pixel_total : 116550 time to create 1 rle with old method : 0.12809443473815918 length of segment : 651 time for calcul the mask position with numpy : 0.0004563331604003906 nb_pixel_total : 23140 time to create 1 rle with old method : 0.027435302734375 length of segment : 183 time for calcul the mask position with numpy : 0.0007317066192626953 nb_pixel_total : 39120 time to create 1 rle with old method : 0.04414653778076172 length of segment : 435 time for calcul the mask position with numpy : 0.00044846534729003906 nb_pixel_total : 8517 time to create 1 rle with old method : 0.009926080703735352 length of segment : 199 time spent for convertir_results : 37.77554965019226 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 199 chid ids of type : 3594 Number RLEs to save : 62830 save missing photos in datou_result : time spend for datou_step_exec : 111.26253962516785 time spend to save output : 4.013627290725708 total time spend for step 1 : 115.27616691589355 step2:crop_condition Mon Mar 17 22:22:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 199 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 119 About to insert : list_path_to_insert length 119 new photo from crops ! About to upload 119 photos upload in portfolio : 3736932 init cache_photo without model_param we have 119 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742246581_857173 we have uploaded 119 photos in the portfolio 3736932 time of upload the photos Elapsed time : 29.299792051315308 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 3736932 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742246631_857173 we have uploaded 48 photos in the portfolio 3736932 time of upload the photos Elapsed time : 17.017138719558716 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742246650_857173 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.4681508541107178 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742246662_857173 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.459211587905884 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742246672_857173 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9658198356628418 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742246675_857173 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5994448661804199 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742246677_857173 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6180534362792969 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1344993735, 1344993422, 1344993388, 1344993359, 1344993228, 1344993097, 1344993022, 1344992091] Looping around the photos to save general results len do output : 199 /1345003730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345003875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1345004604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993735', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993422', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993388', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993359', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993228', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993097', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993022', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344992091', None, None, None, None, None, '2675593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 605 time used for this insertion : 0.034407615661621094 save_final save missing photos in datou_result : time spend for datou_step_exec : 131.44537496566772 time spend to save output : 0.03883528709411621 total time spend for step 2 : 131.48421025276184 step3:rle_unique_nms_with_priority Mon Mar 17 22:24:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 199 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.076610565185547 time for calcul the mask position with numpy : 0.46001219749450684 nb_pixel_total : 6170405 time to create 1 rle with new method : 0.8593273162841797 time for calcul the mask position with numpy : 0.023034334182739258 nb_pixel_total : 241326 time to create 1 rle with new method : 0.5263082981109619 time for calcul the mask position with numpy : 0.019830703735351562 nb_pixel_total : 5543 time to create 1 rle with old method : 0.005915403366088867 time for calcul the mask position with numpy : 0.020015239715576172 nb_pixel_total : 15127 time to create 1 rle with old method : 0.01573657989501953 time for calcul the mask position with numpy : 0.020969867706298828 nb_pixel_total : 15275 time to create 1 rle with old method : 0.016714096069335938 time for calcul the mask position with numpy : 0.023842334747314453 nb_pixel_total : 354667 time to create 1 rle with new method : 0.5655794143676758 time for calcul the mask position with numpy : 0.021683931350708008 nb_pixel_total : 135391 time to create 1 rle with old method : 0.14919447898864746 time for calcul the mask position with numpy : 0.021537303924560547 nb_pixel_total : 98108 time to create 1 rle with old method : 0.10659050941467285 time for calcul the mask position with numpy : 0.03261137008666992 nb_pixel_total : 14398 time to create 1 rle with old method : 0.015932798385620117 create new chi : 2.97701096534729 time to delete rle : 0.013544321060180664 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6620 TO DO : save crop sub photo not yet done ! save time : 0.4226202964782715 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 5.026186466217041 time for calcul the mask position with numpy : 0.5292103290557861 nb_pixel_total : 6271206 time to create 1 rle with new method : 0.38242316246032715 time for calcul the mask position with numpy : 0.033487558364868164 nb_pixel_total : 13820 time to create 1 rle with old method : 0.015290498733520508 time for calcul the mask position with numpy : 0.032866716384887695 nb_pixel_total : 20990 time to create 1 rle with old method : 0.026917219161987305 time for calcul the mask position with numpy : 0.025449752807617188 nb_pixel_total : 380943 time to create 1 rle with new method : 0.5003540515899658 time for calcul the mask position with numpy : 0.021449565887451172 nb_pixel_total : 12491 time to create 1 rle with old method : 0.01372671127319336 time for calcul the mask position with numpy : 0.021275758743286133 nb_pixel_total : 6306 time to create 1 rle with old method : 0.006868600845336914 time for calcul the mask position with numpy : 0.020437955856323242 nb_pixel_total : 20279 time to create 1 rle with old method : 0.02245497703552246 time for calcul the mask position with numpy : 0.02096271514892578 nb_pixel_total : 10542 time to create 1 rle with old method : 0.011807918548583984 time for calcul the mask position with numpy : 0.021411895751953125 nb_pixel_total : 7463 time to create 1 rle with old method : 0.00867152214050293 time for calcul the mask position with numpy : 0.021676301956176758 nb_pixel_total : 105500 time to create 1 rle with old method : 0.1151423454284668 time for calcul the mask position with numpy : 0.02086806297302246 nb_pixel_total : 18588 time to create 1 rle with old method : 0.02023172378540039 time for calcul the mask position with numpy : 0.021489620208740234 nb_pixel_total : 11484 time to create 1 rle with old method : 0.012720584869384766 time for calcul the mask position with numpy : 0.02181077003479004 nb_pixel_total : 95116 time to create 1 rle with old method : 0.10233736038208008 time for calcul the mask position with numpy : 0.021201610565185547 nb_pixel_total : 40154 time to create 1 rle with old method : 0.04317641258239746 time for calcul the mask position with numpy : 0.021342992782592773 nb_pixel_total : 35358 time to create 1 rle with old method : 0.03817892074584961 create new chi : 2.2366836071014404 time to delete rle : 0.0013275146484375 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9308 TO DO : save crop sub photo not yet done ! save time : 0.8825123310089111 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 5.985965728759766 time for calcul the mask position with numpy : 0.40141940116882324 nb_pixel_total : 5037347 time to create 1 rle with new method : 0.733952522277832 time for calcul the mask position with numpy : 0.021526575088500977 nb_pixel_total : 105124 time to create 1 rle with old method : 0.11136412620544434 time for calcul the mask position with numpy : 0.02158832550048828 nb_pixel_total : 75278 time to create 1 rle with old method : 0.0802459716796875 time for calcul the mask position with numpy : 0.02021932601928711 nb_pixel_total : 31710 time to create 1 rle with old method : 0.03367948532104492 time for calcul the mask position with numpy : 0.02081751823425293 nb_pixel_total : 8038 time to create 1 rle with old method : 0.009063243865966797 time for calcul the mask position with numpy : 0.021926403045654297 nb_pixel_total : 41841 time to create 1 rle with old method : 0.04602551460266113 time for calcul the mask position with numpy : 0.024253129959106445 nb_pixel_total : 98405 time to create 1 rle with old method : 0.12177348136901855 time for calcul the mask position with numpy : 0.03197646141052246 nb_pixel_total : 140385 time to create 1 rle with old method : 0.16160249710083008 time for calcul the mask position with numpy : 0.022928714752197266 nb_pixel_total : 58680 time to create 1 rle with old method : 0.06369137763977051 time for calcul the mask position with numpy : 0.022228479385375977 nb_pixel_total : 16989 time to create 1 rle with old method : 0.018793344497680664 time for calcul the mask position with numpy : 0.022870779037475586 nb_pixel_total : 32567 time to create 1 rle with old method : 0.03602170944213867 time for calcul the mask position with numpy : 0.02303338050842285 nb_pixel_total : 27985 time to create 1 rle with old method : 0.03158974647521973 time for calcul the mask position with numpy : 0.023553848266601562 nb_pixel_total : 97755 time to create 1 rle with old method : 0.10762619972229004 time for calcul the mask position with numpy : 0.029813051223754883 nb_pixel_total : 648068 time to create 1 rle with new method : 0.6287801265716553 time for calcul the mask position with numpy : 0.02263641357421875 nb_pixel_total : 98596 time to create 1 rle with old method : 0.10614871978759766 time for calcul the mask position with numpy : 0.021752357482910156 nb_pixel_total : 122037 time to create 1 rle with old method : 0.1341838836669922 time for calcul the mask position with numpy : 0.02147960662841797 nb_pixel_total : 151148 time to create 1 rle with new method : 0.6422274112701416 time for calcul the mask position with numpy : 0.019800901412963867 nb_pixel_total : 56119 time to create 1 rle with old method : 0.05911397933959961 time for calcul the mask position with numpy : 0.021413326263427734 nb_pixel_total : 202168 time to create 1 rle with new method : 0.42722415924072266 create new chi : 4.468887090682983 time to delete rle : 0.002380847930908203 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 15975 TO DO : save crop sub photo not yet done ! save time : 0.938774824142456 nb_obj : 27 nb_hashtags : 5 time to prepare the origin masks : 4.888405084609985 time for calcul the mask position with numpy : 0.5170316696166992 nb_pixel_total : 3807681 time to create 1 rle with new method : 0.7493190765380859 time for calcul the mask position with numpy : 0.030173778533935547 nb_pixel_total : 54149 time to create 1 rle with old method : 0.06425261497497559 time for calcul the mask position with numpy : 0.029056787490844727 nb_pixel_total : 11904 time to create 1 rle with old method : 0.014565229415893555 time for calcul the mask position with numpy : 0.03664970397949219 nb_pixel_total : 743700 time to create 1 rle with new method : 0.639080286026001 time for calcul the mask position with numpy : 0.029883384704589844 nb_pixel_total : 297543 time to create 1 rle with new method : 0.6676914691925049 time for calcul the mask position with numpy : 0.027875185012817383 nb_pixel_total : 8875 time to create 1 rle with old method : 0.00967860221862793 time for calcul the mask position with numpy : 0.028246164321899414 nb_pixel_total : 122739 time to create 1 rle with old method : 0.12950778007507324 time for calcul the mask position with numpy : 0.02713298797607422 nb_pixel_total : 6171 time to create 1 rle with old method : 0.0064928531646728516 time for calcul the mask position with numpy : 0.029682636260986328 nb_pixel_total : 392411 time to create 1 rle with new method : 0.6252868175506592 time for calcul the mask position with numpy : 0.027735233306884766 nb_pixel_total : 35371 time to create 1 rle with old method : 0.038143157958984375 time for calcul the mask position with numpy : 0.028380870819091797 nb_pixel_total : 12864 time to create 1 rle with old method : 0.014199018478393555 time for calcul the mask position with numpy : 0.026623010635375977 nb_pixel_total : 3272 time to create 1 rle with old method : 0.003626585006713867 time for calcul the mask position with numpy : 0.027124881744384766 nb_pixel_total : 26700 time to create 1 rle with old method : 0.02796006202697754 time for calcul the mask position with numpy : 0.027756690979003906 nb_pixel_total : 76365 time to create 1 rle with old method : 0.07999587059020996 time for calcul the mask position with numpy : 0.028037548065185547 nb_pixel_total : 139562 time to create 1 rle with old method : 0.1472623348236084 time for calcul the mask position with numpy : 0.028471708297729492 nb_pixel_total : 100405 time to create 1 rle with old method : 0.10490560531616211 time for calcul the mask position with numpy : 0.029010772705078125 nb_pixel_total : 269719 time to create 1 rle with new method : 0.5297541618347168 time for calcul the mask position with numpy : 0.03209519386291504 nb_pixel_total : 11330 time to create 1 rle with old method : 0.013603687286376953 time for calcul the mask position with numpy : 0.030736446380615234 nb_pixel_total : 412923 time to create 1 rle with new method : 0.43373703956604004 time for calcul the mask position with numpy : 0.02999711036682129 nb_pixel_total : 230739 time to create 1 rle with new method : 0.4528825283050537 time for calcul the mask position with numpy : 0.029336214065551758 nb_pixel_total : 92283 time to create 1 rle with old method : 0.10545778274536133 time for calcul the mask position with numpy : 0.028600454330444336 nb_pixel_total : 19270 time to create 1 rle with old method : 0.02249598503112793 time for calcul the mask position with numpy : 0.028542041778564453 nb_pixel_total : 7584 time to create 1 rle with old method : 0.008712053298950195 time for calcul the mask position with numpy : 0.028635501861572266 nb_pixel_total : 42863 time to create 1 rle with old method : 0.04781460762023926 time for calcul the mask position with numpy : 0.028464317321777344 nb_pixel_total : 49660 time to create 1 rle with old method : 0.05532431602478027 time for calcul the mask position with numpy : 0.028521299362182617 nb_pixel_total : 64822 time to create 1 rle with old method : 0.07245612144470215 time for calcul the mask position with numpy : 0.028446435928344727 nb_pixel_total : 6873 time to create 1 rle with old method : 0.007809877395629883 time for calcul the mask position with numpy : 0.028394222259521484 nb_pixel_total : 2462 time to create 1 rle with old method : 0.0027756690979003906 create new chi : 6.54328989982605 time to delete rle : 0.003331422805786133 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 24255 TO DO : save crop sub photo not yet done ! save time : 1.619652271270752 nb_obj : 40 nb_hashtags : 6 time to prepare the origin masks : 4.097996711730957 time for calcul the mask position with numpy : 0.5244183540344238 nb_pixel_total : 5215208 time to create 1 rle with new method : 0.8622183799743652 time for calcul the mask position with numpy : 0.028151512145996094 nb_pixel_total : 4437 time to create 1 rle with old method : 0.004992961883544922 time for calcul the mask position with numpy : 0.027814626693725586 nb_pixel_total : 13463 time to create 1 rle with old method : 0.015630006790161133 time for calcul the mask position with numpy : 0.028326749801635742 nb_pixel_total : 34401 time to create 1 rle with old method : 0.05627012252807617 time for calcul the mask position with numpy : 0.03233456611633301 nb_pixel_total : 9879 time to create 1 rle with old method : 0.011229991912841797 time for calcul the mask position with numpy : 0.027719497680664062 nb_pixel_total : 3498 time to create 1 rle with old method : 0.003981113433837891 time for calcul the mask position with numpy : 0.027580976486206055 nb_pixel_total : 9955 time to create 1 rle with old method : 0.011275291442871094 time for calcul the mask position with numpy : 0.0283048152923584 nb_pixel_total : 13765 time to create 1 rle with old method : 0.01565694808959961 time for calcul the mask position with numpy : 0.02850627899169922 nb_pixel_total : 18499 time to create 1 rle with old method : 0.030179977416992188 time for calcul the mask position with numpy : 0.03278851509094238 nb_pixel_total : 6249 time to create 1 rle with old method : 0.010267972946166992 time for calcul the mask position with numpy : 0.029623985290527344 nb_pixel_total : 31865 time to create 1 rle with old method : 0.038172006607055664 time for calcul the mask position with numpy : 0.02886033058166504 nb_pixel_total : 125325 time to create 1 rle with old method : 0.1371016502380371 time for calcul the mask position with numpy : 0.029786348342895508 nb_pixel_total : 366192 time to create 1 rle with new method : 0.6479451656341553 time for calcul the mask position with numpy : 0.03005242347717285 nb_pixel_total : 292076 time to create 1 rle with new method : 0.9328725337982178 time for calcul the mask position with numpy : 0.03892183303833008 nb_pixel_total : 26771 time to create 1 rle with old method : 0.054804325103759766 time for calcul the mask position with numpy : 0.03741312026977539 nb_pixel_total : 26805 time to create 1 rle with old method : 0.04855775833129883 time for calcul the mask position with numpy : 0.03845381736755371 nb_pixel_total : 25774 time to create 1 rle with old method : 0.04751229286193848 time for calcul the mask position with numpy : 0.037850379943847656 nb_pixel_total : 25330 time to create 1 rle with old method : 0.04630613327026367 time for calcul the mask position with numpy : 0.03639101982116699 nb_pixel_total : 9192 time to create 1 rle with old method : 0.016875267028808594 time for calcul the mask position with numpy : 0.03668642044067383 nb_pixel_total : 29673 time to create 1 rle with old method : 0.05324745178222656 time for calcul the mask position with numpy : 0.03713250160217285 nb_pixel_total : 22118 time to create 1 rle with old method : 0.025664091110229492 time for calcul the mask position with numpy : 0.029330015182495117 nb_pixel_total : 15239 time to create 1 rle with old method : 0.01728200912475586 time for calcul the mask position with numpy : 0.0289609432220459 nb_pixel_total : 59314 time to create 1 rle with old method : 0.06682205200195312 time for calcul the mask position with numpy : 0.029250621795654297 nb_pixel_total : 27128 time to create 1 rle with old method : 0.03048849105834961 time for calcul the mask position with numpy : 0.029657840728759766 nb_pixel_total : 141427 time to create 1 rle with old method : 0.15958642959594727 time for calcul the mask position with numpy : 0.02840447425842285 nb_pixel_total : 25880 time to create 1 rle with old method : 0.027552127838134766 time for calcul the mask position with numpy : 0.027199745178222656 nb_pixel_total : 34463 time to create 1 rle with old method : 0.03723740577697754 time for calcul the mask position with numpy : 0.028645753860473633 nb_pixel_total : 39015 time to create 1 rle with old method : 0.04446768760681152 time for calcul the mask position with numpy : 0.02918696403503418 nb_pixel_total : 36602 time to create 1 rle with old method : 0.04410076141357422 time for calcul the mask position with numpy : 0.03103351593017578 nb_pixel_total : 30676 time to create 1 rle with old method : 0.041268110275268555 time for calcul the mask position with numpy : 0.02961587905883789 nb_pixel_total : 62048 time to create 1 rle with old method : 0.06914281845092773 time for calcul the mask position with numpy : 0.02954244613647461 nb_pixel_total : 33828 time to create 1 rle with old method : 0.037577152252197266 time for calcul the mask position with numpy : 0.029111623764038086 nb_pixel_total : 5546 time to create 1 rle with old method : 0.006594657897949219 time for calcul the mask position with numpy : 0.028563976287841797 nb_pixel_total : 23682 time to create 1 rle with old method : 0.026697635650634766 time for calcul the mask position with numpy : 0.02814459800720215 nb_pixel_total : 97873 time to create 1 rle with old method : 0.1105034351348877 time for calcul the mask position with numpy : 0.028919458389282227 nb_pixel_total : 12394 time to create 1 rle with old method : 0.015606880187988281 time for calcul the mask position with numpy : 0.028311967849731445 nb_pixel_total : 5480 time to create 1 rle with old method : 0.00639653205871582 time for calcul the mask position with numpy : 0.02802276611328125 nb_pixel_total : 28279 time to create 1 rle with old method : 0.030659914016723633 time for calcul the mask position with numpy : 0.027764081954956055 nb_pixel_total : 37084 time to create 1 rle with old method : 0.0401456356048584 time for calcul the mask position with numpy : 0.0276181697845459 nb_pixel_total : 19178 time to create 1 rle with old method : 0.02154231071472168 time for calcul the mask position with numpy : 0.032593488693237305 nb_pixel_total : 4629 time to create 1 rle with old method : 0.007494211196899414 create new chi : 5.750823259353638 time to delete rle : 0.006330728530883789 batch 1 Loaded 81 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 22406 TO DO : save crop sub photo not yet done ! save time : 1.5112507343292236 nb_obj : 40 nb_hashtags : 5 time to prepare the origin masks : 4.214514255523682 time for calcul the mask position with numpy : 0.4781954288482666 nb_pixel_total : 4922866 time to create 1 rle with new method : 0.8117246627807617 time for calcul the mask position with numpy : 0.03290128707885742 nb_pixel_total : 46423 time to create 1 rle with old method : 0.052224159240722656 time for calcul the mask position with numpy : 0.029242992401123047 nb_pixel_total : 34540 time to create 1 rle with old method : 0.03983640670776367 time for calcul the mask position with numpy : 0.030029773712158203 nb_pixel_total : 107059 time to create 1 rle with old method : 0.14419031143188477 time for calcul the mask position with numpy : 0.031677961349487305 nb_pixel_total : 122297 time to create 1 rle with old method : 0.1362016201019287 time for calcul the mask position with numpy : 0.03249788284301758 nb_pixel_total : 6741 time to create 1 rle with old method : 0.011185407638549805 time for calcul the mask position with numpy : 0.029460668563842773 nb_pixel_total : 78253 time to create 1 rle with old method : 0.09285402297973633 time for calcul the mask position with numpy : 0.030283689498901367 nb_pixel_total : 149193 time to create 1 rle with old method : 0.17998957633972168 time for calcul the mask position with numpy : 0.03069591522216797 nb_pixel_total : 124024 time to create 1 rle with old method : 0.16304826736450195 time for calcul the mask position with numpy : 0.031883955001831055 nb_pixel_total : 125424 time to create 1 rle with old method : 0.13973212242126465 time for calcul the mask position with numpy : 0.029615163803100586 nb_pixel_total : 230182 time to create 1 rle with new method : 0.9359278678894043 time for calcul the mask position with numpy : 0.037224769592285156 nb_pixel_total : 9389 time to create 1 rle with old method : 0.010908126831054688 time for calcul the mask position with numpy : 0.028954505920410156 nb_pixel_total : 81275 time to create 1 rle with old method : 0.09147882461547852 time for calcul the mask position with numpy : 0.027836322784423828 nb_pixel_total : 4080 time to create 1 rle with old method : 0.00464177131652832 time for calcul the mask position with numpy : 0.02788090705871582 nb_pixel_total : 63404 time to create 1 rle with old method : 0.07275915145874023 time for calcul the mask position with numpy : 0.03028130531311035 nb_pixel_total : 13467 time to create 1 rle with old method : 0.016388416290283203 time for calcul the mask position with numpy : 0.028149127960205078 nb_pixel_total : 32113 time to create 1 rle with old method : 0.03675723075866699 time for calcul the mask position with numpy : 0.02874445915222168 nb_pixel_total : 20322 time to create 1 rle with old method : 0.021970033645629883 time for calcul the mask position with numpy : 0.029044151306152344 nb_pixel_total : 33416 time to create 1 rle with old method : 0.037154197692871094 time for calcul the mask position with numpy : 0.029122114181518555 nb_pixel_total : 27590 time to create 1 rle with old method : 0.03088831901550293 time for calcul the mask position with numpy : 0.029006004333496094 nb_pixel_total : 11382 time to create 1 rle with old method : 0.01390695571899414 time for calcul the mask position with numpy : 0.03551769256591797 nb_pixel_total : 22919 time to create 1 rle with old method : 0.02649855613708496 time for calcul the mask position with numpy : 0.02989816665649414 nb_pixel_total : 78210 time to create 1 rle with old method : 0.09316015243530273 time for calcul the mask position with numpy : 0.03363394737243652 nb_pixel_total : 47423 time to create 1 rle with old method : 0.06544733047485352 time for calcul the mask position with numpy : 0.028594255447387695 nb_pixel_total : 11315 time to create 1 rle with old method : 0.013093948364257812 time for calcul the mask position with numpy : 0.029350996017456055 nb_pixel_total : 12977 time to create 1 rle with old method : 0.015298604965209961 time for calcul the mask position with numpy : 0.03161001205444336 nb_pixel_total : 5090 time to create 1 rle with old method : 0.008258819580078125 time for calcul the mask position with numpy : 0.041203975677490234 nb_pixel_total : 18360 time to create 1 rle with old method : 0.02167487144470215 time for calcul the mask position with numpy : 0.02971053123474121 nb_pixel_total : 30056 time to create 1 rle with old method : 0.034539222717285156 time for calcul the mask position with numpy : 0.028774499893188477 nb_pixel_total : 75287 time to create 1 rle with old method : 0.08496356010437012 time for calcul the mask position with numpy : 0.029089689254760742 nb_pixel_total : 17861 time to create 1 rle with old method : 0.020550251007080078 time for calcul the mask position with numpy : 0.02901625633239746 nb_pixel_total : 21685 time to create 1 rle with old method : 0.02485799789428711 time for calcul the mask position with numpy : 0.02920842170715332 nb_pixel_total : 81111 time to create 1 rle with old method : 0.09461736679077148 time for calcul the mask position with numpy : 0.028026342391967773 nb_pixel_total : 38239 time to create 1 rle with old method : 0.04300808906555176 time for calcul the mask position with numpy : 0.027779817581176758 nb_pixel_total : 43127 time to create 1 rle with old method : 0.04775714874267578 time for calcul the mask position with numpy : 0.0281982421875 nb_pixel_total : 169915 time to create 1 rle with new method : 0.5741369724273682 time for calcul the mask position with numpy : 0.027930736541748047 nb_pixel_total : 23645 time to create 1 rle with old method : 0.025760412216186523 time for calcul the mask position with numpy : 0.027651071548461914 nb_pixel_total : 52095 time to create 1 rle with old method : 0.07137370109558105 time for calcul the mask position with numpy : 0.03311967849731445 nb_pixel_total : 44125 time to create 1 rle with old method : 0.049664974212646484 time for calcul the mask position with numpy : 0.02912425994873047 nb_pixel_total : 9953 time to create 1 rle with old method : 0.011826276779174805 time for calcul the mask position with numpy : 0.029079437255859375 nb_pixel_total : 3407 time to create 1 rle with old method : 0.004114627838134766 create new chi : 6.149343252182007 time to delete rle : 0.0039844512939453125 batch 1 Loaded 81 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 25003 TO DO : save crop sub photo not yet done ! save time : 1.651357889175415 nb_obj : 25 nb_hashtags : 2 time to prepare the origin masks : 11.554185390472412 time for calcul the mask position with numpy : 0.3738713264465332 nb_pixel_total : 5906814 time to create 1 rle with new method : 0.7575786113739014 time for calcul the mask position with numpy : 0.03480720520019531 nb_pixel_total : 4424 time to create 1 rle with old method : 0.005059719085693359 time for calcul the mask position with numpy : 0.0352632999420166 nb_pixel_total : 16402 time to create 1 rle with old method : 0.01778864860534668 time for calcul the mask position with numpy : 0.03459644317626953 nb_pixel_total : 27515 time to create 1 rle with old method : 0.03013467788696289 time for calcul the mask position with numpy : 0.0346677303314209 nb_pixel_total : 13388 time to create 1 rle with old method : 0.015039205551147461 time for calcul the mask position with numpy : 0.035859107971191406 nb_pixel_total : 27717 time to create 1 rle with old method : 0.031229019165039062 time for calcul the mask position with numpy : 0.03596186637878418 nb_pixel_total : 3516 time to create 1 rle with old method : 0.004041433334350586 time for calcul the mask position with numpy : 0.03835034370422363 nb_pixel_total : 424755 time to create 1 rle with new method : 1.0645098686218262 time for calcul the mask position with numpy : 0.03736376762390137 nb_pixel_total : 27889 time to create 1 rle with old method : 0.0325167179107666 time for calcul the mask position with numpy : 0.027701854705810547 nb_pixel_total : 15911 time to create 1 rle with old method : 0.02266716957092285 time for calcul the mask position with numpy : 0.0240175724029541 nb_pixel_total : 5364 time to create 1 rle with old method : 0.0063037872314453125 time for calcul the mask position with numpy : 0.022333383560180664 nb_pixel_total : 7435 time to create 1 rle with old method : 0.008521318435668945 time for calcul the mask position with numpy : 0.023122310638427734 nb_pixel_total : 5256 time to create 1 rle with old method : 0.006239175796508789 time for calcul the mask position with numpy : 0.02522587776184082 nb_pixel_total : 36169 time to create 1 rle with old method : 0.05841827392578125 time for calcul the mask position with numpy : 0.02289748191833496 nb_pixel_total : 52136 time to create 1 rle with old method : 0.05648970603942871 time for calcul the mask position with numpy : 0.03741788864135742 nb_pixel_total : 4729 time to create 1 rle with old method : 0.00558781623840332 time for calcul the mask position with numpy : 0.03676772117614746 nb_pixel_total : 32506 time to create 1 rle with old method : 0.03653120994567871 time for calcul the mask position with numpy : 0.035492897033691406 nb_pixel_total : 16210 time to create 1 rle with old method : 0.018318653106689453 time for calcul the mask position with numpy : 0.03620791435241699 nb_pixel_total : 12266 time to create 1 rle with old method : 0.014962196350097656 time for calcul the mask position with numpy : 0.04969167709350586 nb_pixel_total : 123008 time to create 1 rle with old method : 0.13586926460266113 time for calcul the mask position with numpy : 0.03301262855529785 nb_pixel_total : 14377 time to create 1 rle with old method : 0.016064882278442383 time for calcul the mask position with numpy : 0.034552574157714844 nb_pixel_total : 60330 time to create 1 rle with old method : 0.06891608238220215 time for calcul the mask position with numpy : 0.033212900161743164 nb_pixel_total : 12170 time to create 1 rle with old method : 0.013605356216430664 time for calcul the mask position with numpy : 0.033567190170288086 nb_pixel_total : 178176 time to create 1 rle with new method : 0.740319013595581 time for calcul the mask position with numpy : 0.035271644592285156 nb_pixel_total : 11620 time to create 1 rle with old method : 0.013417243957519531 time for calcul the mask position with numpy : 0.03330874443054199 nb_pixel_total : 10157 time to create 1 rle with old method : 0.013950824737548828 create new chi : 4.474658966064453 time to delete rle : 0.0046024322509765625 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 14085 TO DO : save crop sub photo not yet done ! save time : 0.9993622303009033 nb_obj : 27 nb_hashtags : 3 time to prepare the origin masks : 4.053644180297852 time for calcul the mask position with numpy : 1.4040639400482178 nb_pixel_total : 5808692 time to create 1 rle with new method : 0.7701206207275391 time for calcul the mask position with numpy : 0.02960801124572754 nb_pixel_total : 72486 time to create 1 rle with old method : 0.07987141609191895 time for calcul the mask position with numpy : 0.030835390090942383 nb_pixel_total : 19942 time to create 1 rle with old method : 0.023545026779174805 time for calcul the mask position with numpy : 0.028965234756469727 nb_pixel_total : 74171 time to create 1 rle with old method : 0.08338570594787598 time for calcul the mask position with numpy : 0.030254840850830078 nb_pixel_total : 116550 time to create 1 rle with old method : 0.13614630699157715 time for calcul the mask position with numpy : 0.02852606773376465 nb_pixel_total : 65745 time to create 1 rle with old method : 0.07672691345214844 time for calcul the mask position with numpy : 0.028742551803588867 nb_pixel_total : 8517 time to create 1 rle with old method : 0.010961771011352539 time for calcul the mask position with numpy : 0.028532981872558594 nb_pixel_total : 9818 time to create 1 rle with old method : 0.011035680770874023 time for calcul the mask position with numpy : 0.03328275680541992 nb_pixel_total : 1825 time to create 1 rle with old method : 0.002356290817260742 time for calcul the mask position with numpy : 0.02982497215270996 nb_pixel_total : 42620 time to create 1 rle with old method : 0.04898190498352051 time for calcul the mask position with numpy : 0.0288693904876709 nb_pixel_total : 43566 time to create 1 rle with old method : 0.05559349060058594 time for calcul the mask position with numpy : 0.035593509674072266 nb_pixel_total : 1165 time to create 1 rle with old method : 0.0023806095123291016 time for calcul the mask position with numpy : 0.032073974609375 nb_pixel_total : 119482 time to create 1 rle with old method : 0.13451266288757324 time for calcul the mask position with numpy : 0.028525829315185547 nb_pixel_total : 16239 time to create 1 rle with old method : 0.01998734474182129 time for calcul the mask position with numpy : 0.03122687339782715 nb_pixel_total : 28271 time to create 1 rle with old method : 0.0327610969543457 time for calcul the mask position with numpy : 0.0323636531829834 nb_pixel_total : 163954 time to create 1 rle with new method : 0.8025674819946289 time for calcul the mask position with numpy : 0.030135154724121094 nb_pixel_total : 99422 time to create 1 rle with old method : 0.11159348487854004 time for calcul the mask position with numpy : 0.029736757278442383 nb_pixel_total : 39011 time to create 1 rle with old method : 0.04452347755432129 time for calcul the mask position with numpy : 0.028846025466918945 nb_pixel_total : 10785 time to create 1 rle with old method : 0.012567996978759766 time for calcul the mask position with numpy : 0.030178070068359375 nb_pixel_total : 45519 time to create 1 rle with old method : 0.0532071590423584 time for calcul the mask position with numpy : 0.028678417205810547 nb_pixel_total : 24628 time to create 1 rle with old method : 0.02828049659729004 time for calcul the mask position with numpy : 0.028528213500976562 nb_pixel_total : 23140 time to create 1 rle with old method : 0.025714874267578125 time for calcul the mask position with numpy : 0.028927087783813477 nb_pixel_total : 81999 time to create 1 rle with old method : 0.09563398361206055 time for calcul the mask position with numpy : 0.02872633934020996 nb_pixel_total : 24536 time to create 1 rle with old method : 0.027841567993164062 time for calcul the mask position with numpy : 0.028629541397094727 nb_pixel_total : 43734 time to create 1 rle with old method : 0.047139644622802734 time for calcul the mask position with numpy : 0.028722047805786133 nb_pixel_total : 37684 time to create 1 rle with old method : 0.04222726821899414 time for calcul the mask position with numpy : 0.028249502182006836 nb_pixel_total : 13792 time to create 1 rle with old method : 0.015009403228759766 time for calcul the mask position with numpy : 0.027986764907836914 nb_pixel_total : 12947 time to create 1 rle with old method : 0.014400959014892578 create new chi : 5.091979265213013 time to delete rle : 0.004151821136474609 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 19819 TO DO : save crop sub photo not yet done ! save time : 1.479001760482788 map_output_result : {1344993735: (0.0, 'Should be the crop_list due to order', 0), 1344993422: (0.0, 'Should be the crop_list due to order', 0), 1344993388: (0.0, 'Should be the crop_list due to order', 0), 1344993359: (0.0, 'Should be the crop_list due to order', 0), 1344993228: (0.0, 'Should be the crop_list due to order', 0), 1344993097: (0.0, 'Should be the crop_list due to order', 0), 1344993022: (0.0, 'Should be the crop_list due to order', 0), 1344992091: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1344993735, 1344993422, 1344993388, 1344993359, 1344993228, 1344993097, 1344993022, 1344992091] Looping around the photos to save general results len do output : 8 /1344993735.Didn't retrieve data . /1344993422.Didn't retrieve data . /1344993388.Didn't retrieve data . /1344993359.Didn't retrieve data . /1344993228.Didn't retrieve data . /1344993097.Didn't retrieve data . /1344993022.Didn't retrieve data . /1344992091.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993735', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993422', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993388', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993359', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993228', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993097', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993022', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344992091', None, None, None, None, None, '2675593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015052318572998047 save_final save missing photos in datou_result : time spend for datou_step_exec : 91.18609929084778 time spend to save output : 0.015448331832885742 total time spend for step 3 : 91.20154762268066 step4:ventilate_hashtags_in_portfolio Mon Mar 17 22:26:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21504489 get user id for portfolio 21504489 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21504489 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','mal_croppe','background','papier','autre','pehd','pet_fonce','metal','pet_clair','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21504489 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','mal_croppe','background','papier','autre','pehd','pet_fonce','metal','pet_clair','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21504489 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','mal_croppe','background','papier','autre','pehd','pet_fonce','metal','pet_clair','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/21505028,21505029,21505030,21505031,21505032,21505033,21505034,21505035,21505036,21505037,21505038?tags=carton,environnement,mal_croppe,background,papier,autre,pehd,pet_fonce,metal,pet_clair,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1344993735, 1344993422, 1344993388, 1344993359, 1344993228, 1344993097, 1344993022, 1344992091] Looping around the photos to save general results len do output : 1 /21504489. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993735', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993422', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993388', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993359', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993228', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993097', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993022', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344992091', None, None, None, None, None, '2675593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014048099517822266 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.811455488204956 time spend to save output : 0.014290332794189453 total time spend for step 4 : 1.8257458209991455 step5:final Mon Mar 17 22:26:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1344993735: ('0.23512853817742374',), 1344993422: ('0.23512853817742374',), 1344993388: ('0.23512853817742374',), 1344993359: ('0.23512853817742374',), 1344993228: ('0.23512853817742374',), 1344993097: ('0.23512853817742374',), 1344993022: ('0.23512853817742374',), 1344992091: ('0.23512853817742374',)} new output for save of step final : {1344993735: ('0.23512853817742374',), 1344993422: ('0.23512853817742374',), 1344993388: ('0.23512853817742374',), 1344993359: ('0.23512853817742374',), 1344993228: ('0.23512853817742374',), 1344993097: ('0.23512853817742374',), 1344993022: ('0.23512853817742374',), 1344992091: ('0.23512853817742374',)} [1344993735, 1344993422, 1344993388, 1344993359, 1344993228, 1344993097, 1344993022, 1344992091] Looping around the photos to save general results len do output : 8 /1344993735.Didn't retrieve data . /1344993422.Didn't retrieve data . /1344993388.Didn't retrieve data . /1344993359.Didn't retrieve data . /1344993228.Didn't retrieve data . /1344993097.Didn't retrieve data . /1344993022.Didn't retrieve data . /1344992091.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993735', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993422', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993388', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993359', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993228', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993097', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993022', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344992091', None, None, None, None, None, '2675593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013099431991577148 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1128389835357666 time spend to save output : 0.013753175735473633 total time spend for step 5 : 0.12659215927124023 step6:blur_detection Mon Mar 17 22:26:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e.jpg resize: (2160, 3264) 1344993735 -1.7107378359476249 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec.jpg resize: (2160, 3264) 1344993422 -2.474648342022163 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164.jpg resize: (2160, 3264) 1344993388 -4.328407928758441 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566.jpg resize: (2160, 3264) 1344993359 -5.16917899385086 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f.jpg resize: (2160, 3264) 1344993228 -5.065560388685983 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69.jpg resize: (2160, 3264) 1344993097 -5.244176218234107 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac.jpg resize: (2160, 3264) 1344993022 -4.097495523634121 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3.jpg resize: (2160, 3264) 1344992091 -4.56568691425869 treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759311_0.png resize: (165, 171) 1345003730 -2.5187208572288773 treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759312_0.png resize: (132, 136) 1345003731 0.3557963049349976 treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759307_0.png resize: (133, 164) 1345003733 -0.9076597919843122 treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759309_0.png resize: (293, 504) 1345003734 2.2267192790059456 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759316_0.png resize: (286, 223) 1345003735 -1.1071045232681282 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759322_0.png resize: (111, 175) 1345003737 -2.360369620950457 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759319_0.png resize: (227, 135) 1345003738 -1.8385349362247465 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759328_0.png resize: (121, 153) 1345003739 -2.0684290363737974 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759325_0.png resize: (95, 175) 1345003740 -2.4733161441975207 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759323_0.png resize: (156, 170) 1345003742 -3.757527254518636 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759315_0.png resize: (248, 259) 1345003743 -3.0646455887630966 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759318_0.png resize: (139, 96) 1345003744 -2.66598975782213 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759332_0.png resize: (348, 467) 1345003746 -1.5058779407171363 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759338_0.png resize: (139, 165) 1345003747 -2.1254182234322543 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759336_0.png resize: (156, 249) 1345003748 -1.6514173684232951 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759344_0.png resize: (188, 215) 1345003750 -1.8158926883429254 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759341_0.png resize: (349, 379) 1345003751 -1.764206175825359 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759335_0.png resize: (288, 447) 1345003752 -3.995938261156667 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759334_0.png resize: (921, 1030) 1345003753 -0.6475406242868147 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759329_0.png resize: (533, 582) 1345003755 -2.8986977181826825 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759331_0.png resize: (726, 303) 1345003756 -2.9798559305183017 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759355_0.png resize: (713, 769) 1345003757 -3.5666317892317827 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759367_0.png resize: (434, 925) 1345003759 -1.4618791676326437 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759358_0.png resize: (229, 257) 1345003760 -0.22731819545780285 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759360_0.png resize: (895, 1378) 1345003761 -6.019656370235016 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759364_0.png resize: (123, 91) 1345003763 -1.1079823510683227 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759368_0.png resize: (206, 254) 1345003764 -4.044425539918342 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759365_0.png resize: (740, 998) 1345003765 -2.3576869866478165 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759370_0.png resize: (392, 555) 1345003766 -4.10947835686273 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759350_0.png resize: (389, 373) 1345003768 -0.8240887673978476 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759349_0.png resize: (547, 308) 1345003769 -2.9988262585216576 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759376_0.png resize: (252, 288) 1345003770 -1.5200907232391005 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759382_0.png resize: (151, 201) 1345003772 -2.832645950037473 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759385_0.png resize: (445, 554) 1345003773 -1.8849918136666624 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759387_0.png resize: (447, 481) 1345003774 -2.3937821025004196 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759410_0.png resize: (370, 685) 1345003776 -1.8068594427987452 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759395_0.png resize: (204, 277) 1345003777 -3.5135650156891858 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759412_0.png resize: (228, 213) 1345003778 -2.7131567259910825 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759377_0.png resize: (180, 229) 1345003779 -3.1444584678432044 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759407_0.png resize: (132, 134) 1345003781 -3.538006007439149 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759396_0.png resize: (139, 131) 1345003782 -1.6180678789195737 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759390_0.png resize: (171, 248) 1345003783 -4.3907056086909675 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759402_0.png resize: (194, 194) 1345003785 -2.371358613976641 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759406_0.png resize: (204, 239) 1345003786 -2.747998413531106 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759391_0.png resize: (188, 345) 1345003787 -2.8503628466770383 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759399_0.png resize: (240, 203) 1345003788 -2.931195714441567 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759384_0.png resize: (79, 79) 1345003790 -2.6679025925211293 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759389_0.png resize: (185, 206) 1345003791 -3.6842507501506843 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759381_0.png resize: (230, 166) 1345003792 -3.577529277451236 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759401_0.png resize: (119, 129) 1345003795 -3.333117020920041 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759398_0.png resize: (219, 160) 1345003796 -3.623449165522744 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759378_0.png resize: (291, 222) 1345003797 -3.8769283209873193 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759375_0.png resize: (244, 162) 1345003799 -3.6690335613900062 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759400_0.png resize: (163, 86) 1345003800 -4.512861896950945 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759397_0.png resize: (209, 175) 1345003801 -4.122028873360761 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759394_0.png resize: (235, 160) 1345003803 -3.1511403481821874 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759393_0.png resize: (136, 155) 1345003804 -4.123713205133212 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759379_0.png resize: (355, 280) 1345003805 -3.3050781425282887 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759413_0.png resize: (66, 119) 1345003806 -2.1512760313351857 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759415_0.png resize: (276, 182) 1345003808 -1.8764108778063837 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759416_0.png resize: (378, 359) 1345003809 -2.3415997070879695 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759429_0.png resize: (471, 682) 1345003810 -1.3710948352855272 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759426_0.png resize: (140, 379) 1345003812 -1.6839782710518643 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759434_0.png resize: (216, 94) 1345003813 -2.5557824262243662 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759438_0.png resize: (471, 456) 1345003814 -2.3153910854906385 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759449_0.png resize: (184, 189) 1345003815 -2.99529050088816 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759430_0.png resize: (70, 73) 1345003816 -3.558320148802073 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759422_0.png resize: (211, 281) 1345003817 -3.2580558412030722 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759443_0.png resize: (690, 325) 1345003818 -1.8255185019585094 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759435_0.png resize: (184, 212) 1345003819 -3.3561318013912644 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759421_0.png resize: (225, 219) 1345003820 -4.205430939940731 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759427_0.png resize: (275, 169) 1345003821 -0.7525752524715564 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759418_0.png resize: (198, 184) 1345003822 -3.9805469713039523 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759433_0.png resize: (128, 119) 1345003823 -4.059584618841864 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759450_0.png resize: (142, 128) 1345003824 -2.8868872171122444 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759451_0.png resize: (173, 237) 1345003825 -3.797052148839483 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759431_0.png resize: (237, 131) 1345003826 -3.2564220046864034 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759448_0.png resize: (245, 412) 1345003827 -4.30331326707453 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759424_0.png resize: (632, 415) 1345003828 -1.047070399726976 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759440_0.png resize: (175, 103) 1345003829 -3.4808003721394436 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759441_0.png resize: (321, 378) 1345003830 -4.084509057446022 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759414_0.png resize: (254, 312) 1345003831 -3.490385955914708 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759439_0.png resize: (167, 357) 1345003832 -3.1597704002200606 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759419_0.png resize: (375, 607) 1345003833 -4.240272520998482 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759453_0.png resize: (218, 80) 1345003834 -2.475274469031082 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759425_0.png resize: (107, 63) 1345003835 -3.395818894696819 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759442_0.png resize: (172, 254) 1345003836 -4.16040879922955 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759447_0.png resize: (617, 575) 1345003837 -3.9370354082745656 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759428_0.png resize: (94, 175) 1345003838 -4.765812229350961 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759470_0.png resize: (208, 93) 1345003839 -0.6710922295889858 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759471_0.png resize: (281, 222) 1345003840 -2.2387122964733384 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759475_0.png resize: (115, 155) 1345003841 -1.420401982279826 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759454_0.png resize: (109, 123) 1345003842 -2.1092007639978068 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759472_0.png resize: (1005, 796) 1345003843 -2.641634946326531 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759461_0.png resize: (116, 133) 1345003844 -1.7959920182722668 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759468_0.png resize: (94, 122) 1345003846 -2.8987648879676353 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759458_0.png resize: (277, 349) 1345003849 -1.7428129790029585 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759464_0.png resize: (66, 112) 1345003853 -3.1628295701800506 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759459_0.png resize: (138, 156) 1345003855 -3.4085252446666465 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759467_0.png resize: (273, 295) 1345003856 -2.2565465865670986 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759473_0.png resize: (123, 71) 1345003857 -2.458441034413619 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759455_0.png resize: (126, 141) 1345003858 -1.8918103663966381 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759457_0.png resize: (127, 119) 1345003859 -0.7380048760117356 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759466_0.png resize: (250, 282) 1345003860 -3.822965412664051 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759463_0.png resize: (167, 267) 1345003861 -3.8879061287913186 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759476_0.png resize: (199, 166) 1345003862 -0.8702339214683603 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759465_0.png resize: (386, 253) 1345003863 -3.3985628969549184 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759489_0.png resize: (354, 169) 1345003864 -3.451876388406672 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759481_0.png resize: (83, 177) 1345003865 -3.596721601923083 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759494_0.png resize: (104, 212) 1345003866 -0.5933036318154439 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759492_0.png resize: (127, 177) 1345003867 -4.098407437682909 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759480_0.png resize: (198, 220) 1345003868 -2.18462592441609 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759483_0.png resize: (294, 218) 1345003869 -3.924524508312792 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759479_0.png resize: (183, 140) 1345003870 -3.7397788696237644 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759495_0.png resize: (152, 79) 1345003871 -1.447598748504756 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759505_0.png resize: (199, 75) 1345003872 -3.5621627530652447 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759499_0.png resize: (441, 237) 1345003873 -4.192686785156595 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759482_0.png resize: (323, 452) 1345003874 -3.874181458788354 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759500_0.png resize: (624, 246) 1345003875 -4.6437896121282 treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759310_0.png resize: (626, 775) 1345004182 -0.6619998785349867 treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759308_0.png resize: (241, 616) 1345004186 0.0973927809224998 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759326_0.png resize: (706, 988) 1345004188 -1.7390928493785223 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759317_0.png resize: (322, 754) 1345004190 -3.1840082871576922 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759321_0.png resize: (315, 498) 1345004194 -2.053369007968527 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759324_0.png resize: (113, 167) 1345004196 -2.615093311330013 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759337_0.png resize: (144, 384) 1345004198 -2.9604137898722422 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759343_0.png resize: (102, 230) 1345004202 -2.9415776398769857 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759330_0.png resize: (278, 358) 1345004204 -3.061234644555906 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759346_0.png resize: (482, 754) 1345004207 -3.568168499210429 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759342_0.png resize: (206, 559) 1345004211 -2.7098566308785115 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759340_0.png resize: (268, 714) 1345004213 -1.7831217999206748 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759339_0.png resize: (332, 282) 1345004215 -1.5618964634880566 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759333_0.png resize: (407, 457) 1345004218 -3.0913655580899086 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759362_0.png resize: (250, 121) 1345004221 -2.6095254611702687 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759353_0.png resize: (1050, 725) 1345004223 -3.3306311642351125 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759352_0.png resize: (487, 887) 1345004225 -1.4321477742057793 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759361_0.png resize: (440, 718) 1345004227 -1.6527204346038518 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759351_0.png resize: (664, 1455) 1345004229 -2.96995403491941 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759357_0.png resize: (325, 334) 1345004231 -3.0747580178231058 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759363_0.png resize: (287, 182) 1345004233 0.6740219650093243 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759371_0.png resize: (67, 53) 1345004235 -1.8508328445324105 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759354_0.png resize: (920, 1367) 1345004237 -6.025612513888407 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759359_0.png resize: (222, 134) 1345004239 -2.6220453547084492 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759347_0.png resize: (295, 551) 1345004241 -4.038999415541429 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759348_0.png resize: (358, 224) 1345004243 -2.3667647612457126 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759356_0.png resize: (154, 132) 1345004245 -2.2084810199434917 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759369_0.png resize: (154, 160) 1345004247 -2.3296551664985197 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759392_0.png resize: (292, 297) 1345004249 -1.351260281121185 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759388_0.png resize: (372, 134) 1345004251 -2.2603203362050843 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759374_0.png resize: (117, 170) 1345004254 -4.132378381339634 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759386_0.png resize: (190, 405) 1345004256 -3.589382407326889 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759383_0.png resize: (132, 236) 1345004259 -2.755019487386926 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759404_0.png resize: (60, 76) 1345004261 -0.8740143934988651 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759409_0.png resize: (110, 116) 1345004263 -3.200307186197555 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759420_0.png resize: (329, 334) 1345004266 -2.68975279200093 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759444_0.png resize: (289, 269) 1345004268 -2.2212910064276845 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759446_0.png resize: (148, 132) 1345004270 -3.7840213848295967 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759462_0.png resize: (160, 182) 1345004272 -1.038520965347424 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759456_0.png resize: (364, 582) 1345004275 -0.24822741049888916 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759474_0.png resize: (237, 214) 1345004277 -3.351613337554782 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759477_0.png resize: (242, 127) 1345004279 -2.7994085602640895 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759478_0.png resize: (68, 89) 1345004282 -0.3632886192690582 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759469_0.png resize: (99, 91) 1345004284 -2.14644045850901 treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759460_0.png resize: (627, 349) 1345004286 -2.6567380420021056 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759493_0.png resize: (339, 172) 1345004289 -3.644543876737822 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759488_0.png resize: (148, 134) 1345004290 -3.9096605416382713 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759498_0.png resize: (670, 248) 1345004291 -4.888263395840687 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759373_0.png resize: (218, 152) 1345004343 -2.0398707256089925 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759408_0.png resize: (125, 123) 1345004345 -2.556799510720496 treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759313_0.png resize: (40, 190) 1345004572 -2.7566729515937793 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759320_0.png resize: (305, 493) 1345004573 -2.0387914110967493 treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759345_0.png resize: (202, 603) 1345004574 -2.16385899590405 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759372_0.png resize: (202, 452) 1345004575 -1.8050507916268206 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759403_0.png resize: (644, 892) 1345004577 -2.8880656707301666 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759405_0.png resize: (731, 570) 1345004578 -3.2558476508071696 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759417_0.png resize: (214, 679) 1345004579 -2.803877844929188 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759445_0.png resize: (407, 281) 1345004580 -3.886376618133328 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759436_0.png resize: (525, 229) 1345004581 -3.1799865434142243 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759504_0.png resize: (431, 145) 1345004582 -3.0583581822350014 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759484_0.png resize: (434, 275) 1345004583 -3.7025611583312323 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759502_0.png resize: (651, 266) 1345004584 -4.878104375740395 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759496_0.png resize: (260, 390) 1345004585 -4.79318628554083 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759487_0.png resize: (219, 237) 1345004586 -4.558075472043857 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759503_0.png resize: (183, 150) 1345004587 -4.722668899763673 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759490_0.png resize: (661, 254) 1345004588 -3.2674358575460114 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759485_0.png resize: (472, 186) 1345004589 -2.703213870542003 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759497_0.png resize: (534, 463) 1345004590 -1.8309621815106865 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759486_0.png resize: (293, 202) 1345004591 -4.694130666516288 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759501_0.png resize: (448, 144) 1345004592 -3.0897278074363537 treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759491_0.png resize: (240, 261) 1345004593 -1.5231160961097683 treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759314_0.png resize: (529, 558) 1345004595 -1.8887770862747713 treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759327_0.png resize: (168, 162) 1345004596 -2.3575670087980636 treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759366_0.png resize: (78, 50) 1345004597 -1.4752405509713213 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759380_0.png resize: (56, 99) 1345004598 -1.2569068082600854 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759452_0.png resize: (515, 218) 1345004599 -1.7834289343662324 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759432_0.png resize: (95, 88) 1345004600 -2.4888514013395526 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759423_0.png resize: (160, 515) 1345004601 -3.635816122496462 treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759437_0.png resize: (211, 210) 1345004602 -5.03787003169518 treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759411_0.png resize: (65, 123) 1345004604 -2.5986847663729766 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 207 time used for this insertion : 0.023348093032836914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 207 time used for this insertion : 0.044516801834106445 save missing photos in datou_result : time spend for datou_step_exec : 32.99053454399109 time spend to save output : 0.07366824150085449 total time spend for step 6 : 33.06420278549194 step7:brightness Mon Mar 17 22:26:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e.jpg treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec.jpg treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164.jpg treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566.jpg treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f.jpg treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69.jpg treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac.jpg treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3.jpg treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759311_0.png treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759312_0.png treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759307_0.png treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759309_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759316_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759322_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759319_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759328_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759325_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759323_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759315_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759318_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759332_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759338_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759336_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759344_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759341_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759335_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759334_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759329_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759331_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759355_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759367_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759358_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759360_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759364_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759368_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759365_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759370_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759350_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759349_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759376_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759382_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759385_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759387_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759410_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759395_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759412_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759377_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759407_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759396_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759390_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759402_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759406_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759391_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759399_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759384_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759389_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759381_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759401_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759398_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759378_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759375_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759400_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759397_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759394_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759393_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759379_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759413_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759415_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759416_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759429_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759426_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759434_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759438_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759449_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759430_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759422_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759443_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759435_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759421_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759427_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759418_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759433_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759450_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759451_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759431_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759448_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759424_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759440_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759441_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759414_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759439_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759419_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759453_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759425_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759442_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759447_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759428_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759470_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759471_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759475_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759454_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759472_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759461_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759468_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759458_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759464_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759459_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759467_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759473_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759455_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759457_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759466_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759463_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759476_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759465_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759489_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759481_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759494_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759492_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759480_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759483_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759479_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759495_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759505_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759499_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759482_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759500_0.png treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759310_0.png treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759308_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759326_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759317_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759321_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759324_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759337_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759343_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759330_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759346_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759342_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759340_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759339_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759333_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759362_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759353_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759352_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759361_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759351_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759357_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759363_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759371_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759354_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759359_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759347_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759348_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759356_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759369_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759392_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759388_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759374_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759386_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759383_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759404_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759409_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759420_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759444_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759446_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759462_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759456_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759474_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759477_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759478_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759469_0.png treat image : temp/1742246429_857173_1344993022_e166f235bb8e72573ff23e8bd06657ac_rle_crop_3716759460_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759493_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759488_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759498_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759373_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759408_0.png treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759313_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759320_0.png treat image : temp/1742246429_857173_1344993388_0a5b06be87c0351f40c57d6b5f434164_rle_crop_3716759345_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759372_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759403_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759405_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759417_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759445_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759436_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759504_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759484_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759502_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759496_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759487_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759503_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759490_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759485_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759497_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759486_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759501_0.png treat image : temp/1742246429_857173_1344992091_331146989baf2808c0ef2e88776499f3_rle_crop_3716759491_0.png treat image : temp/1742246429_857173_1344993735_86a452e8ae27ef3992d6814bf593434e_rle_crop_3716759314_0.png treat image : temp/1742246429_857173_1344993422_463e36499a962330ca3f967cbcec6aec_rle_crop_3716759327_0.png treat image : temp/1742246429_857173_1344993359_ac3c50013d39a71d9dd1cf9d26876566_rle_crop_3716759366_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759380_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759452_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759432_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759423_0.png treat image : temp/1742246429_857173_1344993097_be0934c1a9f31cb19225e14e3d8edd69_rle_crop_3716759437_0.png treat image : temp/1742246429_857173_1344993228_9f5a9b25298260e9d79cd107363de14f_rle_crop_3716759411_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 207 time used for this insertion : 0.021048307418823242 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 207 time used for this insertion : 0.044878244400024414 save missing photos in datou_result : time spend for datou_step_exec : 9.278088092803955 time spend to save output : 0.0719296932220459 total time spend for step 7 : 9.350017786026001 step8:velours_tree Mon Mar 17 22:26:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.8683979511260986 time spend to save output : 3.719329833984375e-05 total time spend for step 8 : 0.8684351444244385 step9:send_mail_cod Mon Mar 17 22:26:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21504489_17-03-2025_22_26_53.pdf 21505028 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette215050281742246813 21505030 imagette215050301742246815 21505031 imagette215050311742246815 21505032 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette215050321742246815 21505033 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette215050331742246817 21505034 change filename to text .imagette215050341742246818 21505035 change filename to text .imagette215050351742246818 21505036 change filename to text .change filename to text .imagette215050361742246818 21505037 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette215050371742246818 21505038 imagette215050381742246819 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21504489 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21505028,21505029,21505030,21505031,21505032,21505033,21505034,21505035,21505036,21505037,21505038?tags=carton,environnement,mal_croppe,background,papier,autre,pehd,pet_fonce,metal,pet_clair,flou args[1344993735] : ((1344993735, -1.7107378359476249, 492688767), (1344993735, 0.027977548357291847, 2107752395), '0.23512853817742374') We are sending mail with results at report@fotonower.com args[1344993422] : ((1344993422, -2.474648342022163, 492609224), (1344993422, -0.22391733469714853, 496442774), '0.23512853817742374') We are sending mail with results at report@fotonower.com args[1344993388] : ((1344993388, -4.328407928758441, 492609224), (1344993388, -0.5365335963087291, 501862349), '0.23512853817742374') We are sending mail with results at report@fotonower.com args[1344993359] : ((1344993359, -5.16917899385086, 492609224), (1344993359, -0.314100240692808, 496442774), '0.23512853817742374') We are sending mail with results at report@fotonower.com args[1344993228] : ((1344993228, -5.065560388685983, 492609224), (1344993228, -0.37120070606187605, 496442774), '0.23512853817742374') We are sending mail with results at report@fotonower.com args[1344993097] : ((1344993097, -5.244176218234107, 492609224), (1344993097, -0.14345170000433796, 496442774), '0.23512853817742374') We are sending mail with results at report@fotonower.com args[1344993022] : ((1344993022, -4.097495523634121, 492609224), (1344993022, -0.37299279622569914, 496442774), '0.23512853817742374') We are sending mail with results at report@fotonower.com args[1344992091] : ((1344992091, -4.56568691425869, 492609224), (1344992091, -0.25067213014521667, 496442774), '0.23512853817742374') We are sending mail with results at report@fotonower.com refus_total : 0.23512853817742374 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21504489 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1344993097,1344993228,1344993359,1344993388,1344992091,1344993022,1344993422,1344993735) Found this number of photos: 8 begin to download photo : 1344993097 begin to download photo : 1344993359 begin to download photo : 1344992091 begin to download photo : 1344993422 download finish for photo 1344993359 begin to download photo : 1344993388 download finish for photo 1344992091 begin to download photo : 1344993022 download finish for photo 1344993422 begin to download photo : 1344993735 download finish for photo 1344993097 begin to download photo : 1344993228 download finish for photo 1344993735 download finish for photo 1344993022 download finish for photo 1344993388 download finish for photo 1344993228 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21504489_17-03-2025_22_26_53.pdf results_Auto_P21504489_17-03-2025_22_26_53.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21504489_17-03-2025_22_26_53.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','21504489','results_Auto_P21504489_17-03-2025_22_26_53.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21504489_17-03-2025_22_26_53.pdf','pdf','','0.82','0.23512853817742374') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/21504489

https://www.fotonower.com/image?json=false&list_photos_id=1344993735
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1344993422
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1344993388
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1344993359
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1344993228
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1344993097
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1344993022
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1344992091
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 23.51%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/21505028?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/21505032?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/21505033?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/21505034?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/21505035?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/21505036?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/21505037?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21504489_17-03-2025_22_26_53.pdf.

Lien vers velours :https://www.fotonower.com/velours/21505028,21505029,21505030,21505031,21505032,21505033,21505034,21505035,21505036,21505037,21505038?tags=carton,environnement,mal_croppe,background,papier,autre,pehd,pet_fonce,metal,pet_clair,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 17 Mar 2025 21:27:02 GMT Content-Length: 0 Connection: close X-Message-Id: PylGoCEcQwWY-2uO7frerw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1344993735, 1344993422, 1344993388, 1344993359, 1344993228, 1344993097, 1344993022, 1344992091] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993735', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993422', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993388', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993359', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993228', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993097', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993022', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344992091', None, None, None, None, None, '2675593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.011816263198852539 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.734160900115967 time spend to save output : 0.012024641036987305 total time spend for step 9 : 8.746185541152954 step10:split_time_score Mon Mar 17 22:27:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17032025 21504489 Nombre de photos uploadées : 8 / 23040 (0%) 17032025 21504489 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 17032025 21504489 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0967254638671875e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0007469654083251953 elapsed_time : insert_dashboard_record_day_entry 0.021930217742919922 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21504444 order by id desc limit 1 Qualite : 0.11901509511795412 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21489006_17-03-2025_12_20_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21489006 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21489006 AND mptpi.`type`=3726 To do Qualite : 0.0614624131463237 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21489027_17-03-2025_12_25_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21489027 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21489027 AND mptpi.`type`=3726 To do Qualite : 0.25338279264251995 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21491643_17-03-2025_14_02_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21491643 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21491643 AND mptpi.`type`=3594 To do Qualite : 0.23104907066993471 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21491644_17-03-2025_14_01_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21491644 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21491644 AND mptpi.`type`=3594 To do Qualite : 0.23672240629791017 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21493940_17-03-2025_16_38_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21493940 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21493940 AND mptpi.`type`=3594 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21493942_17-03-2025_15_21_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21493942 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21493942 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21504488 order by id desc limit 1 Qualite : 0.23512853817742374 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21504489_17-03-2025_22_26_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21504489 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21504489 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21504540 order by id desc limit 1 Qualite : 0.15873492284241247 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21504570_17-03-2025_22_24_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21504570 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21504570 AND mptpi.`type`=3726 To do Qualite : 0.09197745597426722 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21504571_17-03-2025_22_23_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21504571 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21504571 AND mptpi.`type`=3726 To do Qualite : 0.2667584061981273 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21501457_17-03-2025_20_36_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21501457 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21501457 AND mptpi.`type`=3594 To do Qualite : 0.2147837993221981 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21501459_17-03-2025_20_33_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21501459 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21501459 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17032025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1344993735, 1344993422, 1344993388, 1344993359, 1344993228, 1344993097, 1344993022, 1344992091] Looping around the photos to save general results len do output : 1 /21504489Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993735', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993422', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993388', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993359', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993228', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993097', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344993022', None, None, None, None, None, '2675593') ('3318', None, None, None, None, None, None, None, '2675593') ('3318', '21504489', '1344992091', None, None, None, None, None, '2675593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012726783752441406 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.4692442417144775 time spend to save output : 0.012958049774169922 total time spend for step 10 : 3.4822022914886475 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 193.88user 118.87system 6:41.33elapsed 77%CPU (0avgtext+0avgdata 6154016maxresident)k 2357328inputs+179904outputs (83134major+16128669minor)pagefaults 0swaps