python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2988758 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 62>5 please execute split_portfolio.py -i 20940738 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2625050'] with mtr_portfolio_ids : ['20940738'] and first list_photo_ids : [] new path : /proc/2988758/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.7318682670593262 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Feb 28 21:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5304 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-28 21:20:33.646229: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-28 21:20:33.653784: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-28 21:20:33.655256: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f41d0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-28 21:20:33.655277: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-28 21:20:33.657753: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-28 21:20:33.906833: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x438db990 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-28 21:20:33.906918: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-28 21:20:33.908179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 21:20:33.908827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 21:20:33.913223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 21:20:33.916438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 21:20:33.917006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 21:20:33.921035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 21:20:33.923097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 21:20:33.932266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 21:20:33.934124: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 21:20:33.934237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 21:20:33.935231: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 21:20:33.935258: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 21:20:33.935272: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 21:20:33.937062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4843 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-28 21:20:34.278415: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 21:20:34.278543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 21:20:34.278572: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 21:20:34.278600: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 21:20:34.278625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 21:20:34.278652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 21:20:34.278677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 21:20:34.278701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 21:20:34.280409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 21:20:34.281539: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 21:20:34.281594: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 21:20:34.281613: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 21:20:34.281629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 21:20:34.281645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 21:20:34.281661: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 21:20:34.281677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 21:20:34.281698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 21:20:34.282706: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 21:20:34.282740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 21:20:34.282749: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 21:20:34.282760: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 21:20:34.283848: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4843 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-28 21:20:43.227247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 21:20:43.438420: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 21:20:45.201990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:45.203056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:45.204205: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.002858: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-28 21:20:46.076098: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.076185: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.077660: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.077693: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.085005: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.085066: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.085847: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.085865: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.117434: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.117587: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.117608: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-28 21:20:46.119054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.119094: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.120490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.120526: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.128120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.128207: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.129011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.129034: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.129839: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.129860: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 21:20:46.130646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.139414: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.140295: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.156436: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.157499: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.158518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.159572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.164138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.165248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.166844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.168330: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.170944: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.180913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.182367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.193032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.194349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.195602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.196854: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.198108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 21:20:46.199360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.76641 max: 149.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0001308917999267578 nb_pixel_total : 805 time to create 1 rle with old method : 0.0018153190612792969 length of segment : 32 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 893 time to create 1 rle with old method : 0.0018405914306640625 length of segment : 33 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 938 time to create 1 rle with old method : 0.001829385757446289 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1180 time to create 1 rle with old method : 0.002135753631591797 length of segment : 31 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.00653076171875 length of segment : 26 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1387 time to create 1 rle with old method : 0.0025839805603027344 length of segment : 30 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1781 time to create 1 rle with old method : 0.002315521240234375 length of segment : 37 time for calcul the mask position with numpy : 0.0001404285430908203 nb_pixel_total : 2745 time to create 1 rle with old method : 0.003721475601196289 length of segment : 54 time for calcul the mask position with numpy : 9.202957153320312e-05 nb_pixel_total : 1692 time to create 1 rle with old method : 0.0022008419036865234 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.24297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 24 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0007407665252685547 length of segment : 24 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0009775161743164062 length of segment : 52 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006971359252929688 length of segment : 29 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003898143768310547 length of segment : 11 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.001096487045288086 length of segment : 23 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0016524791717529297 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.27031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004172325134277344 length of segment : 16 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008647441864013672 length of segment : 48 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0011212825775146484 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0017747879028320312 length of segment : 78 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0009963512420654297 length of segment : 21 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 561 time to create 1 rle with old method : 0.0009486675262451172 length of segment : 23 time for calcul the mask position with numpy : 0.0008411407470703125 nb_pixel_total : 64323 time to create 1 rle with old method : 0.08511114120483398 length of segment : 320 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 232.00000 molded_images shape: (1, 640, 640, 3) min: -98.20781 max: 95.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.52031 max: 146.27969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 561 time to create 1 rle with old method : 0.0007765293121337891 length of segment : 26 time for calcul the mask position with numpy : 0.00021529197692871094 nb_pixel_total : 8987 time to create 1 rle with old method : 0.011635780334472656 length of segment : 114 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001595020294189453 length of segment : 18 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0006554126739501953 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.98906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0004570484161376953 length of segment : 22 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0007836818695068359 length of segment : 19 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002872943878173828 length of segment : 18 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.00034546852111816406 length of segment : 11 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0005280971527099609 length of segment : 22 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0005283355712890625 length of segment : 15 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0010862350463867188 length of segment : 19 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0005223751068115234 length of segment : 15 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0003170967102050781 length of segment : 11 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 26728 time to create 1 rle with old method : 0.041997671127319336 length of segment : 255 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.36016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00010228157043457031 nb_pixel_total : 445 time to create 1 rle with old method : 0.0010466575622558594 length of segment : 32 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 1468 time to create 1 rle with old method : 0.002670764923095703 length of segment : 66 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 1960 time to create 1 rle with old method : 0.0037822723388671875 length of segment : 124 time for calcul the mask position with numpy : 0.0001633167266845703 nb_pixel_total : 414 time to create 1 rle with old method : 0.0008933544158935547 length of segment : 31 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 1615 time to create 1 rle with old method : 0.0036585330963134766 length of segment : 57 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.0002512931823730469 length of segment : 9 time for calcul the mask position with numpy : 0.0002396106719970703 nb_pixel_total : 8469 time to create 1 rle with old method : 0.013873100280761719 length of segment : 74 time for calcul the mask position with numpy : 0.0001437664031982422 nb_pixel_total : 2045 time to create 1 rle with old method : 0.003494739532470703 length of segment : 55 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1422 time to create 1 rle with old method : 0.0018227100372314453 length of segment : 68 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0012292861938476562 length of segment : 71 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 31 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0005209445953369141 length of segment : 31 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0016849040985107422 length of segment : 70 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 1415 time to create 1 rle with old method : 0.0018172264099121094 length of segment : 118 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 207.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 88.36562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002849102020263672 length of segment : 14 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.12734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0023641586303710938 length of segment : 45 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 1168 time to create 1 rle with old method : 0.002137899398803711 length of segment : 29 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0005536079406738281 length of segment : 18 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 21 time for calcul the mask position with numpy : 0.00012087821960449219 nb_pixel_total : 3312 time to create 1 rle with old method : 0.005781412124633789 length of segment : 94 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0006208419799804688 length of segment : 17 time for calcul the mask position with numpy : 8.749961853027344e-05 nb_pixel_total : 2468 time to create 1 rle with old method : 0.004436016082763672 length of segment : 91 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.15469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 279 time to create 1 rle with old method : 0.0005347728729248047 length of segment : 18 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.0002727508544921875 length of segment : 8 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.00025153160095214844 length of segment : 21 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 914 time to create 1 rle with old method : 0.0012292861938476562 length of segment : 29 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00016164779663085938 length of segment : 14 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003075599670410156 length of segment : 22 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.000583648681640625 length of segment : 30 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.0001881122589111328 length of segment : 12 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0008721351623535156 length of segment : 23 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.000583648681640625 length of segment : 15 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.0002689361572265625 length of segment : 12 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.00032711029052734375 length of segment : 17 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0006170272827148438 length of segment : 26 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0010943412780761719 length of segment : 43 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00037097930908203125 length of segment : 14 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0016818046569824219 length of segment : 34 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005726814270019531 length of segment : 30 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005564689636230469 length of segment : 21 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1757 time to create 1 rle with old method : 0.0021119117736816406 length of segment : 64 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1675 time to create 1 rle with old method : 0.0019731521606445312 length of segment : 62 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0015299320220947266 length of segment : 38 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1531 time to create 1 rle with old method : 0.0018427371978759766 length of segment : 54 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0014390945434570312 length of segment : 43 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005407333374023438 length of segment : 30 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003819465637207031 length of segment : 25 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 2103 time to create 1 rle with old method : 0.0026030540466308594 length of segment : 76 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003590583801269531 length of segment : 18 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0005900859832763672 length of segment : 68 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.00041985511779785156 length of segment : 32 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00012445449829101562 length of segment : 17 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1737 time to create 1 rle with old method : 0.0023958683013916016 length of segment : 66 time for calcul the mask position with numpy : 0.00022673606872558594 nb_pixel_total : 6661 time to create 1 rle with old method : 0.011111021041870117 length of segment : 169 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 1776 time to create 1 rle with old method : 0.0028548240661621094 length of segment : 68 time for calcul the mask position with numpy : 0.00018930435180664062 nb_pixel_total : 5629 time to create 1 rle with old method : 0.009258031845092773 length of segment : 151 time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 2112 time to create 1 rle with old method : 0.0034973621368408203 length of segment : 74 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0008611679077148438 length of segment : 20 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 20 time to create 1 rle with old method : 0.00017380714416503906 length of segment : 10 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.34844 max: 149.30312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 860 time to create 1 rle with old method : 0.0011649131774902344 length of segment : 34 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 953 time to create 1 rle with old method : 0.0012972354888916016 length of segment : 30 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1034 time to create 1 rle with old method : 0.0013034343719482422 length of segment : 32 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 903 time to create 1 rle with old method : 0.0011906623840332031 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.74688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1350 time to create 1 rle with old method : 0.0018966197967529297 length of segment : 32 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1700 time to create 1 rle with old method : 0.002232789993286133 length of segment : 45 time for calcul the mask position with numpy : 0.00018453598022460938 nb_pixel_total : 4411 time to create 1 rle with old method : 0.0057353973388671875 length of segment : 71 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1060 time to create 1 rle with old method : 0.0013415813446044922 length of segment : 52 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0003371238708496094 length of segment : 19 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1568 time to create 1 rle with old method : 0.002133607864379883 length of segment : 36 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 561 time to create 1 rle with old method : 0.0008502006530761719 length of segment : 14 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0007598400115966797 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.01250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006914138793945312 length of segment : 23 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 2669 time to create 1 rle with old method : 0.004915714263916016 length of segment : 72 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0007042884826660156 length of segment : 23 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 30 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.0010249614715576172 length of segment : 32 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00040793418884277344 length of segment : 48 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00016045570373535156 length of segment : 17 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003528594970703125 length of segment : 25 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00019693374633789062 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.68828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0004458427429199219 length of segment : 16 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 2019 time to create 1 rle with old method : 0.0025289058685302734 length of segment : 121 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0009925365447998047 length of segment : 63 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 572 time to create 1 rle with old method : 0.0007417201995849609 length of segment : 37 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0006339550018310547 length of segment : 28 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.92422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 1032 time to create 1 rle with old method : 0.001264810562133789 length of segment : 81 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.00043392181396484375 length of segment : 33 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003535747528076172 length of segment : 39 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0008006095886230469 length of segment : 19 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0016961097717285156 length of segment : 50 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 510 time to create 1 rle with old method : 0.0006973743438720703 length of segment : 23 time for calcul the mask position with numpy : 0.0001423358917236328 nb_pixel_total : 5801 time to create 1 rle with old method : 0.007416486740112305 length of segment : 50 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007932186126708984 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 216.00000 molded_images shape: (1, 640, 640, 3) min: -97.75078 max: 90.14687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.64531 max: 144.36953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00021576881408691406 nb_pixel_total : 7824 time to create 1 rle with old method : 0.009987592697143555 length of segment : 101 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 15799 time to create 1 rle with old method : 0.019459009170532227 length of segment : 147 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 776 time to create 1 rle with old method : 0.0009894371032714844 length of segment : 63 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005474090576171875 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.85625 max: 151.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 25590 time to create 1 rle with old method : 0.030038118362426758 length of segment : 218 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.17266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 2135 time to create 1 rle with old method : 0.0025644302368164062 length of segment : 133 time for calcul the mask position with numpy : 0.00012874603271484375 nb_pixel_total : 8664 time to create 1 rle with old method : 0.010733366012573242 length of segment : 75 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007889270782470703 length of segment : 37 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1573 time to create 1 rle with old method : 0.002023935317993164 length of segment : 50 time for calcul the mask position with numpy : 0.00021266937255859375 nb_pixel_total : 3938 time to create 1 rle with old method : 0.004935503005981445 length of segment : 207 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1505 time to create 1 rle with old method : 0.002293109893798828 length of segment : 79 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 30 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 953 time to create 1 rle with old method : 0.0019195079803466797 length of segment : 86 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.000492095947265625 length of segment : 32 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 761 time to create 1 rle with old method : 0.0010826587677001953 length of segment : 93 Processing 1 images image shape: (280, 400, 3) min: 6.00000 max: 206.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 81.29141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0006577968597412109 length of segment : 55 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.76016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 2192 time to create 1 rle with old method : 0.004331350326538086 length of segment : 92 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 3202 time to create 1 rle with old method : 0.004585742950439453 length of segment : 49 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0004715919494628906 length of segment : 30 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1570 time to create 1 rle with old method : 0.001979827880859375 length of segment : 35 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 2855 time to create 1 rle with old method : 0.003755807876586914 length of segment : 88 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 3045 time to create 1 rle with old method : 0.004126787185668945 length of segment : 84 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006940364837646484 length of segment : 50 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1510 time to create 1 rle with old method : 0.0019118785858154297 length of segment : 36 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.42422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 28 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00040030479431152344 length of segment : 18 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00016427040100097656 length of segment : 7 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005054473876953125 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002448558807373047 length of segment : 23 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0013103485107421875 length of segment : 50 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00017547607421875 length of segment : 15 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.00045108795166015625 length of segment : 29 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1563 time to create 1 rle with old method : 0.0019023418426513672 length of segment : 53 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.0001914501190185547 length of segment : 13 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00031447410583496094 length of segment : 21 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00018143653869628906 length of segment : 11 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005815029144287109 length of segment : 35 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0008485317230224609 length of segment : 32 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1881 time to create 1 rle with old method : 0.0023910999298095703 length of segment : 53 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007808208465576172 length of segment : 32 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.00030493736267089844 length of segment : 22 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00025010108947753906 length of segment : 15 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0009417533874511719 length of segment : 27 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.00012350082397460938 length of segment : 12 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1016 time to create 1 rle with old method : 0.0014269351959228516 length of segment : 45 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1651 time to create 1 rle with old method : 0.002189159393310547 length of segment : 54 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005917549133300781 length of segment : 27 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0007715225219726562 length of segment : 34 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1000 time to create 1 rle with old method : 0.001214742660522461 length of segment : 44 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1490 time to create 1 rle with old method : 0.0018868446350097656 length of segment : 53 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0014719963073730469 length of segment : 35 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 1336 time to create 1 rle with old method : 0.001561880111694336 length of segment : 37 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1366 time to create 1 rle with old method : 0.0016121864318847656 length of segment : 38 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0014879703521728516 length of segment : 43 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1386 time to create 1 rle with old method : 0.0018873214721679688 length of segment : 64 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007619857788085938 length of segment : 33 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004017353057861328 length of segment : 33 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00026607513427734375 length of segment : 16 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1102 time to create 1 rle with old method : 0.0014197826385498047 length of segment : 43 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0007314682006835938 length of segment : 44 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.001329660415649414 length of segment : 67 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 12 time to create 1 rle with old method : 0.00011420249938964844 length of segment : 10 time for calcul the mask position with numpy : 0.00042366981506347656 nb_pixel_total : 39397 time to create 1 rle with old method : 0.04791092872619629 length of segment : 267 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.74688 max: 149.38125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 912 time to create 1 rle with old method : 0.0012807846069335938 length of segment : 32 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 948 time to create 1 rle with old method : 0.00128936767578125 length of segment : 33 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1014 time to create 1 rle with old method : 0.001359701156616211 length of segment : 34 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0013322830200195312 length of segment : 29 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 814 time to create 1 rle with old method : 0.001153707504272461 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.43047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 1945 time to create 1 rle with old method : 0.002553224563598633 length of segment : 42 length of segment : 0 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 776 time to create 1 rle with old method : 0.0011000633239746094 length of segment : 25 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 56 time to create 1 rle with old method : 0.0001347064971923828 length of segment : 10 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.001135110855102539 length of segment : 40 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 39 time to create 1 rle with old method : 8.630752563476562e-05 length of segment : 6 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0002529621124267578 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.10234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0008041858673095703 length of segment : 25 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 856 time to create 1 rle with old method : 0.0011334419250488281 length of segment : 62 time for calcul the mask position with numpy : 0.0001838207244873047 nb_pixel_total : 9593 time to create 1 rle with old method : 0.011326789855957031 length of segment : 78 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 689 time to create 1 rle with old method : 0.0010097026824951172 length of segment : 24 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005571842193603516 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.74297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00043320655822753906 length of segment : 17 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 927 time to create 1 rle with old method : 0.0013129711151123047 length of segment : 57 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007388591766357422 length of segment : 41 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 956 time to create 1 rle with old method : 0.0012979507446289062 length of segment : 39 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1027 time to create 1 rle with old method : 0.0013768672943115234 length of segment : 42 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1036 time to create 1 rle with old method : 0.001337289810180664 length of segment : 40 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.06484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1234 time to create 1 rle with old method : 0.0015332698822021484 length of segment : 83 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 948 time to create 1 rle with old method : 0.001190185546875 length of segment : 36 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00039315223693847656 length of segment : 27 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0007262229919433594 length of segment : 19 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006415843963623047 length of segment : 19 time for calcul the mask position with numpy : 0.0008380413055419922 nb_pixel_total : 56130 time to create 1 rle with old method : 0.07044553756713867 length of segment : 251 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004584789276123047 length of segment : 35 time for calcul the mask position with numpy : 0.00067138671875 nb_pixel_total : 61137 time to create 1 rle with old method : 0.07314062118530273 length of segment : 237 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 221.00000 molded_images shape: (1, 640, 640, 3) min: -96.07500 max: 91.14687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.75859 max: 145.90469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0029795169830322266 length of segment : 47 time for calcul the mask position with numpy : 0.00019025802612304688 nb_pixel_total : 8213 time to create 1 rle with old method : 0.013771533966064453 length of segment : 107 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0006995201110839844 length of segment : 19 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.0003027915954589844 length of segment : 23 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005409717559814453 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.34844 max: 150.96328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 15 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0004892349243164062 length of segment : 28 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002455711364746094 length of segment : 11 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0007309913635253906 length of segment : 24 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0010251998901367188 length of segment : 21 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0006458759307861328 length of segment : 30 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 16 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.000530242919921875 length of segment : 16 time for calcul the mask position with numpy : 0.0007069110870361328 nb_pixel_total : 26876 time to create 1 rle with old method : 0.03978753089904785 length of segment : 263 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.62578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 2097 time to create 1 rle with old method : 0.002683401107788086 length of segment : 130 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0006051063537597656 length of segment : 37 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006465911865234375 length of segment : 57 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 4845 time to create 1 rle with old method : 0.006157398223876953 length of segment : 87 time for calcul the mask position with numpy : 0.0001423358917236328 nb_pixel_total : 8134 time to create 1 rle with old method : 0.009689807891845703 length of segment : 71 time for calcul the mask position with numpy : 0.0007848739624023438 nb_pixel_total : 43569 time to create 1 rle with old method : 0.04775524139404297 length of segment : 485 time for calcul the mask position with numpy : 0.00011038780212402344 nb_pixel_total : 5772 time to create 1 rle with old method : 0.008926868438720703 length of segment : 99 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1564 time to create 1 rle with old method : 0.0019702911376953125 length of segment : 78 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 912 time to create 1 rle with old method : 0.0010993480682373047 length of segment : 50 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004906654357910156 length of segment : 31 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1099 time to create 1 rle with old method : 0.001399993896484375 length of segment : 86 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.00047898292541503906 length of segment : 29 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003771781921386719 length of segment : 28 time for calcul the mask position with numpy : 0.0001761913299560547 nb_pixel_total : 4541 time to create 1 rle with old method : 0.0052547454833984375 length of segment : 221 time for calcul the mask position with numpy : 0.00018596649169921875 nb_pixel_total : 3914 time to create 1 rle with old method : 0.0047647953033447266 length of segment : 208 Processing 1 images image shape: (280, 400, 3) min: 6.00000 max: 207.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 83.29531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0007283687591552734 length of segment : 59 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 3103 time to create 1 rle with old method : 0.0038118362426757812 length of segment : 49 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004444122314453125 length of segment : 29 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 3745 time to create 1 rle with old method : 0.004446506500244141 length of segment : 108 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003426074981689453 length of segment : 20 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004668235778808594 length of segment : 18 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1647 time to create 1 rle with old method : 0.0019156932830810547 length of segment : 36 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1409 time to create 1 rle with old method : 0.0018649101257324219 length of segment : 49 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 3705 time to create 1 rle with old method : 0.0043833255767822266 length of segment : 74 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 2855 time to create 1 rle with old method : 0.0035500526428222656 length of segment : 91 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1737 time to create 1 rle with old method : 0.002292156219482422 length of segment : 39 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.34219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0004189014434814453 length of segment : 18 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.00017070770263671875 length of segment : 8 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1558 time to create 1 rle with old method : 0.0017852783203125 length of segment : 52 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0010650157928466797 length of segment : 29 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0004336833953857422 length of segment : 21 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.0002117156982421875 length of segment : 11 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.00032973289489746094 length of segment : 22 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0008695125579833984 length of segment : 32 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.0014188289642333984 length of segment : 42 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0008604526519775391 length of segment : 22 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.0002827644348144531 length of segment : 15 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 853 time to create 1 rle with old method : 0.0015728473663330078 length of segment : 34 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0011348724365234375 length of segment : 24 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0007865428924560547 length of segment : 33 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1725 time to create 1 rle with old method : 0.002992868423461914 length of segment : 63 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1365 time to create 1 rle with old method : 0.0024499893188476562 length of segment : 38 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.00017714500427246094 length of segment : 9 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0005676746368408203 length of segment : 18 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 426 time to create 1 rle with old method : 0.0005588531494140625 length of segment : 32 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.00035834312438964844 length of segment : 12 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007433891296386719 length of segment : 51 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1679 time to create 1 rle with old method : 0.002022266387939453 length of segment : 58 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0011463165283203125 length of segment : 36 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0012502670288085938 length of segment : 44 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005519390106201172 length of segment : 19 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0021240711212158203 length of segment : 52 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0019998550415039062 length of segment : 40 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0010943412780761719 length of segment : 66 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.00027751922607421875 length of segment : 16 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0014307498931884766 length of segment : 44 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.0002491474151611328 length of segment : 37 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006935596466064453 length of segment : 25 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00019502639770507812 length of segment : 15 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 918 time to create 1 rle with old method : 0.0011229515075683594 length of segment : 52 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003669261932373047 length of segment : 25 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2361 time to create 1 rle with old method : 0.0030586719512939453 length of segment : 31 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1732 time to create 1 rle with old method : 0.0021440982818603516 length of segment : 65 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003230571746826172 length of segment : 25 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0007443428039550781 length of segment : 89 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.63359 max: 149.30312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 897 time to create 1 rle with old method : 0.0011467933654785156 length of segment : 33 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 833 time to create 1 rle with old method : 0.0010733604431152344 length of segment : 42 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 1003 time to create 1 rle with old method : 0.0012061595916748047 length of segment : 36 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005843639373779297 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.77422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.00017404556274414062 length of segment : 15 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1791 time to create 1 rle with old method : 0.0022978782653808594 length of segment : 42 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0011439323425292969 length of segment : 26 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00018453598022460938 length of segment : 10 length of segment : 0 time for calcul the mask position with numpy : 0.00013256072998046875 nb_pixel_total : 3587 time to create 1 rle with old method : 0.004404783248901367 length of segment : 52 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 35 time to create 1 rle with old method : 8.58306884765625e-05 length of segment : 6 length of segment : 0 length of segment : 0 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 26 time to create 1 rle with old method : 6.937980651855469e-05 length of segment : 5 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 829 time to create 1 rle with old method : 0.0009906291961669922 length of segment : 51 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009860992431640625 length of segment : 65 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.72344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006916522979736328 length of segment : 25 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006108283996582031 length of segment : 29 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00020623207092285156 length of segment : 17 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007781982421875 length of segment : 28 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0010237693786621094 length of segment : 48 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00037407875061035156 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.07109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003714561462402344 length of segment : 17 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009765625 length of segment : 57 time for calcul the mask position with numpy : 0.00018024444580078125 nb_pixel_total : 1409 time to create 1 rle with old method : 0.003300905227661133 length of segment : 91 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0007977485656738281 length of segment : 28 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0007257461547851562 length of segment : 40 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0006568431854248047 length of segment : 65 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.75625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0010747909545898438 length of segment : 20 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0031287670135498047 length of segment : 84 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0011997222900390625 length of segment : 28 time for calcul the mask position with numpy : 0.0008404254913330078 nb_pixel_total : 62362 time to create 1 rle with old method : 0.08914375305175781 length of segment : 251 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 229.00000 molded_images shape: (1, 640, 640, 3) min: -99.42656 max: 91.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.24688 max: 144.36953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00014781951904296875 nb_pixel_total : 8918 time to create 1 rle with old method : 0.01035451889038086 length of segment : 122 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0008251667022705078 length of segment : 23 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 2836 time to create 1 rle with old method : 0.0035238265991210938 length of segment : 53 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005426406860351562 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.86797 max: 150.77578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002765655517578125 length of segment : 11 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0007426738739013672 length of segment : 20 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0010704994201660156 length of segment : 33 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0008871555328369141 length of segment : 21 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003566741943359375 length of segment : 14 time for calcul the mask position with numpy : 0.0003497600555419922 nb_pixel_total : 24249 time to create 1 rle with old method : 0.026457548141479492 length of segment : 231 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.32891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 2327 time to create 1 rle with old method : 0.002808094024658203 length of segment : 143 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 1735 time to create 1 rle with old method : 0.0022699832916259766 length of segment : 62 time for calcul the mask position with numpy : 0.00014710426330566406 nb_pixel_total : 8514 time to create 1 rle with old method : 0.011508941650390625 length of segment : 77 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007822513580322266 length of segment : 56 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1893 time to create 1 rle with old method : 0.0023217201232910156 length of segment : 65 time for calcul the mask position with numpy : 0.0005145072937011719 nb_pixel_total : 20475 time to create 1 rle with old method : 0.02236199378967285 length of segment : 503 time for calcul the mask position with numpy : 0.000133514404296875 nb_pixel_total : 7528 time to create 1 rle with old method : 0.009326696395874023 length of segment : 86 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1621 time to create 1 rle with old method : 0.001958131790161133 length of segment : 76 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004546642303466797 length of segment : 30 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004124641418457031 length of segment : 28 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010120868682861328 length of segment : 65 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003726482391357422 length of segment : 27 time for calcul the mask position with numpy : 0.00018525123596191406 nb_pixel_total : 4217 time to create 1 rle with old method : 0.004852771759033203 length of segment : 203 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 4056 time to create 1 rle with old method : 0.0050106048583984375 length of segment : 196 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 207.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 83.29141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005917549133300781 length of segment : 57 time for calcul the mask position with numpy : 0.0009548664093017578 nb_pixel_total : 104892 time to create 1 rle with old method : 0.11163115501403809 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.37734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 3214 time to create 1 rle with old method : 0.003843545913696289 length of segment : 50 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1705 time to create 1 rle with old method : 0.002071380615234375 length of segment : 36 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003819465637207031 length of segment : 13 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004565715789794922 length of segment : 31 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004935264587402344 length of segment : 38 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 3290 time to create 1 rle with old method : 0.0039598941802978516 length of segment : 91 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 2378 time to create 1 rle with old method : 0.002900362014770508 length of segment : 84 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002899169921875 length of segment : 20 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 2731 time to create 1 rle with old method : 0.003424406051635742 length of segment : 82 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007064342498779297 length of segment : 44 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 3785 time to create 1 rle with old method : 0.0044825077056884766 length of segment : 77 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.54141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.000400543212890625 length of segment : 19 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001697540283203125 length of segment : 7 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002601146697998047 length of segment : 21 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003254413604736328 length of segment : 22 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007958412170410156 length of segment : 25 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1026 time to create 1 rle with old method : 0.001312255859375 length of segment : 49 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1718 time to create 1 rle with old method : 0.002085447311401367 length of segment : 63 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0004892349243164062 length of segment : 18 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 868 time to create 1 rle with old method : 0.0011143684387207031 length of segment : 43 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1786 time to create 1 rle with old method : 0.002036571502685547 length of segment : 73 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00013494491577148438 length of segment : 11 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.00045418739318847656 length of segment : 22 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 14 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.0009958744049072266 length of segment : 41 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.00042891502380371094 length of segment : 26 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004820823669433594 length of segment : 25 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2052 time to create 1 rle with old method : 0.0025262832641601562 length of segment : 53 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0009379386901855469 length of segment : 30 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0016503334045410156 length of segment : 35 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 30 time to create 1 rle with old method : 6.890296936035156e-05 length of segment : 7 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005099773406982422 length of segment : 30 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005323886871337891 length of segment : 31 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1327 time to create 1 rle with old method : 0.0016312599182128906 length of segment : 37 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1207 time to create 1 rle with old method : 0.0014698505401611328 length of segment : 46 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0006182193756103516 length of segment : 31 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 2178 time to create 1 rle with old method : 0.0024824142456054688 length of segment : 80 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00029921531677246094 length of segment : 17 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1824 time to create 1 rle with old method : 0.002226114273071289 length of segment : 65 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004162788391113281 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.00049591064453125 length of segment : 27 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005154609680175781 length of segment : 29 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003485679626464844 length of segment : 21 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.00101470947265625 length of segment : 65 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00038743019104003906 length of segment : 36 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005083084106445312 length of segment : 19 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 671 time to create 1 rle with old method : 0.0009489059448242188 length of segment : 116 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.76641 max: 149.43984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.001051187515258789 length of segment : 34 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 856 time to create 1 rle with old method : 0.0010986328125 length of segment : 36 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0012011528015136719 length of segment : 34 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 1031 time to create 1 rle with old method : 0.0013103485107421875 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.74688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 864 time to create 1 rle with old method : 0.0011284351348876953 length of segment : 23 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1835 time to create 1 rle with old method : 0.0023779869079589844 length of segment : 43 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1360 time to create 1 rle with old method : 0.0016074180603027344 length of segment : 31 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 7828 time to create 1 rle with old method : 0.00897216796875 length of segment : 81 time for calcul the mask position with numpy : 0.00012063980102539062 nb_pixel_total : 4333 time to create 1 rle with old method : 0.0052144527435302734 length of segment : 62 time for calcul the mask position with numpy : 0.00018477439880371094 nb_pixel_total : 12490 time to create 1 rle with old method : 0.01450800895690918 length of segment : 79 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -98.62188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0009396076202392578 length of segment : 22 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.0013034343719482422 length of segment : 27 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00013780593872070312 length of segment : 13 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0004951953887939453 length of segment : 11 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.001100778579711914 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.14531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003838539123535156 length of segment : 17 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1516 time to create 1 rle with old method : 0.0018508434295654297 length of segment : 119 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0008552074432373047 length of segment : 34 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006990432739257812 length of segment : 27 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0006592273712158203 length of segment : 56 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009307861328125 length of segment : 58 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006875991821289062 length of segment : 38 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0008709430694580078 length of segment : 38 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.62734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0006339550018310547 length of segment : 19 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 1191 time to create 1 rle with old method : 0.001332998275756836 length of segment : 80 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.00039887428283691406 length of segment : 33 time for calcul the mask position with numpy : 0.0005092620849609375 nb_pixel_total : 56548 time to create 1 rle with old method : 0.062123775482177734 length of segment : 251 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 229.00000 molded_images shape: (1, 640, 640, 3) min: -102.08281 max: 90.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.06719 max: 146.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.0001571178436279297 nb_pixel_total : 9689 time to create 1 rle with old method : 0.010535478591918945 length of segment : 127 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 1197 time to create 1 rle with old method : 0.001394510269165039 length of segment : 42 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 18 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.57109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0007250308990478516 length of segment : 19 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002779960632324219 length of segment : 11 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.000354766845703125 length of segment : 15 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0007922649383544922 length of segment : 19 time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 18156 time to create 1 rle with old method : 0.021871089935302734 length of segment : 207 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.06328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 1831 time to create 1 rle with old method : 0.002928018569946289 length of segment : 117 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 2314 time to create 1 rle with old method : 0.0030472278594970703 length of segment : 33 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 972 time to create 1 rle with old method : 0.00173187255859375 length of segment : 43 time for calcul the mask position with numpy : 0.0010900497436523438 nb_pixel_total : 8336 time to create 1 rle with old method : 0.009859800338745117 length of segment : 77 time for calcul the mask position with numpy : 0.00020432472229003906 nb_pixel_total : 8567 time to create 1 rle with old method : 0.014648199081420898 length of segment : 70 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0006103515625 length of segment : 30 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 1148 time to create 1 rle with old method : 0.002038717269897461 length of segment : 150 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00040650367736816406 length of segment : 28 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.0009870529174804688 length of segment : 44 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1335 time to create 1 rle with old method : 0.001678466796875 length of segment : 69 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00023031234741210938 length of segment : 19 time for calcul the mask position with numpy : 0.0002627372741699219 nb_pixel_total : 4546 time to create 1 rle with old method : 0.00823521614074707 length of segment : 210 time for calcul the mask position with numpy : 0.00020933151245117188 nb_pixel_total : 2554 time to create 1 rle with old method : 0.004589080810546875 length of segment : 217 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.0005929470062255859 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 3.00000 max: 207.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 86.16641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.001177072525024414 nb_pixel_total : 106079 time to create 1 rle with old method : 0.12792396545410156 length of segment : 283 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0005261898040771484 length of segment : 18 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 345 time to create 1 rle with old method : 0.0007030963897705078 length of segment : 50 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.36953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003190040588378906 length of segment : 20 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0017559528350830078 length of segment : 87 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0004248619079589844 length of segment : 18 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 2974 time to create 1 rle with old method : 0.0036611557006835938 length of segment : 48 time for calcul the mask position with numpy : 0.00011920928955078125 nb_pixel_total : 3455 time to create 1 rle with old method : 0.004592418670654297 length of segment : 86 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 38 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 566 time to create 1 rle with old method : 0.0007350444793701172 length of segment : 40 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 1494 time to create 1 rle with old method : 0.0019736289978027344 length of segment : 37 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 3238 time to create 1 rle with old method : 0.004154682159423828 length of segment : 59 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 20 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 2753 time to create 1 rle with old method : 0.0034863948822021484 length of segment : 80 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.22109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005431175231933594 length of segment : 29 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.00044155120849609375 length of segment : 18 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002224445343017578 length of segment : 20 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0005946159362792969 length of segment : 28 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003361701965332031 length of segment : 15 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00015687942504882812 length of segment : 7 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007774829864501953 length of segment : 28 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 3024 time to create 1 rle with old method : 0.0037713050842285156 length of segment : 53 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.0003495216369628906 length of segment : 20 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001475811004638672 length of segment : 12 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.00032973289489746094 length of segment : 13 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004315376281738281 length of segment : 22 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00019049644470214844 length of segment : 15 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002319812774658203 length of segment : 14 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004782676696777344 length of segment : 19 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005590915679931641 length of segment : 28 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1898 time to create 1 rle with old method : 0.0022804737091064453 length of segment : 65 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006444454193115234 length of segment : 38 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0015861988067626953 length of segment : 38 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 910 time to create 1 rle with old method : 0.001142740249633789 length of segment : 47 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005395412445068359 length of segment : 23 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.00048279762268066406 length of segment : 22 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 993 time to create 1 rle with old method : 0.0011985301971435547 length of segment : 50 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1772 time to create 1 rle with old method : 0.0021104812622070312 length of segment : 60 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0007014274597167969 length of segment : 34 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1111 time to create 1 rle with old method : 0.0013742446899414062 length of segment : 44 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003724098205566406 length of segment : 28 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004534721374511719 length of segment : 34 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 863 time to create 1 rle with old method : 0.001100778579711914 length of segment : 67 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 17 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1137 time to create 1 rle with old method : 0.001401662826538086 length of segment : 43 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 2015 time to create 1 rle with old method : 0.0025234222412109375 length of segment : 80 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.0011138916015625 length of segment : 90 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 14 time to create 1 rle with old method : 7.224082946777344e-05 length of segment : 10 Detection mask done ! Trying to reset tf kernel 2989530 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3312 tf kernel not reseted sub process len(results) : 505 len(list_Values) 505 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 505 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4505 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 505 chid ids of type : 4228 Number RLEs to save : 25245 save missing photos in datou_result : time spend for datou_step_exec : 34.21141219139099 time spend to save output : 1.6901278495788574 total time spend for step 1 : 35.90154004096985 step2:brightness Fri Feb 28 21:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740774030_2988758_1340208819_2593c65ba030a722c3b39f5ba87c46bc.jpg treat image : temp/1740774030_2988758_1340208048_89bf6b8ee89fb89e353ae20aab7e4699.jpg treat image : temp/1740774030_2988758_1340207963_f59c57b137e4b7195af7ccd63756a08e.jpg treat image : temp/1740774030_2988758_1340207853_86c2e53e4bf67c579bd5ced660cedf3e.jpg treat image : temp/1740774030_2988758_1340207753_199760c9bebfb740798d343052f9a8ce.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.012262344360351562 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.012041330337524414 save missing photos in datou_result : time spend for datou_step_exec : 1.2350399494171143 time spend to save output : 0.029569149017333984 total time spend for step 2 : 1.2646090984344482 step3:blur_detection Fri Feb 28 21:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740774030_2988758_1340208819_2593c65ba030a722c3b39f5ba87c46bc.jpg resize: (1080, 1920) 1340208819 -7.727924891912349 treat image : temp/1740774030_2988758_1340208048_89bf6b8ee89fb89e353ae20aab7e4699.jpg resize: (1080, 1920) 1340208048 -7.724580990112039 treat image : temp/1740774030_2988758_1340207963_f59c57b137e4b7195af7ccd63756a08e.jpg resize: (1080, 1920) 1340207963 -7.717025283121189 treat image : temp/1740774030_2988758_1340207853_86c2e53e4bf67c579bd5ced660cedf3e.jpg resize: (1080, 1920) 1340207853 -7.714295046843347 treat image : temp/1740774030_2988758_1340207753_199760c9bebfb740798d343052f9a8ce.jpg resize: (1080, 1920) 1340207753 -7.715071132399132 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.012634038925170898 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.012640237808227539 save missing photos in datou_result : time spend for datou_step_exec : 5.081032991409302 time spend to save output : 0.030421018600463867 total time spend for step 3 : 5.111454010009766 step4:rle_unique_nms_with_priority Fri Feb 28 21:21:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 505 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 95 nb_hashtags : 6 time to prepare the origin masks : 1.1359436511993408 time for calcul the mask position with numpy : 0.7270817756652832 nb_pixel_total : 1903402 time to create 1 rle with new method : 0.18230700492858887 time for calcul the mask position with numpy : 0.010280132293701172 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006222724914550781 time for calcul the mask position with numpy : 0.00865483283996582 nb_pixel_total : 2745 time to create 1 rle with old method : 0.0038361549377441406 time for calcul the mask position with numpy : 0.010671854019165039 nb_pixel_total : 516 time to create 1 rle with old method : 0.0007965564727783203 time for calcul the mask position with numpy : 0.008832454681396484 nb_pixel_total : 944 time to create 1 rle with old method : 0.0011305809020996094 time for calcul the mask position with numpy : 0.01585531234741211 nb_pixel_total : 64323 time to create 1 rle with old method : 0.07558727264404297 time for calcul the mask position with numpy : 0.00872802734375 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0013227462768554688 time for calcul the mask position with numpy : 0.008666515350341797 nb_pixel_total : 805 time to create 1 rle with old method : 0.000949859619140625 time for calcul the mask position with numpy : 0.008784294128417969 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003037452697753906 time for calcul the mask position with numpy : 0.00868678092956543 nb_pixel_total : 893 time to create 1 rle with old method : 0.0010750293731689453 time for calcul the mask position with numpy : 0.00884103775024414 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005567073822021484 time for calcul the mask position with numpy : 0.00881052017211914 nb_pixel_total : 1387 time to create 1 rle with old method : 0.0015745162963867188 time for calcul the mask position with numpy : 0.008820056915283203 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007190704345703125 time for calcul the mask position with numpy : 0.008772611618041992 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0014002323150634766 time for calcul the mask position with numpy : 0.008750438690185547 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005834102630615234 time for calcul the mask position with numpy : 0.009173393249511719 nb_pixel_total : 597 time to create 1 rle with old method : 0.0008721351623535156 time for calcul the mask position with numpy : 0.010442972183227539 nb_pixel_total : 1781 time to create 1 rle with old method : 0.002044677734375 time for calcul the mask position with numpy : 0.008561372756958008 nb_pixel_total : 260 time to create 1 rle with old method : 0.000392913818359375 time for calcul the mask position with numpy : 0.010573387145996094 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003676414489746094 time for calcul the mask position with numpy : 0.008647441864013672 nb_pixel_total : 773 time to create 1 rle with old method : 0.0008907318115234375 time for calcul the mask position with numpy : 0.008486032485961914 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001800060272216797 time for calcul the mask position with numpy : 0.008539199829101562 nb_pixel_total : 834 time to create 1 rle with old method : 0.0009632110595703125 time for calcul the mask position with numpy : 0.010579109191894531 nb_pixel_total : 49 time to create 1 rle with old method : 0.00013756752014160156 time for calcul the mask position with numpy : 0.00913381576538086 nb_pixel_total : 547 time to create 1 rle with old method : 0.0006775856018066406 time for calcul the mask position with numpy : 0.008736371994018555 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005624294281005859 time for calcul the mask position with numpy : 0.010085105895996094 nb_pixel_total : 4 time to create 1 rle with old method : 7.486343383789062e-05 time for calcul the mask position with numpy : 0.010848045349121094 nb_pixel_total : 1740 time to create 1 rle with old method : 0.002501249313354492 time for calcul the mask position with numpy : 0.00848698616027832 nb_pixel_total : 140 time to create 1 rle with old method : 0.00017189979553222656 time for calcul the mask position with numpy : 0.008445262908935547 nb_pixel_total : 7 time to create 1 rle with old method : 2.6464462280273438e-05 time for calcul the mask position with numpy : 0.008405685424804688 nb_pixel_total : 414 time to create 1 rle with old method : 0.0004913806915283203 time for calcul the mask position with numpy : 0.008537769317626953 nb_pixel_total : 26499 time to create 1 rle with old method : 0.033830881118774414 time for calcul the mask position with numpy : 0.008734464645385742 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002181529998779297 time for calcul the mask position with numpy : 0.008727788925170898 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001361370086669922 time for calcul the mask position with numpy : 0.01054692268371582 nb_pixel_total : 8987 time to create 1 rle with old method : 0.01105809211730957 time for calcul the mask position with numpy : 0.013157367706298828 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005919933319091797 time for calcul the mask position with numpy : 0.00847625732421875 nb_pixel_total : 383 time to create 1 rle with old method : 0.0004200935363769531 time for calcul the mask position with numpy : 0.00798797607421875 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010683536529541016 time for calcul the mask position with numpy : 0.008471965789794922 nb_pixel_total : 981 time to create 1 rle with old method : 0.0011191368103027344 time for calcul the mask position with numpy : 0.008098602294921875 nb_pixel_total : 561 time to create 1 rle with old method : 0.0006010532379150391 time for calcul the mask position with numpy : 0.008307218551635742 nb_pixel_total : 1960 time to create 1 rle with old method : 0.002201080322265625 time for calcul the mask position with numpy : 0.008302688598632812 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0013582706451416016 time for calcul the mask position with numpy : 0.008439779281616211 nb_pixel_total : 86 time to create 1 rle with old method : 0.00010776519775390625 time for calcul the mask position with numpy : 0.00831913948059082 nb_pixel_total : 1615 time to create 1 rle with old method : 0.001790761947631836 time for calcul the mask position with numpy : 0.008033990859985352 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002684593200683594 time for calcul the mask position with numpy : 0.007932901382446289 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0011661052703857422 time for calcul the mask position with numpy : 0.007982730865478516 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005049705505371094 time for calcul the mask position with numpy : 0.008033037185668945 nb_pixel_total : 1422 time to create 1 rle with old method : 0.0015957355499267578 time for calcul the mask position with numpy : 0.008242130279541016 nb_pixel_total : 8469 time to create 1 rle with old method : 0.009278297424316406 time for calcul the mask position with numpy : 0.00847482681274414 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003085136413574219 time for calcul the mask position with numpy : 0.00844573974609375 nb_pixel_total : 229 time to create 1 rle with old method : 0.00026488304138183594 time for calcul the mask position with numpy : 0.00828862190246582 nb_pixel_total : 7 time to create 1 rle with old method : 3.170967102050781e-05 time for calcul the mask position with numpy : 0.008394479751586914 nb_pixel_total : 115 time to create 1 rle with old method : 0.00013446807861328125 time for calcul the mask position with numpy : 0.008302688598632812 nb_pixel_total : 155 time to create 1 rle with old method : 0.00017881393432617188 time for calcul the mask position with numpy : 0.008200645446777344 nb_pixel_total : 251 time to create 1 rle with old method : 0.0002727508544921875 time for calcul the mask position with numpy : 0.008349180221557617 nb_pixel_total : 20 time to create 1 rle with old method : 6.008148193359375e-05 time for calcul the mask position with numpy : 0.008254051208496094 nb_pixel_total : 914 time to create 1 rle with old method : 0.0010352134704589844 time for calcul the mask position with numpy : 0.008247852325439453 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003190040588378906 time for calcul the mask position with numpy : 0.008074522018432617 nb_pixel_total : 644 time to create 1 rle with old method : 0.0006871223449707031 time for calcul the mask position with numpy : 0.008313894271850586 nb_pixel_total : 89 time to create 1 rle with old method : 0.00010180473327636719 time for calcul the mask position with numpy : 0.008127689361572266 nb_pixel_total : 209 time to create 1 rle with old method : 0.00022411346435546875 time for calcul the mask position with numpy : 0.008004426956176758 nb_pixel_total : 93 time to create 1 rle with old method : 0.00011706352233886719 time for calcul the mask position with numpy : 0.009510517120361328 nb_pixel_total : 181 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.008300304412841797 nb_pixel_total : 219 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.008641719818115234 nb_pixel_total : 412 time to create 1 rle with old method : 0.0007026195526123047 time for calcul the mask position with numpy : 0.008355855941772461 nb_pixel_total : 2103 time to create 1 rle with old method : 0.0022974014282226562 time for calcul the mask position with numpy : 0.00823354721069336 nb_pixel_total : 393 time to create 1 rle with old method : 0.0004410743713378906 time for calcul the mask position with numpy : 0.008077859878540039 nb_pixel_total : 63 time to create 1 rle with old method : 0.00010824203491210938 time for calcul the mask position with numpy : 0.008205175399780273 nb_pixel_total : 72 time to create 1 rle with old method : 8.940696716308594e-05 time for calcul the mask position with numpy : 0.008059501647949219 nb_pixel_total : 367 time to create 1 rle with old method : 0.00039267539978027344 time for calcul the mask position with numpy : 0.008176326751708984 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011539459228515625 time for calcul the mask position with numpy : 0.008399009704589844 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0013537406921386719 time for calcul the mask position with numpy : 0.008416175842285156 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005307197570800781 time for calcul the mask position with numpy : 0.008771181106567383 nb_pixel_total : 46 time to create 1 rle with old method : 0.00010633468627929688 time for calcul the mask position with numpy : 0.008398771286010742 nb_pixel_total : 3312 time to create 1 rle with old method : 0.003688812255859375 time for calcul the mask position with numpy : 0.00834965705871582 nb_pixel_total : 6125 time to create 1 rle with old method : 0.006724834442138672 time for calcul the mask position with numpy : 0.008365154266357422 nb_pixel_total : 36 time to create 1 rle with old method : 8.654594421386719e-05 time for calcul the mask position with numpy : 0.008373737335205078 nb_pixel_total : 1757 time to create 1 rle with old method : 0.001965045928955078 time for calcul the mask position with numpy : 0.008247137069702148 nb_pixel_total : 400 time to create 1 rle with old method : 0.0004749298095703125 time for calcul the mask position with numpy : 0.008197784423828125 nb_pixel_total : 266 time to create 1 rle with old method : 0.00030612945556640625 time for calcul the mask position with numpy : 0.00864100456237793 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002624988555908203 time for calcul the mask position with numpy : 0.00829172134399414 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005083084106445312 time for calcul the mask position with numpy : 0.008120059967041016 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002541542053222656 time for calcul the mask position with numpy : 0.00838780403137207 nb_pixel_total : 329 time to create 1 rle with old method : 0.0003998279571533203 time for calcul the mask position with numpy : 0.008310556411743164 nb_pixel_total : 220 time to create 1 rle with old method : 0.0002510547637939453 time for calcul the mask position with numpy : 0.00822901725769043 nb_pixel_total : 1737 time to create 1 rle with old method : 0.0019288063049316406 time for calcul the mask position with numpy : 0.008153200149536133 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0012466907501220703 time for calcul the mask position with numpy : 0.00823354721069336 nb_pixel_total : 1168 time to create 1 rle with old method : 0.0012886524200439453 time for calcul the mask position with numpy : 0.008091449737548828 nb_pixel_total : 46 time to create 1 rle with old method : 7.700920104980469e-05 time for calcul the mask position with numpy : 0.008188247680664062 nb_pixel_total : 104 time to create 1 rle with old method : 0.00011444091796875 time for calcul the mask position with numpy : 0.0081939697265625 nb_pixel_total : 370 time to create 1 rle with old method : 0.00042128562927246094 time for calcul the mask position with numpy : 0.008428573608398438 nb_pixel_total : 1531 time to create 1 rle with old method : 0.0023877620697021484 time for calcul the mask position with numpy : 0.008362770080566406 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0013728141784667969 time for calcul the mask position with numpy : 0.008386850357055664 nb_pixel_total : 188 time to create 1 rle with old method : 0.00020647048950195312 time for calcul the mask position with numpy : 0.008057355880737305 nb_pixel_total : 772 time to create 1 rle with old method : 0.0008120536804199219 time for calcul the mask position with numpy : 0.008194684982299805 nb_pixel_total : 38 time to create 1 rle with old method : 4.887580871582031e-05 time for calcul the mask position with numpy : 0.008157730102539062 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003178119659423828 create new chi : 1.9564387798309326 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.00667572021484375 batch 1 Loaded 96 chid ids of type : 4230 Number RLEs to save : 8326 TO DO : save crop sub photo not yet done ! save time : 0.5023379325866699 nb_obj : 96 nb_hashtags : 7 time to prepare the origin masks : 2.1973626613616943 time for calcul the mask position with numpy : 0.11259245872497559 nb_pixel_total : 1903062 time to create 1 rle with new method : 0.1417837142944336 time for calcul the mask position with numpy : 0.009001731872558594 nb_pixel_total : 4411 time to create 1 rle with old method : 0.005105018615722656 time for calcul the mask position with numpy : 0.009117841720581055 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004591941833496094 time for calcul the mask position with numpy : 0.009302139282226562 nb_pixel_total : 805 time to create 1 rle with old method : 0.0009472370147705078 time for calcul the mask position with numpy : 0.009059906005859375 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006084442138671875 time for calcul the mask position with numpy : 0.008577823638916016 nb_pixel_total : 254 time to create 1 rle with old method : 0.00032639503479003906 time for calcul the mask position with numpy : 0.012866735458374023 nb_pixel_total : 77 time to create 1 rle with old method : 0.00014853477478027344 time for calcul the mask position with numpy : 0.012927055358886719 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001881122589111328 time for calcul the mask position with numpy : 0.012911081314086914 nb_pixel_total : 953 time to create 1 rle with old method : 0.001112222671508789 time for calcul the mask position with numpy : 0.012782573699951172 nb_pixel_total : 1350 time to create 1 rle with old method : 0.0015974044799804688 time for calcul the mask position with numpy : 0.01284933090209961 nb_pixel_total : 860 time to create 1 rle with old method : 0.0010097026824951172 time for calcul the mask position with numpy : 0.010500192642211914 nb_pixel_total : 163 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.013411283493041992 nb_pixel_total : 1700 time to create 1 rle with old method : 0.0020918846130371094 time for calcul the mask position with numpy : 0.013296127319335938 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.012606143951416016 nb_pixel_total : 1032 time to create 1 rle with old method : 0.0012960433959960938 time for calcul the mask position with numpy : 0.01271200180053711 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001666545867919922 time for calcul the mask position with numpy : 0.01287984848022461 nb_pixel_total : 258 time to create 1 rle with old method : 0.00036263465881347656 time for calcul the mask position with numpy : 0.012967824935913086 nb_pixel_total : 561 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.012967109680175781 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006120204925537109 time for calcul the mask position with numpy : 0.012880802154541016 nb_pixel_total : 721 time to create 1 rle with old method : 0.0009813308715820312 time for calcul the mask position with numpy : 0.013152122497558594 nb_pixel_total : 1568 time to create 1 rle with old method : 0.0020186901092529297 time for calcul the mask position with numpy : 0.013096809387207031 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020241737365722656 time for calcul the mask position with numpy : 0.013227462768554688 nb_pixel_total : 1060 time to create 1 rle with old method : 0.0013544559478759766 time for calcul the mask position with numpy : 0.013158321380615234 nb_pixel_total : 572 time to create 1 rle with old method : 0.0007357597351074219 time for calcul the mask position with numpy : 0.013164520263671875 nb_pixel_total : 236 time to create 1 rle with old method : 0.00033211708068847656 time for calcul the mask position with numpy : 0.013165712356567383 nb_pixel_total : 521 time to create 1 rle with old method : 0.0007686614990234375 time for calcul the mask position with numpy : 0.01316690444946289 nb_pixel_total : 2669 time to create 1 rle with old method : 0.008203983306884766 time for calcul the mask position with numpy : 0.013243913650512695 nb_pixel_total : 2019 time to create 1 rle with old method : 0.0025703907012939453 time for calcul the mask position with numpy : 0.013119697570800781 nb_pixel_total : 5801 time to create 1 rle with old method : 0.0065424442291259766 time for calcul the mask position with numpy : 0.013429403305053711 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005745887756347656 time for calcul the mask position with numpy : 0.013621330261230469 nb_pixel_total : 1278 time to create 1 rle with old method : 0.001477956771850586 time for calcul the mask position with numpy : 0.013605594635009766 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007371902465820312 time for calcul the mask position with numpy : 0.013560771942138672 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003325939178466797 time for calcul the mask position with numpy : 0.007883548736572266 nb_pixel_total : 41 time to create 1 rle with old method : 0.00011324882507324219 time for calcul the mask position with numpy : 0.007872819900512695 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006952285766601562 time for calcul the mask position with numpy : 0.007919549942016602 nb_pixel_total : 1573 time to create 1 rle with old method : 0.0017840862274169922 time for calcul the mask position with numpy : 0.008207321166992188 nb_pixel_total : 25590 time to create 1 rle with old method : 0.02971053123474121 time for calcul the mask position with numpy : 0.008330821990966797 nb_pixel_total : 3938 time to create 1 rle with old method : 0.004814624786376953 time for calcul the mask position with numpy : 0.008143901824951172 nb_pixel_total : 7824 time to create 1 rle with old method : 0.009183645248413086 time for calcul the mask position with numpy : 0.008509397506713867 nb_pixel_total : 13 time to create 1 rle with old method : 6.103515625e-05 time for calcul the mask position with numpy : 0.008056640625 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004658699035644531 time for calcul the mask position with numpy : 0.008462190628051758 nb_pixel_total : 398 time to create 1 rle with old method : 0.0006229877471923828 time for calcul the mask position with numpy : 0.008176565170288086 nb_pixel_total : 953 time to create 1 rle with old method : 0.0011496543884277344 time for calcul the mask position with numpy : 0.00803375244140625 nb_pixel_total : 2135 time to create 1 rle with old method : 0.002468585968017578 time for calcul the mask position with numpy : 0.008115291595458984 nb_pixel_total : 733 time to create 1 rle with old method : 0.0009338855743408203 time for calcul the mask position with numpy : 0.008775711059570312 nb_pixel_total : 15799 time to create 1 rle with old method : 0.01865363121032715 time for calcul the mask position with numpy : 0.009230852127075195 nb_pixel_total : 585 time to create 1 rle with old method : 0.0008080005645751953 time for calcul the mask position with numpy : 0.00919961929321289 nb_pixel_total : 1505 time to create 1 rle with old method : 0.0017142295837402344 time for calcul the mask position with numpy : 0.009685516357421875 nb_pixel_total : 8664 time to create 1 rle with old method : 0.011451482772827148 time for calcul the mask position with numpy : 0.008209943771362305 nb_pixel_total : 776 time to create 1 rle with old method : 0.0009577274322509766 time for calcul the mask position with numpy : 0.008016347885131836 nb_pixel_total : 107 time to create 1 rle with old method : 0.00016999244689941406 time for calcul the mask position with numpy : 0.007968902587890625 nb_pixel_total : 120 time to create 1 rle with old method : 0.00031685829162597656 time for calcul the mask position with numpy : 0.007985353469848633 nb_pixel_total : 210 time to create 1 rle with old method : 0.00029540061950683594 time for calcul the mask position with numpy : 0.008020401000976562 nb_pixel_total : 329 time to create 1 rle with old method : 0.00044035911560058594 time for calcul the mask position with numpy : 0.007982015609741211 nb_pixel_total : 12 time to create 1 rle with old method : 6.67572021484375e-05 time for calcul the mask position with numpy : 0.008371353149414062 nb_pixel_total : 39397 time to create 1 rle with old method : 0.04810047149658203 time for calcul the mask position with numpy : 0.007953882217407227 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004894733428955078 time for calcul the mask position with numpy : 0.013305425643920898 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005528926849365234 time for calcul the mask position with numpy : 0.013337373733520508 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003504753112792969 time for calcul the mask position with numpy : 0.01318669319152832 nb_pixel_total : 70 time to create 1 rle with old method : 0.00011372566223144531 time for calcul the mask position with numpy : 0.013245105743408203 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005047321319580078 time for calcul the mask position with numpy : 0.013260364532470703 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001571178436279297 time for calcul the mask position with numpy : 0.01345515251159668 nb_pixel_total : 192 time to create 1 rle with old method : 0.00024700164794921875 time for calcul the mask position with numpy : 0.01337122917175293 nb_pixel_total : 173 time to create 1 rle with old method : 0.00023818016052246094 time for calcul the mask position with numpy : 0.013313770294189453 nb_pixel_total : 3202 time to create 1 rle with old method : 0.0035893917083740234 time for calcul the mask position with numpy : 0.013941526412963867 nb_pixel_total : 545 time to create 1 rle with old method : 0.0006990432739257812 time for calcul the mask position with numpy : 0.015083074569702148 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004630088806152344 time for calcul the mask position with numpy : 0.014700889587402344 nb_pixel_total : 1016 time to create 1 rle with old method : 0.0013761520385742188 time for calcul the mask position with numpy : 0.015519857406616211 nb_pixel_total : 27 time to create 1 rle with old method : 0.00029158592224121094 time for calcul the mask position with numpy : 0.014185905456542969 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006854534149169922 time for calcul the mask position with numpy : 0.013147115707397461 nb_pixel_total : 1386 time to create 1 rle with old method : 0.0016679763793945312 time for calcul the mask position with numpy : 0.013154745101928711 nb_pixel_total : 46 time to create 1 rle with old method : 0.00011754035949707031 time for calcul the mask position with numpy : 0.013031005859375 nb_pixel_total : 74 time to create 1 rle with old method : 0.000152587890625 time for calcul the mask position with numpy : 0.008058547973632812 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0014712810516357422 time for calcul the mask position with numpy : 0.008015155792236328 nb_pixel_total : 2192 time to create 1 rle with old method : 0.002524852752685547 time for calcul the mask position with numpy : 0.008033037185668945 nb_pixel_total : 584 time to create 1 rle with old method : 0.0007245540618896484 time for calcul the mask position with numpy : 0.00825357437133789 nb_pixel_total : 680 time to create 1 rle with old method : 0.0009081363677978516 time for calcul the mask position with numpy : 0.008497238159179688 nb_pixel_total : 149 time to create 1 rle with old method : 0.00022983551025390625 time for calcul the mask position with numpy : 0.008345842361450195 nb_pixel_total : 1881 time to create 1 rle with old method : 0.0023355484008789062 time for calcul the mask position with numpy : 0.008389711380004883 nb_pixel_total : 11 time to create 1 rle with old method : 8.630752563476562e-05 time for calcul the mask position with numpy : 0.008252143859863281 nb_pixel_total : 75 time to create 1 rle with old method : 0.0001430511474609375 time for calcul the mask position with numpy : 0.00834035873413086 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007119178771972656 time for calcul the mask position with numpy : 0.008121252059936523 nb_pixel_total : 1570 time to create 1 rle with old method : 0.0018999576568603516 time for calcul the mask position with numpy : 0.008432388305664062 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003745555877685547 time for calcul the mask position with numpy : 0.00862741470336914 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003695487976074219 time for calcul the mask position with numpy : 0.00931692123413086 nb_pixel_total : 23 time to create 1 rle with old method : 0.00011134147644042969 time for calcul the mask position with numpy : 0.009550094604492188 nb_pixel_total : 1098 time to create 1 rle with old method : 0.001458883285522461 time for calcul the mask position with numpy : 0.008228778839111328 nb_pixel_total : 13 time to create 1 rle with old method : 9.822845458984375e-05 time for calcul the mask position with numpy : 0.008050680160522461 nb_pixel_total : 90 time to create 1 rle with old method : 0.00014710426330566406 time for calcul the mask position with numpy : 0.00802159309387207 nb_pixel_total : 5 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.008098363876342773 nb_pixel_total : 966 time to create 1 rle with old method : 0.0012927055358886719 time for calcul the mask position with numpy : 0.008018970489501953 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005691051483154297 time for calcul the mask position with numpy : 0.008222341537475586 nb_pixel_total : 2855 time to create 1 rle with old method : 0.0036728382110595703 time for calcul the mask position with numpy : 0.008167505264282227 nb_pixel_total : 1563 time to create 1 rle with old method : 0.0020904541015625 time for calcul the mask position with numpy : 0.008001089096069336 nb_pixel_total : 364 time to create 1 rle with old method : 0.0005002021789550781 time for calcul the mask position with numpy : 0.008895635604858398 nb_pixel_total : 1004 time to create 1 rle with old method : 0.001340627670288086 time for calcul the mask position with numpy : 0.009004831314086914 nb_pixel_total : 3 time to create 1 rle with old method : 4.100799560546875e-05 create new chi : 1.5011224746704102 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0024476051330566406 batch 1 Loaded 97 chid ids of type : 4230 Number RLEs to save : 9594 TO DO : save crop sub photo not yet done ! save time : 0.5690569877624512 nb_obj : 108 nb_hashtags : 6 time to prepare the origin masks : 1.4835467338562012 time for calcul the mask position with numpy : 0.07464432716369629 nb_pixel_total : 1837452 time to create 1 rle with new method : 0.09142518043518066 time for calcul the mask position with numpy : 0.007241010665893555 nb_pixel_total : 856 time to create 1 rle with old method : 0.0009691715240478516 time for calcul the mask position with numpy : 0.006425619125366211 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005033016204833984 time for calcul the mask position with numpy : 0.006335258483886719 nb_pixel_total : 776 time to create 1 rle with old method : 0.0009076595306396484 time for calcul the mask position with numpy : 0.006602764129638672 nb_pixel_total : 56130 time to create 1 rle with old method : 0.061943769454956055 time for calcul the mask position with numpy : 0.006264686584472656 nb_pixel_total : 112 time to create 1 rle with old method : 0.00024127960205078125 time for calcul the mask position with numpy : 0.010279178619384766 nb_pixel_total : 948 time to create 1 rle with old method : 0.0010960102081298828 time for calcul the mask position with numpy : 0.010223865509033203 nb_pixel_total : 803 time to create 1 rle with old method : 0.0009224414825439453 time for calcul the mask position with numpy : 0.010205984115600586 nb_pixel_total : 912 time to create 1 rle with old method : 0.001032114028930664 time for calcul the mask position with numpy : 0.010075092315673828 nb_pixel_total : 56 time to create 1 rle with old method : 8.797645568847656e-05 time for calcul the mask position with numpy : 0.010133981704711914 nb_pixel_total : 35 time to create 1 rle with old method : 8.511543273925781e-05 time for calcul the mask position with numpy : 0.010201454162597656 nb_pixel_total : 9542 time to create 1 rle with old method : 0.01077890396118164 time for calcul the mask position with numpy : 0.010010480880737305 nb_pixel_total : 1945 time to create 1 rle with old method : 0.003995656967163086 time for calcul the mask position with numpy : 0.007204532623291016 nb_pixel_total : 39 time to create 1 rle with old method : 6.628036499023438e-05 time for calcul the mask position with numpy : 0.006272315979003906 nb_pixel_total : 30 time to create 1 rle with old method : 6.937980651855469e-05 time for calcul the mask position with numpy : 0.0062215328216552734 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001270771026611328 time for calcul the mask position with numpy : 0.006278514862060547 nb_pixel_total : 1234 time to create 1 rle with old method : 0.0013689994812011719 time for calcul the mask position with numpy : 0.006108283996582031 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006303787231445312 time for calcul the mask position with numpy : 0.00615692138671875 nb_pixel_total : 874 time to create 1 rle with old method : 0.0010464191436767578 time for calcul the mask position with numpy : 0.006222248077392578 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006775856018066406 time for calcul the mask position with numpy : 0.006291389465332031 nb_pixel_total : 254 time to create 1 rle with old method : 0.00030803680419921875 time for calcul the mask position with numpy : 0.006428718566894531 nb_pixel_total : 2 time to create 1 rle with old method : 2.3365020751953125e-05 time for calcul the mask position with numpy : 0.006682872772216797 nb_pixel_total : 9593 time to create 1 rle with old method : 0.013894319534301758 time for calcul the mask position with numpy : 0.007370710372924805 nb_pixel_total : 36 time to create 1 rle with old method : 0.00012111663818359375 time for calcul the mask position with numpy : 0.007141828536987305 nb_pixel_total : 291 time to create 1 rle with old method : 0.000576019287109375 time for calcul the mask position with numpy : 0.0068149566650390625 nb_pixel_total : 140 time to create 1 rle with old method : 0.00025463104248046875 time for calcul the mask position with numpy : 0.0067827701568603516 nb_pixel_total : 956 time to create 1 rle with old method : 0.0015902519226074219 time for calcul the mask position with numpy : 0.006804466247558594 nb_pixel_total : 948 time to create 1 rle with old method : 0.0015780925750732422 time for calcul the mask position with numpy : 0.006735563278198242 nb_pixel_total : 10 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.006760120391845703 nb_pixel_total : 47 time to create 1 rle with old method : 0.00013065338134765625 time for calcul the mask position with numpy : 0.006680011749267578 nb_pixel_total : 469 time to create 1 rle with old method : 0.0008180141448974609 time for calcul the mask position with numpy : 0.006789684295654297 nb_pixel_total : 447 time to create 1 rle with old method : 0.0008168220520019531 time for calcul the mask position with numpy : 0.00671696662902832 nb_pixel_total : 102 time to create 1 rle with old method : 0.00025200843811035156 time for calcul the mask position with numpy : 0.006885051727294922 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002620220184326172 time for calcul the mask position with numpy : 0.006799936294555664 nb_pixel_total : 26788 time to create 1 rle with old method : 0.03093409538269043 time for calcul the mask position with numpy : 0.006478786468505859 nb_pixel_total : 4845 time to create 1 rle with old method : 0.005819559097290039 time for calcul the mask position with numpy : 0.006747245788574219 nb_pixel_total : 41112 time to create 1 rle with old method : 0.08226227760314941 time for calcul the mask position with numpy : 0.007085561752319336 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006020069122314453 time for calcul the mask position with numpy : 0.006716012954711914 nb_pixel_total : 912 time to create 1 rle with old method : 0.0010428428649902344 time for calcul the mask position with numpy : 0.006796360015869141 nb_pixel_total : 280 time to create 1 rle with old method : 0.00034809112548828125 time for calcul the mask position with numpy : 0.01513361930847168 nb_pixel_total : 8213 time to create 1 rle with old method : 0.011844396591186523 time for calcul the mask position with numpy : 0.011471748352050781 nb_pixel_total : 375 time to create 1 rle with old method : 0.00045418739318847656 time for calcul the mask position with numpy : 0.010744333267211914 nb_pixel_total : 5 time to create 1 rle with old method : 3.123283386230469e-05 time for calcul the mask position with numpy : 0.010364055633544922 nb_pixel_total : 4541 time to create 1 rle with old method : 0.005354881286621094 time for calcul the mask position with numpy : 0.010268926620483398 nb_pixel_total : 1099 time to create 1 rle with old method : 0.0012867450714111328 time for calcul the mask position with numpy : 0.011728048324584961 nb_pixel_total : 374 time to create 1 rle with old method : 0.0006866455078125 time for calcul the mask position with numpy : 0.010718345642089844 nb_pixel_total : 2097 time to create 1 rle with old method : 0.0023102760314941406 time for calcul the mask position with numpy : 0.010368824005126953 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0015225410461425781 time for calcul the mask position with numpy : 0.010708093643188477 nb_pixel_total : 320 time to create 1 rle with old method : 0.00039577484130859375 time for calcul the mask position with numpy : 0.010591983795166016 nb_pixel_total : 57 time to create 1 rle with old method : 0.00010180473327636719 time for calcul the mask position with numpy : 0.010454893112182617 nb_pixel_total : 277 time to create 1 rle with old method : 0.00036907196044921875 time for calcul the mask position with numpy : 0.010598897933959961 nb_pixel_total : 111 time to create 1 rle with old method : 0.00024962425231933594 time for calcul the mask position with numpy : 0.01090097427368164 nb_pixel_total : 166 time to create 1 rle with old method : 0.00022864341735839844 time for calcul the mask position with numpy : 0.012028932571411133 nb_pixel_total : 445 time to create 1 rle with old method : 0.0006818771362304688 time for calcul the mask position with numpy : 0.011129140853881836 nb_pixel_total : 1564 time to create 1 rle with old method : 0.0017583370208740234 time for calcul the mask position with numpy : 0.010495901107788086 nb_pixel_total : 257 time to create 1 rle with old method : 0.00030159950256347656 time for calcul the mask position with numpy : 0.006290435791015625 nb_pixel_total : 5 time to create 1 rle with old method : 4.00543212890625e-05 time for calcul the mask position with numpy : 0.006107330322265625 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005023479461669922 time for calcul the mask position with numpy : 0.0067844390869140625 nb_pixel_total : 8134 time to create 1 rle with old method : 0.010796546936035156 time for calcul the mask position with numpy : 0.0070629119873046875 nb_pixel_total : 275 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.007002115249633789 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.007020711898803711 nb_pixel_total : 479 time to create 1 rle with old method : 0.0006134510040283203 time for calcul the mask position with numpy : 0.006463527679443359 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005645751953125 time for calcul the mask position with numpy : 0.006444692611694336 nb_pixel_total : 2 time to create 1 rle with old method : 2.09808349609375e-05 time for calcul the mask position with numpy : 0.006642818450927734 nb_pixel_total : 853 time to create 1 rle with old method : 0.001035451889038086 time for calcul the mask position with numpy : 0.006509065628051758 nb_pixel_total : 3705 time to create 1 rle with old method : 0.004151821136474609 time for calcul the mask position with numpy : 0.006438732147216797 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005085468292236328 time for calcul the mask position with numpy : 0.0067865848541259766 nb_pixel_total : 275 time to create 1 rle with old method : 0.00036716461181640625 time for calcul the mask position with numpy : 0.008452653884887695 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007195472717285156 time for calcul the mask position with numpy : 0.007964134216308594 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005254745483398438 time for calcul the mask position with numpy : 0.009100198745727539 nb_pixel_total : 95 time to create 1 rle with old method : 0.00013589859008789062 time for calcul the mask position with numpy : 0.008017778396606445 nb_pixel_total : 195 time to create 1 rle with old method : 0.00025177001953125 time for calcul the mask position with numpy : 0.008019685745239258 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002186298370361328 time for calcul the mask position with numpy : 0.007757425308227539 nb_pixel_total : 1679 time to create 1 rle with old method : 0.0018703937530517578 time for calcul the mask position with numpy : 0.0076313018798828125 nb_pixel_total : 3103 time to create 1 rle with old method : 0.00345611572265625 time for calcul the mask position with numpy : 0.007932662963867188 nb_pixel_total : 53 time to create 1 rle with old method : 0.00014781951904296875 time for calcul the mask position with numpy : 0.007791757583618164 nb_pixel_total : 918 time to create 1 rle with old method : 0.001087188720703125 time for calcul the mask position with numpy : 0.007624387741088867 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0012066364288330078 time for calcul the mask position with numpy : 0.008077144622802734 nb_pixel_total : 1365 time to create 1 rle with old method : 0.001735687255859375 time for calcul the mask position with numpy : 0.007512807846069336 nb_pixel_total : 3745 time to create 1 rle with old method : 0.00417327880859375 time for calcul the mask position with numpy : 0.007538795471191406 nb_pixel_total : 1203 time to create 1 rle with old method : 0.0013849735260009766 time for calcul the mask position with numpy : 0.0077860355377197266 nb_pixel_total : 1156 time to create 1 rle with old method : 0.001363992691040039 time for calcul the mask position with numpy : 0.0077288150787353516 nb_pixel_total : 131 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.007754325866699219 nb_pixel_total : 1725 time to create 1 rle with old method : 0.001978158950805664 time for calcul the mask position with numpy : 0.007542133331298828 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007829666137695312 time for calcul the mask position with numpy : 0.007437705993652344 nb_pixel_total : 99 time to create 1 rle with old method : 0.000186920166015625 time for calcul the mask position with numpy : 0.007584333419799805 nb_pixel_total : 576 time to create 1 rle with old method : 0.0006783008575439453 time for calcul the mask position with numpy : 0.0077745914459228516 nb_pixel_total : 1647 time to create 1 rle with old method : 0.0018870830535888672 time for calcul the mask position with numpy : 0.007878541946411133 nb_pixel_total : 2361 time to create 1 rle with old method : 0.002820253372192383 time for calcul the mask position with numpy : 0.008898496627807617 nb_pixel_total : 254 time to create 1 rle with old method : 0.00038051605224609375 time for calcul the mask position with numpy : 0.008298635482788086 nb_pixel_total : 221 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.007588624954223633 nb_pixel_total : 85 time to create 1 rle with old method : 0.00015091896057128906 time for calcul the mask position with numpy : 0.0078105926513671875 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0013294219970703125 time for calcul the mask position with numpy : 0.007975339889526367 nb_pixel_total : 1732 time to create 1 rle with old method : 0.0019268989562988281 time for calcul the mask position with numpy : 0.007784843444824219 nb_pixel_total : 29 time to create 1 rle with old method : 7.05718994140625e-05 time for calcul the mask position with numpy : 0.007842302322387695 nb_pixel_total : 91 time to create 1 rle with old method : 0.00015234947204589844 time for calcul the mask position with numpy : 0.0077667236328125 nb_pixel_total : 2855 time to create 1 rle with old method : 0.0034759044647216797 time for calcul the mask position with numpy : 0.00794219970703125 nb_pixel_total : 857 time to create 1 rle with old method : 0.001005411148071289 time for calcul the mask position with numpy : 0.008466005325317383 nb_pixel_total : 478 time to create 1 rle with old method : 0.0006208419799804688 time for calcul the mask position with numpy : 0.00850534439086914 nb_pixel_total : 476 time to create 1 rle with old method : 0.0005502700805664062 time for calcul the mask position with numpy : 0.01084756851196289 nb_pixel_total : 1558 time to create 1 rle with old method : 0.0017802715301513672 time for calcul the mask position with numpy : 0.008552074432373047 nb_pixel_total : 426 time to create 1 rle with old method : 0.0005717277526855469 time for calcul the mask position with numpy : 0.008494377136230469 nb_pixel_total : 794 time to create 1 rle with old method : 0.0010864734649658203 time for calcul the mask position with numpy : 0.008481264114379883 nb_pixel_total : 318 time to create 1 rle with old method : 0.00042438507080078125 time for calcul the mask position with numpy : 0.008447647094726562 nb_pixel_total : 902 time to create 1 rle with old method : 0.0011208057403564453 time for calcul the mask position with numpy : 0.008445262908935547 nb_pixel_total : 133 time to create 1 rle with old method : 0.00017499923706054688 time for calcul the mask position with numpy : 0.008400678634643555 nb_pixel_total : 45 time to create 1 rle with old method : 5.9604644775390625e-05 time for calcul the mask position with numpy : 0.008414745330810547 nb_pixel_total : 435 time to create 1 rle with old method : 0.00048732757568359375 time for calcul the mask position with numpy : 0.008513212203979492 nb_pixel_total : 75 time to create 1 rle with old method : 0.00010514259338378906 create new chi : 1.3708374500274658 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.002660036087036133 batch 1 Loaded 109 chid ids of type : 4230 Number RLEs to save : 11061 TO DO : save crop sub photo not yet done ! save time : 0.6947784423828125 nb_obj : 102 nb_hashtags : 7 time to prepare the origin masks : 1.928684949874878 time for calcul the mask position with numpy : 0.04669928550720215 nb_pixel_total : 1769630 time to create 1 rle with new method : 0.10615015029907227 time for calcul the mask position with numpy : 0.00820302963256836 nb_pixel_total : 3587 time to create 1 rle with old method : 0.004365444183349609 time for calcul the mask position with numpy : 0.008622407913208008 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003533363342285156 time for calcul the mask position with numpy : 0.013517141342163086 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006711483001708984 time for calcul the mask position with numpy : 0.014960527420043945 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007178783416748047 time for calcul the mask position with numpy : 0.013148069381713867 nb_pixel_total : 723 time to create 1 rle with old method : 0.0009484291076660156 time for calcul the mask position with numpy : 0.013266324996948242 nb_pixel_total : 211 time to create 1 rle with old method : 0.00035858154296875 time for calcul the mask position with numpy : 0.00815129280090332 nb_pixel_total : 897 time to create 1 rle with old method : 0.0011394023895263672 time for calcul the mask position with numpy : 0.008475303649902344 nb_pixel_total : 833 time to create 1 rle with old method : 0.0012030601501464844 time for calcul the mask position with numpy : 0.008959293365478516 nb_pixel_total : 62362 time to create 1 rle with old method : 0.06903839111328125 time for calcul the mask position with numpy : 0.0071485042572021484 nb_pixel_total : 45 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.007014274597167969 nb_pixel_total : 26 time to create 1 rle with old method : 6.985664367675781e-05 time for calcul the mask position with numpy : 0.006876230239868164 nb_pixel_total : 69 time to create 1 rle with old method : 0.00012111663818359375 time for calcul the mask position with numpy : 0.006959438323974609 nb_pixel_total : 1791 time to create 1 rle with old method : 0.0021758079528808594 time for calcul the mask position with numpy : 0.010383129119873047 nb_pixel_total : 35 time to create 1 rle with old method : 8.940696716308594e-05 time for calcul the mask position with numpy : 0.0069446563720703125 nb_pixel_total : 96 time to create 1 rle with old method : 0.00016570091247558594 time for calcul the mask position with numpy : 0.008098363876342773 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0015976428985595703 time for calcul the mask position with numpy : 0.008277177810668945 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021147727966308594 time for calcul the mask position with numpy : 0.00815892219543457 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006430149078369141 time for calcul the mask position with numpy : 0.008102893829345703 nb_pixel_total : 685 time to create 1 rle with old method : 0.0009047985076904297 time for calcul the mask position with numpy : 0.013605594635009766 nb_pixel_total : 829 time to create 1 rle with old method : 0.0009856224060058594 time for calcul the mask position with numpy : 0.01337289810180664 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009791851043701172 time for calcul the mask position with numpy : 0.01331949234008789 nb_pixel_total : 573 time to create 1 rle with old method : 0.0007977485656738281 time for calcul the mask position with numpy : 0.013098478317260742 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003459453582763672 time for calcul the mask position with numpy : 0.013386249542236328 nb_pixel_total : 217 time to create 1 rle with old method : 0.00032067298889160156 time for calcul the mask position with numpy : 0.012033700942993164 nb_pixel_total : 1409 time to create 1 rle with old method : 0.0018489360809326172 time for calcul the mask position with numpy : 0.013605594635009766 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005557537078857422 time for calcul the mask position with numpy : 0.011442184448242188 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006358623504638672 time for calcul the mask position with numpy : 0.012524127960205078 nb_pixel_total : 621 time to create 1 rle with old method : 0.0007355213165283203 time for calcul the mask position with numpy : 0.012093067169189453 nb_pixel_total : 545 time to create 1 rle with old method : 0.0009243488311767578 time for calcul the mask position with numpy : 0.014750957489013672 nb_pixel_total : 84 time to create 1 rle with old method : 0.00019669532775878906 time for calcul the mask position with numpy : 0.015431642532348633 nb_pixel_total : 484 time to create 1 rle with old method : 0.0008900165557861328 time for calcul the mask position with numpy : 0.017194747924804688 nb_pixel_total : 1735 time to create 1 rle with old method : 0.002637147903442383 time for calcul the mask position with numpy : 0.016117334365844727 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002579689025878906 time for calcul the mask position with numpy : 0.01967453956604004 nb_pixel_total : 24249 time to create 1 rle with old method : 0.03123784065246582 time for calcul the mask position with numpy : 0.014023303985595703 nb_pixel_total : 20475 time to create 1 rle with old method : 0.030358314514160156 time for calcul the mask position with numpy : 0.015503883361816406 nb_pixel_total : 817 time to create 1 rle with old method : 0.0011963844299316406 time for calcul the mask position with numpy : 0.01789999008178711 nb_pixel_total : 274 time to create 1 rle with old method : 0.00039887428283691406 time for calcul the mask position with numpy : 0.01696181297302246 nb_pixel_total : 8918 time to create 1 rle with old method : 0.011620283126831055 time for calcul the mask position with numpy : 0.015524864196777344 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004563331604003906 time for calcul the mask position with numpy : 0.01467442512512207 nb_pixel_total : 13 time to create 1 rle with old method : 7.987022399902344e-05 time for calcul the mask position with numpy : 0.014862060546875 nb_pixel_total : 568 time to create 1 rle with old method : 0.0011289119720458984 time for calcul the mask position with numpy : 0.015029430389404297 nb_pixel_total : 407 time to create 1 rle with old method : 0.0008914470672607422 time for calcul the mask position with numpy : 0.014780998229980469 nb_pixel_total : 4217 time to create 1 rle with old method : 0.006970405578613281 time for calcul the mask position with numpy : 0.014503240585327148 nb_pixel_total : 771 time to create 1 rle with old method : 0.0009746551513671875 time for calcul the mask position with numpy : 0.013906717300415039 nb_pixel_total : 2327 time to create 1 rle with old method : 0.002724170684814453 time for calcul the mask position with numpy : 0.013576269149780273 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007050037384033203 time for calcul the mask position with numpy : 0.014392852783203125 nb_pixel_total : 1893 time to create 1 rle with old method : 0.002179384231567383 time for calcul the mask position with numpy : 0.01416635513305664 nb_pixel_total : 2836 time to create 1 rle with old method : 0.0031960010528564453 time for calcul the mask position with numpy : 0.014290571212768555 nb_pixel_total : 1621 time to create 1 rle with old method : 0.0019252300262451172 time for calcul the mask position with numpy : 0.008246183395385742 nb_pixel_total : 8514 time to create 1 rle with old method : 0.009485483169555664 time for calcul the mask position with numpy : 0.008071660995483398 nb_pixel_total : 399 time to create 1 rle with old method : 0.0004999637603759766 time for calcul the mask position with numpy : 0.008191585540771484 nb_pixel_total : 23 time to create 1 rle with old method : 9.417533874511719e-05 time for calcul the mask position with numpy : 0.008071660995483398 nb_pixel_total : 231 time to create 1 rle with old method : 0.00030803680419921875 time for calcul the mask position with numpy : 0.014153003692626953 nb_pixel_total : 104501 time to create 1 rle with old method : 0.11609220504760742 time for calcul the mask position with numpy : 0.008471488952636719 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003552436828613281 time for calcul the mask position with numpy : 0.0077588558197021484 nb_pixel_total : 671 time to create 1 rle with old method : 0.0010061264038085938 time for calcul the mask position with numpy : 0.008470773696899414 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004553794860839844 time for calcul the mask position with numpy : 0.00893712043762207 nb_pixel_total : 760 time to create 1 rle with old method : 0.0011775493621826172 time for calcul the mask position with numpy : 0.010003805160522461 nb_pixel_total : 333 time to create 1 rle with old method : 0.0005090236663818359 time for calcul the mask position with numpy : 0.00943136215209961 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007379055023193359 time for calcul the mask position with numpy : 0.008606910705566406 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004317760467529297 time for calcul the mask position with numpy : 0.008346080780029297 nb_pixel_total : 326 time to create 1 rle with old method : 0.00042366981506347656 time for calcul the mask position with numpy : 0.008599996566772461 nb_pixel_total : 295 time to create 1 rle with old method : 0.00039458274841308594 time for calcul the mask position with numpy : 0.008470535278320312 nb_pixel_total : 88 time to create 1 rle with old method : 0.00014352798461914062 time for calcul the mask position with numpy : 0.008938074111938477 nb_pixel_total : 363 time to create 1 rle with old method : 0.00045418739318847656 time for calcul the mask position with numpy : 0.008846044540405273 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002722740173339844 time for calcul the mask position with numpy : 0.008839845657348633 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002384185791015625 time for calcul the mask position with numpy : 0.014376401901245117 nb_pixel_total : 2052 time to create 1 rle with old method : 0.0023870468139648438 time for calcul the mask position with numpy : 0.013573884963989258 nb_pixel_total : 3214 time to create 1 rle with old method : 0.003698110580444336 time for calcul the mask position with numpy : 0.01140284538269043 nb_pixel_total : 2177 time to create 1 rle with old method : 0.0028035640716552734 time for calcul the mask position with numpy : 0.011054515838623047 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004391670227050781 time for calcul the mask position with numpy : 0.010752201080322266 nb_pixel_total : 868 time to create 1 rle with old method : 0.0009968280792236328 time for calcul the mask position with numpy : 0.011259078979492188 nb_pixel_total : 71 time to create 1 rle with old method : 0.000133514404296875 time for calcul the mask position with numpy : 0.010986328125 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0014584064483642578 time for calcul the mask position with numpy : 0.012566328048706055 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005788803100585938 time for calcul the mask position with numpy : 0.01136016845703125 nb_pixel_total : 566 time to create 1 rle with old method : 0.0009014606475830078 time for calcul the mask position with numpy : 0.011602401733398438 nb_pixel_total : 3290 time to create 1 rle with old method : 0.0042266845703125 time for calcul the mask position with numpy : 0.015783309936523438 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003936290740966797 time for calcul the mask position with numpy : 0.01118612289428711 nb_pixel_total : 1718 time to create 1 rle with old method : 0.002076387405395508 time for calcul the mask position with numpy : 0.011258363723754883 nb_pixel_total : 271 time to create 1 rle with old method : 0.000324249267578125 time for calcul the mask position with numpy : 0.011298179626464844 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002930164337158203 time for calcul the mask position with numpy : 0.011760234832763672 nb_pixel_total : 30 time to create 1 rle with old method : 6.842613220214844e-05 time for calcul the mask position with numpy : 0.012128114700317383 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005252361297607422 time for calcul the mask position with numpy : 0.012495279312133789 nb_pixel_total : 1705 time to create 1 rle with old method : 0.0024242401123046875 time for calcul the mask position with numpy : 0.011801719665527344 nb_pixel_total : 247 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.010200738906860352 nb_pixel_total : 311 time to create 1 rle with old method : 0.0003795623779296875 time for calcul the mask position with numpy : 0.006394863128662109 nb_pixel_total : 1207 time to create 1 rle with old method : 0.0013628005981445312 time for calcul the mask position with numpy : 0.006571531295776367 nb_pixel_total : 1824 time to create 1 rle with old method : 0.002031087875366211 time for calcul the mask position with numpy : 0.006325244903564453 nb_pixel_total : 91 time to create 1 rle with old method : 0.00017905235290527344 time for calcul the mask position with numpy : 0.006632328033447266 nb_pixel_total : 763 time to create 1 rle with old method : 0.0008757114410400391 time for calcul the mask position with numpy : 0.006381511688232422 nb_pixel_total : 552 time to create 1 rle with old method : 0.0006558895111083984 time for calcul the mask position with numpy : 0.006336212158203125 nb_pixel_total : 2378 time to create 1 rle with old method : 0.002831697463989258 time for calcul the mask position with numpy : 0.0065860748291015625 nb_pixel_total : 627 time to create 1 rle with old method : 0.0008254051208496094 time for calcul the mask position with numpy : 0.006351947784423828 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004737377166748047 time for calcul the mask position with numpy : 0.0064351558685302734 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006084442138671875 time for calcul the mask position with numpy : 0.0072443485260009766 nb_pixel_total : 1786 time to create 1 rle with old method : 0.0021932125091552734 time for calcul the mask position with numpy : 0.006747245788574219 nb_pixel_total : 396 time to create 1 rle with old method : 0.0004818439483642578 time for calcul the mask position with numpy : 0.007948875427246094 nb_pixel_total : 1026 time to create 1 rle with old method : 0.0017786026000976562 time for calcul the mask position with numpy : 0.009239435195922852 nb_pixel_total : 239 time to create 1 rle with old method : 0.00039649009704589844 time for calcul the mask position with numpy : 0.007608175277709961 nb_pixel_total : 352 time to create 1 rle with old method : 0.0004725456237792969 time for calcul the mask position with numpy : 0.007233858108520508 nb_pixel_total : 134 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.007057905197143555 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005393028259277344 create new chi : 1.6354870796203613 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0021402835845947266 batch 1 Loaded 103 chid ids of type : 4230 Number RLEs to save : 11511 TO DO : save crop sub photo not yet done ! save time : 0.7149784564971924 nb_obj : 96 nb_hashtags : 6 time to prepare the origin masks : 1.5704879760742188 time for calcul the mask position with numpy : 0.06827926635742188 nb_pixel_total : 1793850 time to create 1 rle with new method : 0.10798907279968262 time for calcul the mask position with numpy : 0.010883569717407227 nb_pixel_total : 4678 time to create 1 rle with old method : 0.0054094791412353516 time for calcul the mask position with numpy : 0.010612249374389648 nb_pixel_total : 7739 time to create 1 rle with old method : 0.008898019790649414 time for calcul the mask position with numpy : 0.006647825241088867 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007710456848144531 time for calcul the mask position with numpy : 0.006997346878051758 nb_pixel_total : 864 time to create 1 rle with old method : 0.001161336898803711 time for calcul the mask position with numpy : 0.008465051651000977 nb_pixel_total : 56548 time to create 1 rle with old method : 0.06290650367736816 time for calcul the mask position with numpy : 0.01014089584350586 nb_pixel_total : 1360 time to create 1 rle with old method : 0.0016217231750488281 time for calcul the mask position with numpy : 0.008243799209594727 nb_pixel_total : 856 time to create 1 rle with old method : 0.0010223388671875 time for calcul the mask position with numpy : 0.008879423141479492 nb_pixel_total : 234 time to create 1 rle with old method : 0.0006091594696044922 time for calcul the mask position with numpy : 0.008256673812866211 nb_pixel_total : 834 time to create 1 rle with old method : 0.000989675521850586 time for calcul the mask position with numpy : 0.008984565734863281 nb_pixel_total : 88 time to create 1 rle with old method : 0.00026607513427734375 time for calcul the mask position with numpy : 0.009055376052856445 nb_pixel_total : 1835 time to create 1 rle with old method : 0.0021409988403320312 time for calcul the mask position with numpy : 0.00861358642578125 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001399517059326172 time for calcul the mask position with numpy : 0.008337974548339844 nb_pixel_total : 1191 time to create 1 rle with old method : 0.0014789104461669922 time for calcul the mask position with numpy : 0.008957624435424805 nb_pixel_total : 451 time to create 1 rle with old method : 0.0009047985076904297 time for calcul the mask position with numpy : 0.009323835372924805 nb_pixel_total : 756 time to create 1 rle with old method : 0.0010783672332763672 time for calcul the mask position with numpy : 0.007924079895019531 nb_pixel_total : 64 time to create 1 rle with old method : 0.00013303756713867188 time for calcul the mask position with numpy : 0.008295059204101562 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006620883941650391 time for calcul the mask position with numpy : 0.014575481414794922 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003399848937988281 time for calcul the mask position with numpy : 0.0079498291015625 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003018379211425781 time for calcul the mask position with numpy : 0.00805044174194336 nb_pixel_total : 744 time to create 1 rle with old method : 0.0008978843688964844 time for calcul the mask position with numpy : 0.010068893432617188 nb_pixel_total : 1516 time to create 1 rle with old method : 0.0021505355834960938 time for calcul the mask position with numpy : 0.008612394332885742 nb_pixel_total : 558 time to create 1 rle with old method : 0.0006995201110839844 time for calcul the mask position with numpy : 0.007886648178100586 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006501674652099609 time for calcul the mask position with numpy : 0.00817561149597168 nb_pixel_total : 79 time to create 1 rle with old method : 0.00016117095947265625 time for calcul the mask position with numpy : 0.009493112564086914 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007810592651367188 time for calcul the mask position with numpy : 0.010191202163696289 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005881786346435547 time for calcul the mask position with numpy : 0.009893417358398438 nb_pixel_total : 439 time to create 1 rle with old method : 0.0007617473602294922 time for calcul the mask position with numpy : 0.008440494537353516 nb_pixel_total : 3 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.00803065299987793 nb_pixel_total : 136 time to create 1 rle with old method : 0.00020813941955566406 time for calcul the mask position with numpy : 0.008184671401977539 nb_pixel_total : 2314 time to create 1 rle with old method : 0.0028994083404541016 time for calcul the mask position with numpy : 0.00825190544128418 nb_pixel_total : 18156 time to create 1 rle with old method : 0.020105600357055664 time for calcul the mask position with numpy : 0.008012771606445312 nb_pixel_total : 804 time to create 1 rle with old method : 0.0009860992431640625 time for calcul the mask position with numpy : 0.007727146148681641 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003809928894042969 time for calcul the mask position with numpy : 0.008067131042480469 nb_pixel_total : 9689 time to create 1 rle with old method : 0.01126718521118164 time for calcul the mask position with numpy : 0.007756233215332031 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004203319549560547 time for calcul the mask position with numpy : 0.008163928985595703 nb_pixel_total : 26 time to create 1 rle with old method : 6.985664367675781e-05 time for calcul the mask position with numpy : 0.007562398910522461 nb_pixel_total : 313 time to create 1 rle with old method : 0.0005297660827636719 time for calcul the mask position with numpy : 0.007994651794433594 nb_pixel_total : 4546 time to create 1 rle with old method : 0.0051860809326171875 time for calcul the mask position with numpy : 0.0076367855072021484 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001475811004638672 time for calcul the mask position with numpy : 0.007541656494140625 nb_pixel_total : 1148 time to create 1 rle with old method : 0.0014927387237548828 time for calcul the mask position with numpy : 0.007668733596801758 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0015153884887695312 time for calcul the mask position with numpy : 0.00790548324584961 nb_pixel_total : 1831 time to create 1 rle with old method : 0.002143383026123047 time for calcul the mask position with numpy : 0.007376670837402344 nb_pixel_total : 116 time to create 1 rle with old method : 0.00018906593322753906 time for calcul the mask position with numpy : 0.007582664489746094 nb_pixel_total : 2554 time to create 1 rle with old method : 0.003014802932739258 time for calcul the mask position with numpy : 0.007558107376098633 nb_pixel_total : 972 time to create 1 rle with old method : 0.0011434555053710938 time for calcul the mask position with numpy : 0.007851600646972656 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0016567707061767578 time for calcul the mask position with numpy : 0.008623361587524414 nb_pixel_total : 8336 time to create 1 rle with old method : 0.009780168533325195 time for calcul the mask position with numpy : 0.007625579833984375 nb_pixel_total : 290 time to create 1 rle with old method : 0.0005667209625244141 time for calcul the mask position with numpy : 0.007941961288452148 nb_pixel_total : 230 time to create 1 rle with old method : 0.00029087066650390625 time for calcul the mask position with numpy : 0.008238554000854492 nb_pixel_total : 106079 time to create 1 rle with old method : 0.11568999290466309 time for calcul the mask position with numpy : 0.008426904678344727 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004858970642089844 time for calcul the mask position with numpy : 0.008036375045776367 nb_pixel_total : 227 time to create 1 rle with old method : 0.00029540061950683594 time for calcul the mask position with numpy : 0.00804448127746582 nb_pixel_total : 14 time to create 1 rle with old method : 5.745887756347656e-05 time for calcul the mask position with numpy : 0.007683515548706055 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006086826324462891 time for calcul the mask position with numpy : 0.00771331787109375 nb_pixel_total : 124 time to create 1 rle with old method : 0.0001895427703857422 time for calcul the mask position with numpy : 0.007889270782470703 nb_pixel_total : 146 time to create 1 rle with old method : 0.00020766258239746094 time for calcul the mask position with numpy : 0.007824897766113281 nb_pixel_total : 10 time to create 1 rle with old method : 7.2479248046875e-05 time for calcul the mask position with numpy : 0.0078089237213134766 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004553794860839844 time for calcul the mask position with numpy : 0.007818937301635742 nb_pixel_total : 3238 time to create 1 rle with old method : 0.0035152435302734375 time for calcul the mask position with numpy : 0.007861852645874023 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003006458282470703 time for calcul the mask position with numpy : 0.00813746452331543 nb_pixel_total : 308 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.007858991622924805 nb_pixel_total : 293 time to create 1 rle with old method : 0.000354766845703125 time for calcul the mask position with numpy : 0.007824897766113281 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004105567932128906 time for calcul the mask position with numpy : 0.007567882537841797 nb_pixel_total : 84 time to create 1 rle with old method : 0.00013208389282226562 time for calcul the mask position with numpy : 0.007698535919189453 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007300376892089844 time for calcul the mask position with numpy : 0.012446880340576172 nb_pixel_total : 219 time to create 1 rle with old method : 0.00027108192443847656 time for calcul the mask position with numpy : 0.011888742446899414 nb_pixel_total : 158 time to create 1 rle with old method : 0.00020551681518554688 time for calcul the mask position with numpy : 0.012304544448852539 nb_pixel_total : 2974 time to create 1 rle with old method : 0.003345489501953125 time for calcul the mask position with numpy : 0.022891759872436523 nb_pixel_total : 394 time to create 1 rle with old method : 0.0004944801330566406 time for calcul the mask position with numpy : 0.012557268142700195 nb_pixel_total : 910 time to create 1 rle with old method : 0.0010433197021484375 time for calcul the mask position with numpy : 0.012605905532836914 nb_pixel_total : 1772 time to create 1 rle with old method : 0.0020089149475097656 time for calcul the mask position with numpy : 0.013626575469970703 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0014290809631347656 time for calcul the mask position with numpy : 0.013130903244018555 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006618499755859375 time for calcul the mask position with numpy : 0.013142585754394531 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0015711784362792969 time for calcul the mask position with numpy : 0.013358592987060547 nb_pixel_total : 125 time to create 1 rle with old method : 0.0001933574676513672 time for calcul the mask position with numpy : 0.013269901275634766 nb_pixel_total : 1898 time to create 1 rle with old method : 0.0021677017211914062 time for calcul the mask position with numpy : 0.013733148574829102 nb_pixel_total : 215 time to create 1 rle with old method : 0.0005369186401367188 time for calcul the mask position with numpy : 0.015259504318237305 nb_pixel_total : 1494 time to create 1 rle with old method : 0.0018105506896972656 time for calcul the mask position with numpy : 0.0130615234375 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003771781921386719 time for calcul the mask position with numpy : 0.008275270462036133 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002789497375488281 time for calcul the mask position with numpy : 0.007745981216430664 nb_pixel_total : 1111 time to create 1 rle with old method : 0.0013434886932373047 time for calcul the mask position with numpy : 0.007948637008666992 nb_pixel_total : 753 time to create 1 rle with old method : 0.0010242462158203125 time for calcul the mask position with numpy : 0.007775306701660156 nb_pixel_total : 2015 time to create 1 rle with old method : 0.00225067138671875 time for calcul the mask position with numpy : 0.007797718048095703 nb_pixel_total : 44 time to create 1 rle with old method : 0.000118255615234375 time for calcul the mask position with numpy : 0.007915973663330078 nb_pixel_total : 86 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.00801396369934082 nb_pixel_total : 993 time to create 1 rle with old method : 0.0011506080627441406 time for calcul the mask position with numpy : 0.007979631423950195 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004298686981201172 time for calcul the mask position with numpy : 0.007791996002197266 nb_pixel_total : 765 time to create 1 rle with old method : 0.0009045600891113281 time for calcul the mask position with numpy : 0.008129358291625977 nb_pixel_total : 507 time to create 1 rle with old method : 0.0008754730224609375 time for calcul the mask position with numpy : 0.008040666580200195 nb_pixel_total : 195 time to create 1 rle with old method : 0.0004677772521972656 time for calcul the mask position with numpy : 0.007985830307006836 nb_pixel_total : 3455 time to create 1 rle with old method : 0.005720376968383789 time for calcul the mask position with numpy : 0.010210514068603516 nb_pixel_total : 381 time to create 1 rle with old method : 0.0006768703460693359 time for calcul the mask position with numpy : 0.007768392562866211 nb_pixel_total : 422 time to create 1 rle with old method : 0.0007174015045166016 time for calcul the mask position with numpy : 0.00778651237487793 nb_pixel_total : 5 time to create 1 rle with old method : 5.626678466796875e-05 time for calcul the mask position with numpy : 0.007761240005493164 nb_pixel_total : 3024 time to create 1 rle with old method : 0.0049211978912353516 time for calcul the mask position with numpy : 0.008665323257446289 nb_pixel_total : 253 time to create 1 rle with old method : 0.00042724609375 create new chi : 1.3877813816070557 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0027189254760742188 batch 1 Loaded 97 chid ids of type : 4230 Number RLEs to save : 10179 TO DO : save crop sub photo not yet done ! save time : 0.6384930610656738 map_output_result : {1340208819: (0.0, 'Should be the crop_list due to order', 0.0), 1340208048: (0.0, 'Should be the crop_list due to order', 0.0), 1340207963: (0.0, 'Should be the crop_list due to order', 0.0), 1340207853: (0.0, 'Should be the crop_list due to order', 0.0), 1340207753: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340208819, 1340208048, 1340207963, 1340207853, 1340207753] Looping around the photos to save general results len do output : 5 /1340208819.Didn't retrieve data . /1340208048.Didn't retrieve data . /1340207963.Didn't retrieve data . /1340207853.Didn't retrieve data . /1340207753.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208819', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208048', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207963', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207853', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207753', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01481318473815918 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.08444905281067 time spend to save output : 0.015466928482055664 total time spend for step 4 : 20.099915981292725 step5:crop_condition Fri Feb 28 21:21:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 502 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 163 About to insert : list_path_to_insert length 163 new photo from crops ! About to upload 163 photos upload in portfolio : 4869462 init cache_photo without model_param we have 163 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740774096_2988758 we have uploaded 163 photos in the portfolio 4869462 time of upload the photos Elapsed time : 41.55113363265991 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 69 About to insert : list_path_to_insert length 69 new photo from crops ! About to upload 69 photos upload in portfolio : 4869462 init cache_photo without model_param we have 69 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740774139_2988758 we have uploaded 69 photos in the portfolio 4869462 time of upload the photos Elapsed time : 17.84378147125244 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740774157_2988758 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6266283988952637 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 4869462 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740774158_2988758 we have uploaded 18 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.245129823684692 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 80 About to insert : list_path_to_insert length 80 new photo from crops ! About to upload 80 photos upload in portfolio : 4869462 init cache_photo without model_param we have 80 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740774164_2988758 we have uploaded 80 photos in the portfolio 4869462 time of upload the photos Elapsed time : 19.10435724258423 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740774183_2988758 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8712842464447021 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340208819, 1340208048, 1340207963, 1340207853, 1340207753] Looping around the photos to save general results len do output : 333 /1340219143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340219506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208819', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208048', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207963', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207853', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207753', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1004 time used for this insertion : 0.051666975021362305 save_final save missing photos in datou_result : time spend for datou_step_exec : 91.5624361038208 time spend to save output : 0.062293291091918945 total time spend for step 5 : 91.62472939491272 step6:thcl Fri Feb 28 21:23:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.013592243194580078 time to convert the images to numpy array : 0.06803059577941895 time to import caffe and check if the image exist : 0.022538185119628906 time to convert the images to numpy array : 0.07510876655578613 time to import caffe and check if the image exist : 0.016344308853149414 time to convert the images to numpy array : 0.08221840858459473 time to import caffe and check if the image exist : 0.017408132553100586 time to convert the images to numpy array : 0.08122825622558594 time to import caffe and check if the image exist : 0.026990652084350586 time to convert the images to numpy array : 0.07468056678771973 time to import caffe and check if the image exist : 0.0239565372467041 time to convert the images to numpy array : 0.07968521118164062 time to import caffe and check if the image exist : 0.02503037452697754 time to convert the images to numpy array : 0.07749462127685547 time to import caffe and check if the image exist : 0.026920318603515625 time to convert the images to numpy array : 0.08214473724365234 time to import caffe and check if the image exist : 0.02963876724243164 time to convert the images to numpy array : 0.07906174659729004 time to import caffe and check if the image exist : 0.023447751998901367 time to convert the images to numpy array : 0.08574676513671875 total time to convert the images to numpy array : 0.6160910129547119 list photo_ids error: [] list photo_ids correct : [1340219480, 1340219481, 1340219482, 1340219483, 1340219484, 1340219485, 1340219486, 1340219487, 1340219488, 1340219489, 1340219490, 1340219491, 1340219492, 1340219493, 1340219494, 1340219495, 1340219496, 1340219497, 1340219498, 1340219499, 1340219500, 1340219501, 1340219502, 1340219503, 1340219504, 1340219505, 1340219506, 1340219143, 1340219144, 1340219145, 1340219146, 1340219147, 1340219148, 1340219149, 1340219150, 1340219151, 1340219152, 1340219153, 1340219154, 1340219155, 1340219156, 1340219157, 1340219158, 1340219159, 1340219160, 1340219161, 1340219162, 1340219163, 1340219164, 1340219165, 1340219166, 1340219167, 1340219168, 1340219169, 1340219170, 1340219171, 1340219172, 1340219173, 1340219175, 1340219176, 1340219177, 1340219178, 1340219179, 1340219180, 1340219181, 1340219182, 1340219183, 1340219184, 1340219185, 1340219186, 1340219187, 1340219188, 1340219189, 1340219190, 1340219191, 1340219192, 1340219193, 1340219194, 1340219195, 1340219196, 1340219197, 1340219198, 1340219199, 1340219200, 1340219201, 1340219202, 1340219203, 1340219204, 1340219205, 1340219207, 1340219208, 1340219209, 1340219210, 1340219211, 1340219212, 1340219446, 1340219447, 1340219448, 1340219449, 1340219450, 1340219451, 1340219452, 1340219453, 1340219454, 1340219455, 1340219456, 1340219457, 1340219458, 1340219459, 1340219460, 1340219461, 1340219462, 1340219463, 1340219464, 1340219465, 1340219466, 1340219467, 1340219468, 1340219469, 1340219470, 1340219471, 1340219472, 1340219473, 1340219474, 1340219475, 1340219476, 1340219477, 1340219478, 1340219479, 1340219282, 1340219283, 1340219284, 1340219285, 1340219286, 1340219287, 1340219288, 1340219289, 1340219290, 1340219291, 1340219292, 1340219293, 1340219294, 1340219295, 1340219296, 1340219297, 1340219299, 1340219300, 1340219301, 1340219302, 1340219303, 1340219304, 1340219305, 1340219307, 1340219308, 1340219309, 1340219310, 1340219320, 1340219321, 1340219322, 1340219323, 1340219324, 1340219325, 1340219326, 1340219247, 1340219248, 1340219249, 1340219250, 1340219251, 1340219252, 1340219253, 1340219254, 1340219255, 1340219256, 1340219257, 1340219258, 1340219259, 1340219261, 1340219262, 1340219263, 1340219264, 1340219265, 1340219266, 1340219267, 1340219268, 1340219269, 1340219270, 1340219271, 1340219272, 1340219273, 1340219274, 1340219275, 1340219276, 1340219277, 1340219278, 1340219279, 1340219280, 1340219281, 1340219362, 1340219363, 1340219364, 1340219365, 1340219366, 1340219367, 1340219369, 1340219370, 1340219371, 1340219372, 1340219373, 1340219374, 1340219375, 1340219376, 1340219377, 1340219378, 1340219379, 1340219380, 1340219381, 1340219382, 1340219383, 1340219384, 1340219385, 1340219386, 1340219387, 1340219388, 1340219389, 1340219390, 1340219392, 1340219397, 1340219398, 1340219399, 1340219400, 1340219401, 1340219213, 1340219214, 1340219215, 1340219216, 1340219217, 1340219218, 1340219219, 1340219220, 1340219221, 1340219222, 1340219223, 1340219224, 1340219225, 1340219226, 1340219227, 1340219228, 1340219229, 1340219230, 1340219231, 1340219232, 1340219233, 1340219234, 1340219235, 1340219236, 1340219237, 1340219238, 1340219239, 1340219240, 1340219241, 1340219242, 1340219243, 1340219244, 1340219245, 1340219246, 1340219327, 1340219328, 1340219329, 1340219330, 1340219331, 1340219332, 1340219333, 1340219334, 1340219336, 1340219337, 1340219338, 1340219339, 1340219340, 1340219341, 1340219342, 1340219343, 1340219344, 1340219345, 1340219346, 1340219347, 1340219348, 1340219349, 1340219350, 1340219351, 1340219352, 1340219353, 1340219354, 1340219355, 1340219356, 1340219357, 1340219358, 1340219359, 1340219360, 1340219361, 1340219402, 1340219403, 1340219404, 1340219405, 1340219406, 1340219407, 1340219409, 1340219410, 1340219411, 1340219412, 1340219413, 1340219414, 1340219415, 1340219424, 1340219425, 1340219426, 1340219427, 1340219428, 1340219429, 1340219430, 1340219431, 1340219432, 1340219433, 1340219434, 1340219435, 1340219436, 1340219437, 1340219438, 1340219439, 1340219440, 1340219441, 1340219443, 1340219444, 1340219445] number of photos to traite : 333 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 2500 l 3632 free memory gpu now : 1761 wait 20 seconds l 3637 free memory gpu now : 1761 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 2500 l 3632 free memory gpu now : 1542 wait 20 seconds l 3637 free memory gpu now : 1542 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.7044122219085693 time used to do the prediction : 1.563685655593872 save descriptor for thcl : 3237 time to traite the descriptors : 2.1112911701202393 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340219480 To insert : 1340219481 To insert : 1340219482 To insert : 1340219483 To insert : 1340219484 To insert : 1340219485 To insert : 1340219486 To insert : 1340219487 To insert : 1340219488 To insert : 1340219489 To insert : 1340219490 To insert : 1340219491 To insert : 1340219492 To insert : 1340219493 To insert : 1340219494 To insert : 1340219495 To insert : 1340219496 To insert : 1340219497 To insert : 1340219498 To insert : 1340219499 To insert : 1340219500 To insert : 1340219501 To insert : 1340219502 To insert : 1340219503 To insert : 1340219504 To insert : 1340219505 To insert : 1340219506 To insert : 1340219143 To insert : 1340219144 To insert : 1340219145 To insert : 1340219146 To insert : 1340219147 To insert : 1340219148 To insert : 1340219149 To insert : 1340219150 To insert : 1340219151 To insert : 1340219152 To insert : 1340219153 To insert : 1340219154 To insert : 1340219155 To insert : 1340219156 To insert : 1340219157 To insert : 1340219158 To insert : 1340219159 To insert : 1340219160 To insert : 1340219161 To insert : 1340219162 To insert : 1340219163 To insert : 1340219164 To insert : 1340219165 To insert : 1340219166 To insert : 1340219167 To insert : 1340219168 To insert : 1340219169 To insert : 1340219170 To insert : 1340219171 To insert : 1340219172 To insert : 1340219173 To insert : 1340219175 To insert : 1340219176 To insert : 1340219177 To insert : 1340219178 To insert : 1340219179 To insert : 1340219180 To insert : 1340219181 To insert : 1340219182 To insert : 1340219183 To insert : 1340219184 To insert : 1340219185 To insert : 1340219186 To insert : 1340219187 To insert : 1340219188 To insert : 1340219189 To insert : 1340219190 To insert : 1340219191 To insert : 1340219192 To insert : 1340219193 To insert : 1340219194 To insert : 1340219195 To insert : 1340219196 To insert : 1340219197 To insert : 1340219198 To insert : 1340219199 To insert : 1340219200 To insert : 1340219201 To insert : 1340219202 To insert : 1340219203 To insert : 1340219204 To insert : 1340219205 To insert : 1340219207 To insert : 1340219208 To insert : 1340219209 To insert : 1340219210 To insert : 1340219211 To insert : 1340219212 To insert : 1340219446 To insert : 1340219447 To insert : 1340219448 To insert : 1340219449 To insert : 1340219450 To insert : 1340219451 To insert : 1340219452 To insert : 1340219453 To insert : 1340219454 To insert : 1340219455 To insert : 1340219456 To insert : 1340219457 To insert : 1340219458 To insert : 1340219459 To insert : 1340219460 To insert : 1340219461 To insert : 1340219462 To insert : 1340219463 To insert : 1340219464 To insert : 1340219465 To insert : 1340219466 To insert : 1340219467 To insert : 1340219468 To insert : 1340219469 To insert : 1340219470 To insert : 1340219471 To insert : 1340219472 To insert : 1340219473 To insert : 1340219474 To insert : 1340219475 To insert : 1340219476 To insert : 1340219477 To insert : 1340219478 To insert : 1340219479 To insert : 1340219282 To insert : 1340219283 To insert : 1340219284 To insert : 1340219285 To insert : 1340219286 To insert : 1340219287 To insert : 1340219288 To insert : 1340219289 To insert : 1340219290 To insert : 1340219291 To insert : 1340219292 To insert : 1340219293 To insert : 1340219294 To insert : 1340219295 To insert : 1340219296 To insert : 1340219297 To insert : 1340219299 To insert : 1340219300 To insert : 1340219301 To insert : 1340219302 To insert : 1340219303 To insert : 1340219304 To insert : 1340219305 To insert : 1340219307 To insert : 1340219308 To insert : 1340219309 To insert : 1340219310 To insert : 1340219320 To insert : 1340219321 To insert : 1340219322 To insert : 1340219323 To insert : 1340219324 To insert : 1340219325 To insert : 1340219326 To insert : 1340219247 To insert : 1340219248 To insert : 1340219249 To insert : 1340219250 To insert : 1340219251 To insert : 1340219252 To insert : 1340219253 To insert : 1340219254 To insert : 1340219255 To insert : 1340219256 To insert : 1340219257 To insert : 1340219258 To insert : 1340219259 To insert : 1340219261 To insert : 1340219262 To insert : 1340219263 To insert : 1340219264 To insert : 1340219265 To insert : 1340219266 To insert : 1340219267 To insert : 1340219268 To insert : 1340219269 To insert : 1340219270 To insert : 1340219271 To insert : 1340219272 To insert : 1340219273 To insert : 1340219274 To insert : 1340219275 To insert : 1340219276 To insert : 1340219277 To insert : 1340219278 To insert : 1340219279 To insert : 1340219280 To insert : 1340219281 To insert : 1340219362 To insert : 1340219363 To insert : 1340219364 To insert : 1340219365 To insert : 1340219366 To insert : 1340219367 To insert : 1340219369 To insert : 1340219370 To insert : 1340219371 To insert : 1340219372 To insert : 1340219373 To insert : 1340219374 To insert : 1340219375 To insert : 1340219376 To insert : 1340219377 To insert : 1340219378 To insert : 1340219379 To insert : 1340219380 To insert : 1340219381 To insert : 1340219382 To insert : 1340219383 To insert : 1340219384 To insert : 1340219385 To insert : 1340219386 To insert : 1340219387 To insert : 1340219388 To insert : 1340219389 To insert : 1340219390 To insert : 1340219392 To insert : 1340219397 To insert : 1340219398 To insert : 1340219399 To insert : 1340219400 To insert : 1340219401 To insert : 1340219213 To insert : 1340219214 To insert : 1340219215 To insert : 1340219216 To insert : 1340219217 To insert : 1340219218 To insert : 1340219219 To insert : 1340219220 To insert : 1340219221 To insert : 1340219222 To insert : 1340219223 To insert : 1340219224 To insert : 1340219225 To insert : 1340219226 To insert : 1340219227 To insert : 1340219228 To insert : 1340219229 To insert : 1340219230 To insert : 1340219231 To insert : 1340219232 To insert : 1340219233 To insert : 1340219234 To insert : 1340219235 To insert : 1340219236 To insert : 1340219237 To insert : 1340219238 To insert : 1340219239 To insert : 1340219240 To insert : 1340219241 To insert : 1340219242 To insert : 1340219243 To insert : 1340219244 To insert : 1340219245 To insert : 1340219246 To insert : 1340219327 To insert : 1340219328 To insert : 1340219329 To insert : 1340219330 To insert : 1340219331 To insert : 1340219332 To insert : 1340219333 To insert : 1340219334 To insert : 1340219336 To insert : 1340219337 To insert : 1340219338 To insert : 1340219339 To insert : 1340219340 To insert : 1340219341 To insert : 1340219342 To insert : 1340219343 To insert : 1340219344 To insert : 1340219345 To insert : 1340219346 To insert : 1340219347 To insert : 1340219348 To insert : 1340219349 To insert : 1340219350 To insert : 1340219351 To insert : 1340219352 To insert : 1340219353 To insert : 1340219354 To insert : 1340219355 To insert : 1340219356 To insert : 1340219357 To insert : 1340219358 To insert : 1340219359 To insert : 1340219360 To insert : 1340219361 To insert : 1340219402 To insert : 1340219403 To insert : 1340219404 To insert : 1340219405 To insert : 1340219406 To insert : 1340219407 To insert : 1340219409 To insert : 1340219410 To insert : 1340219411 To insert : 1340219412 To insert : 1340219413 To insert : 1340219414 To insert : 1340219415 To insert : 1340219424 To insert : 1340219425 To insert : 1340219426 To insert : 1340219427 To insert : 1340219428 To insert : 1340219429 To insert : 1340219430 To insert : 1340219431 To insert : 1340219432 To insert : 1340219433 To insert : 1340219434 To insert : 1340219435 To insert : 1340219436 To insert : 1340219437 To insert : 1340219438 To insert : 1340219439 To insert : 1340219440 To insert : 1340219441 To insert : 1340219443 To insert : 1340219444 To insert : 1340219445 time to insert the descriptors : 65.07174897193909 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 525 time used for this insertion : 0.04491925239562988 save missing photos in datou_result : time spend for datou_step_exec : 117.34444522857666 time spend to save output : 0.11688947677612305 total time spend for step 6 : 117.46133470535278 step7:ventilate_hashtags_in_portfolio Fri Feb 28 21:25:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20940738 get user id for portfolio 20940738 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940738 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','Papier','papier','metal','Film_plastique','Carton','PET_clair','pet_clair','pet_fonce','environnement','mal_croppe','pehd','PET_fonce','flou','refus','Tetrapak','PEHD','autre')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940738 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','Papier','papier','metal','Film_plastique','Carton','PET_clair','pet_clair','pet_fonce','environnement','mal_croppe','pehd','PET_fonce','flou','refus','Tetrapak','PEHD','autre')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940738 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','Papier','papier','metal','Film_plastique','Carton','PET_clair','pet_clair','pet_fonce','environnement','mal_croppe','pehd','PET_fonce','flou','refus','Tetrapak','PEHD','autre')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940738 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','Papier','papier','metal','Film_plastique','Carton','PET_clair','pet_clair','pet_fonce','environnement','mal_croppe','pehd','PET_fonce','flou','refus','Tetrapak','PEHD','autre')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20942001,20941998,20941999,20942000,20942003,20942008,20942005,20942006,20942012,20942009,20942010,20942011,20942013?tags=carton,papier,metal,film_plastique,pet_clair,pet_fonce,environnement,mal_croppe,pehd,flou,refus,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20940738 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340208819, 1340208048, 1340207963, 1340207853, 1340207753] Looping around the photos to save general results len do output : 1 /20940738. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208819', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208048', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207963', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207853', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207753', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012791156768798828 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.3540446758270264 time spend to save output : 0.013092279434204102 total time spend for step 7 : 2.3671369552612305 step8:final Fri Feb 28 21:25:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340208819: ('0.24172650017188088',), 1340208048: ('0.24172650017188088',), 1340207963: ('0.24172650017188088',), 1340207853: ('0.24172650017188088',), 1340207753: ('0.24172650017188088',)} new output for save of step final : {1340208819: ('0.24172650017188088',), 1340208048: ('0.24172650017188088',), 1340207963: ('0.24172650017188088',), 1340207853: ('0.24172650017188088',), 1340207753: ('0.24172650017188088',)} [1340208819, 1340208048, 1340207963, 1340207853, 1340207753] Looping around the photos to save general results len do output : 5 /1340208819.Didn't retrieve data . /1340208048.Didn't retrieve data . /1340207963.Didn't retrieve data . /1340207853.Didn't retrieve data . /1340207753.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208819', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208048', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207963', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207853', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207753', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012699365615844727 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1538231372833252 time spend to save output : 0.013020753860473633 total time spend for step 8 : 0.16684389114379883 step9:velours_tree Fri Feb 28 21:25:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20942001,20941998,20941999,20942000,20942003,20942008,20942005,20942006,20942012,20942009,20942010,20942011,20942013 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942001 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20941998 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20941999 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942000 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942003 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942008 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942005 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942006 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942012 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942009 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942010 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942011 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942013 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 1392 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 1 2 ... 0 4 1] Elapsed time: 1.3694493770599365 graph_id used : 80720 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20942001,20941998,20941999,20942000,20942003,20942008,20942005,20942006,20942012,20942009,20942010,20942011,20942013?tags=carton,papier,metal,film_plastique,pet_clair,pet_fonce,environnement,mal_croppe,pehd,flou,refus,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20940738&tree_id=80720 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340208819, 1340208048, 1340207963, 1340207853, 1340207753] Looping around the photos to save general results len do output : 1 /20940738Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208819', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208048', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207963', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207853', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207753', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012662172317504883 save_final save missing photos in datou_result : time spend for datou_step_exec : 102.30328273773193 time spend to save output : 0.04105806350708008 total time spend for step 9 : 102.34434080123901 step10:send_mail_cod Fri Feb 28 21:26:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20940738_28-02-2025_21_26_47.pdf 20941983 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419831740774407 20941980 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419801740774408 20941981 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419811740774409 20941982 imagette209419821740774410 20941985 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419851740774410 20941990 imagette209419901740774411 20941988 imagette209419881740774411 20941994 change filename to text .change filename to text .change filename to text .change filename to text .imagette209419941740774411 20941991 imagette209419911740774411 20941992 imagette209419921740774411 20941993 imagette209419931740774411 20941995 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419951740774411 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20940738 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20942001,20941998,20941999,20942000,20942003,20942008,20942005,20942006,20942012,20942009,20942010,20942011,20942013?tags=carton,papier,metal,film_plastique,pet_clair,pet_fonce,environnement,mal_croppe,pehd,flou,refus,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20940738&tree_id=80720 your option no_mail is active, we will not send the real mail to your client args[1340208819] : ((1340208819, -7.727924891912349, 492609224), (1340208819, -0.5285980575795012, 501862349), '0.24172650017188088') We are sending mail with results at cod@fotonower.com args[1340208048] : ((1340208048, -7.724580990112039, 492609224), (1340208048, -0.5546982786878328, 501862349), '0.24172650017188088') We are sending mail with results at cod@fotonower.com args[1340207963] : ((1340207963, -7.717025283121189, 492609224), (1340207963, -0.5513496697459311, 501862349), '0.24172650017188088') We are sending mail with results at cod@fotonower.com args[1340207853] : ((1340207853, -7.714295046843347, 492609224), (1340207853, -0.5449942001330916, 501862349), '0.24172650017188088') We are sending mail with results at cod@fotonower.com args[1340207753] : ((1340207753, -7.715071132399132, 492609224), (1340207753, -0.5354912410005421, 501862349), '0.24172650017188088') We are sending mail with results at cod@fotonower.com refus_total : 0.24172650017188088 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20940738 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940738_28-02-2025_21_26_47.pdf results_Qualipapia_P20940738_28-02-2025_21_26_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940738_28-02-2025_21_26_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20940738','results_Qualipapia_P20940738_28-02-2025_21_26_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940738_28-02-2025_21_26_47.pdf','pdf','','0.2','0.24172650017188088') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340208819, 1340208048, 1340207963, 1340207853, 1340207753] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208819', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208048', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207963', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207853', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207753', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.011885881423950195 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.751988172531128 time spend to save output : 0.012222766876220703 total time spend for step 10 : 6.764210939407349 step11:split_time_score Fri Feb 28 21:26:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 62),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28022025 20940738 Nombre de photos uploadées : 62 / 23040 (0%) 28022025 20940738 Nombre de photos taguées (types de déchets): 62 / 62 (100%) 28022025 20940738 Nombre de photos taguées (volume) : 0 / 62 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0013580322265625e-05 ?????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.002801656723022461 elapsed_time : insert_dashboard_record_day_entry 0.024240732192993164 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925313 order by id desc limit 1 Qualite : 0.2389124139495338 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925314_28-02-2025_16_27_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925314 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925314 AND mptpi.`type`=4230 To do Qualite : 0.20097250357084048 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925315_28-02-2025_16_33_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925315 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925315 AND mptpi.`type`=4230 To do Qualite : 0.17175854819984712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925316_28-02-2025_16_37_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925316 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925316 AND mptpi.`type`=4230 To do Qualite : 0.14603092887147903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925317_28-02-2025_16_48_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925317 AND mptpi.`type`=4230 To do Qualite : 0.14537379123310024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925318_28-02-2025_16_47_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925318 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925318 AND mptpi.`type`=4230 To do Qualite : 0.13834991985174483 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925319_28-02-2025_16_53_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925319 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925319 AND mptpi.`type`=4230 To do Qualite : 0.20701680283651394 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925320_28-02-2025_12_19_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925320 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925320 AND mptpi.`type`=4230 To do Qualite : 0.20965568130120157 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925322_28-02-2025_12_35_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925322 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925322 AND mptpi.`type`=4230 To do Qualite : 0.19136356371699506 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926288_28-02-2025_17_55_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926288 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926288 AND mptpi.`type`=4230 To do Qualite : 0.18230722131056523 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926289_28-02-2025_17_49_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926289 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926289 AND mptpi.`type`=4230 To do Qualite : 0.28319271719456496 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926290_28-02-2025_17_52_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926290 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926290 AND mptpi.`type`=4230 To do Qualite : 0.20152453678282414 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926291_28-02-2025_18_00_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926291 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926291 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926292 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926294 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926295 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926296 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926297 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926298 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926299 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926300 order by id desc limit 1 Qualite : 0.20301090126642068 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926680_28-02-2025_19_49_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926680 AND mptpi.`type`=4230 To do Qualite : 0.1907352174406225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926681_28-02-2025_19_41_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926681 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926681 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926682 order by id desc limit 1 Qualite : 0.19471567274044788 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926683_28-02-2025_19_48_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926683 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926683 AND mptpi.`type`=4230 To do Qualite : 0.1738227302063754 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926684_28-02-2025_19_53_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926684 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926684 AND mptpi.`type`=4230 To do Qualite : 0.20471644430980254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926685_28-02-2025_20_03_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926685 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926685 AND mptpi.`type`=4230 To do Qualite : 0.19885090886216725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926686_28-02-2025_20_12_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926686 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926686 AND mptpi.`type`=4230 To do Qualite : 0.18519467081681223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926687_28-02-2025_20_07_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926687 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926687 AND mptpi.`type`=4230 To do Qualite : 0.15869362550655408 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926688_28-02-2025_20_41_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926688 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926688 AND mptpi.`type`=4230 To do Qualite : 0.195875078609268 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926689_28-02-2025_13_45_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926689 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926689 AND mptpi.`type`=4230 To do Qualite : 0.20091742580903377 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926959_28-02-2025_15_57_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926959 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926959 AND mptpi.`type`=4230 To do Qualite : 0.19808442389049616 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926960_28-02-2025_13_47_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926960 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926960 AND mptpi.`type`=4230 To do Qualite : 0.1789930776371666 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926961_28-02-2025_14_35_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926961 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926961 AND mptpi.`type`=4230 To do Qualite : 0.23665664333760855 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926962_28-02-2025_14_58_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926962 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926962 AND mptpi.`type`=4230 To do Qualite : 0.2286496649991992 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20931435_28-02-2025_16_31_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20931435 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20931435 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932896 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932897 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932898 order by id desc limit 1 Qualite : 0.13881388279873863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20932899_28-02-2025_16_46_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932899 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20932899 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932900 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934012 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934013 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934014 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934015 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934016 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934017 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934018 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934019 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934020 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934021 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934022 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934023 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934024 order by id desc limit 1 Qualite : 0.0970633201854936 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20934025_28-02-2025_17_32_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934025 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20934025 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934026 order by id desc limit 1 Qualite : 0.16967650816069063 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20934027_28-02-2025_17_24_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934027 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20934027 AND mptpi.`type`=4230 To do Qualite : 0.1639586909166268 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20934028_28-02-2025_17_26_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934028 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20934028 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20935529 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20935530 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20935531 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20935532 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936067 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936068 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936069 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936070 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936071 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936072 order by id desc limit 1 Qualite : 0.15966075121649642 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20936073_28-02-2025_18_37_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936073 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20936073 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936074 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936075 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936076 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936463 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936464 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936465 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936466 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936467 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936468 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936469 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936470 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936471 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936472 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936473 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936474 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936475 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936476 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936477 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936478 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936479 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936480 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936481 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20937371 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20937372 order by id desc limit 1 Qualite : 0.24449189314433856 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20937373_28-02-2025_19_32_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20937373 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20937373 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20938277 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20938278 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20938279 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20939698 order by id desc limit 1 Qualite : 0.1722945259380154 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20939699_28-02-2025_20_22_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20939699 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20939699 AND mptpi.`type`=4230 To do Qualite : 0.2252823435782075 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20939724_28-02-2025_20_11_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20939724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20939724 AND mptpi.`type`=4230 To do Qualite : 0.24172650017188088 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940738_28-02-2025_21_26_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20940738 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940738 AND mptpi.`type`=4230 To do Qualite : 0.23788780239766558 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940739_28-02-2025_20_48_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20940739 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940739 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28022025': {'nb_upload': 62, 'nb_taggue_class': 62, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340208819, 1340208048, 1340207963, 1340207853, 1340207753] Looping around the photos to save general results len do output : 1 /20940738Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208819', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340208048', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207963', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207853', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', '20940738', '1340207753', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012085199356079102 save_final save missing photos in datou_result : time spend for datou_step_exec : 55.034387826919556 time spend to save output : 0.012315750122070312 total time spend for step 11 : 55.046703577041626 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 68.60user 40.16system 7:24.25elapsed 24%CPU (0avgtext+0avgdata 2455316maxresident)k 1386712inputs+32216outputs (12967major+3456265minor)pagefaults 0swaps