python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3978966 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 8>5 please execute split_portfolio.py -i 20138024 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2536931'] with mtr_portfolio_ids : ['20138024'] and first list_photo_ids : [] new path : /proc/3978966/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.76711106300354 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 1 09:20:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 09:20:30.486820: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 09:20:30.511558: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 09:20:30.513850: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbd98000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 09:20:30.513912: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 09:20:30.517995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 09:20:30.740985: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x10704c00 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 09:20:30.741029: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 09:20:30.742426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 09:20:30.742844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 09:20:30.746043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 09:20:30.749157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 09:20:30.749679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 09:20:30.752574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 09:20:30.753634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 09:20:30.758656: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 09:20:30.760144: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 09:20:30.760220: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 09:20:30.760965: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 09:20:30.760981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 09:20:30.760990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 09:20:30.762277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9777 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 09:20:31.020117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 09:20:31.020260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 09:20:31.020293: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 09:20:31.020324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 09:20:31.020353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 09:20:31.020382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 09:20:31.020410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 09:20:31.020439: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 09:20:31.021627: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 09:20:31.022695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 09:20:31.022723: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 09:20:31.022737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 09:20:31.022749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 09:20:31.022761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 09:20:31.022774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 09:20:31.022786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 09:20:31.022798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 09:20:31.023993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 09:20:31.024028: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 09:20:31.024037: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 09:20:31.024045: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 09:20:31.025272: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9777 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 09:20:38.597532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 09:20:38.818476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.41484 max: 146.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 28 time to create 1 rle with old method : 0.00014495849609375 length of segment : 8 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0005800724029541016 length of segment : 42 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0018055438995361328 length of segment : 31 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 14 time to create 1 rle with old method : 5.221366882324219e-05 length of segment : 6 length of segment : 0 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 1625 time to create 1 rle with old method : 0.0029211044311523438 length of segment : 48 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.48125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 895 time to create 1 rle with old method : 0.0013020038604736328 length of segment : 45 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005886554718017578 length of segment : 40 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 2013 time to create 1 rle with old method : 0.0025510787963867188 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.63750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 678 time to create 1 rle with old method : 0.0008985996246337891 length of segment : 24 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1413 time to create 1 rle with old method : 0.0018706321716308594 length of segment : 30 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007793903350830078 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.23125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.0001266002655029297 nb_pixel_total : 7081 time to create 1 rle with old method : 0.008304595947265625 length of segment : 86 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 2348 time to create 1 rle with old method : 0.0029375553131103516 length of segment : 133 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 4874 time to create 1 rle with old method : 0.005861759185791016 length of segment : 75 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 4586 time to create 1 rle with old method : 0.005527496337890625 length of segment : 71 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 2084 time to create 1 rle with old method : 0.0034754276275634766 length of segment : 148 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.0010533332824707031 length of segment : 22 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0014972686767578125 length of segment : 51 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1050 time to create 1 rle with old method : 0.0019383430480957031 length of segment : 33 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 32 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0009663105010986328 length of segment : 18 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1133 time to create 1 rle with old method : 0.002045154571533203 length of segment : 35 time for calcul the mask position with numpy : 0.0008404254913330078 nb_pixel_total : 54789 time to create 1 rle with old method : 0.06989789009094238 length of segment : 336 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 230.00000 molded_images shape: (1, 640, 640, 3) min: -86.52813 max: 97.79766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -96.98906 max: 150.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0007297992706298828 length of segment : 23 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005071163177490234 length of segment : 18 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 2550 time to create 1 rle with old method : 0.0031473636627197266 length of segment : 38 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0006372928619384766 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.88750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.000301361083984375 length of segment : 14 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005934238433837891 length of segment : 32 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0010292530059814453 length of segment : 19 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 828 time to create 1 rle with old method : 0.0011658668518066406 length of segment : 37 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005986690521240234 length of segment : 51 time for calcul the mask position with numpy : 0.0002541542053222656 nb_pixel_total : 12153 time to create 1 rle with old method : 0.014215230941772461 length of segment : 227 time for calcul the mask position with numpy : 0.0003421306610107422 nb_pixel_total : 16140 time to create 1 rle with old method : 0.03044891357421875 length of segment : 170 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 65 time to create 1 rle with old method : 9.560585021972656e-05 length of segment : 14 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 2844 time to create 1 rle with old method : 0.003313779830932617 length of segment : 41 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 2429 time to create 1 rle with old method : 0.0028727054595947266 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.55938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1274 time to create 1 rle with old method : 0.0015680789947509766 length of segment : 72 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004284381866455078 length of segment : 67 time for calcul the mask position with numpy : 0.0001995563507080078 nb_pixel_total : 9008 time to create 1 rle with old method : 0.010883092880249023 length of segment : 197 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00023436546325683594 length of segment : 15 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0011086463928222656 length of segment : 95 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 697 time to create 1 rle with old method : 0.0013508796691894531 length of segment : 39 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.002244710922241211 length of segment : 40 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0014650821685791016 length of segment : 29 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 2841 time to create 1 rle with old method : 0.004958152770996094 length of segment : 89 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00024390220642089844 length of segment : 15 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0007281303405761719 length of segment : 12 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 1222 time to create 1 rle with old method : 0.001600027084350586 length of segment : 77 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.05312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0010437965393066406 length of segment : 54 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 981 time to create 1 rle with old method : 0.0012755393981933594 length of segment : 57 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1643 time to create 1 rle with old method : 0.002002716064453125 length of segment : 79 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1462 time to create 1 rle with old method : 0.0017600059509277344 length of segment : 59 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 6174 time to create 1 rle with old method : 0.0070421695709228516 length of segment : 226 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005047321319580078 length of segment : 36 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 204.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 74.47734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009229183197021484 nb_pixel_total : 106813 time to create 1 rle with old method : 0.11956024169921875 length of segment : 288 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.45156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006558895111083984 length of segment : 25 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006456375122070312 length of segment : 34 time for calcul the mask position with numpy : 0.00018262863159179688 nb_pixel_total : 8257 time to create 1 rle with old method : 0.009470224380493164 length of segment : 143 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0006067752838134766 length of segment : 34 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00021791458129882812 length of segment : 19 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003490447998046875 length of segment : 22 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 4217 time to create 1 rle with old method : 0.005126953125 length of segment : 157 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.0001347064971923828 length of segment : 8 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.0002353191375732422 length of segment : 12 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.84219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.000522613525390625 length of segment : 25 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006330013275146484 length of segment : 34 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.000286102294921875 length of segment : 11 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00041794776916503906 length of segment : 16 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0011627674102783203 length of segment : 55 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00021076202392578125 length of segment : 27 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.00046133995056152344 length of segment : 21 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.00014925003051757812 length of segment : 7 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 978 time to create 1 rle with old method : 0.0011963844299316406 length of segment : 32 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006451606750488281 length of segment : 26 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.00051116943359375 length of segment : 19 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004749298095703125 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.12344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003256797790527344 length of segment : 22 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00020551681518554688 length of segment : 29 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.00026106834411621094 length of segment : 19 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.0002028942108154297 length of segment : 14 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002779960632324219 length of segment : 22 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003418922424316406 length of segment : 21 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00017261505126953125 length of segment : 9 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 25 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.000732421875 length of segment : 31 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 12 time to create 1 rle with old method : 5.555152893066406e-05 length of segment : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.41484 max: 148.55703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 7 time to create 1 rle with old method : 5.316734313964844e-05 length of segment : 3 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.00046253204345703125 length of segment : 35 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 886 time to create 1 rle with old method : 0.0013537406921386719 length of segment : 32 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00022530555725097656 length of segment : 14 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.0004189014434814453 length of segment : 21 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.0002040863037109375 length of segment : 24 length of segment : 0 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 628 time to create 1 rle with old method : 0.0010788440704345703 length of segment : 69 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00022268295288085938 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.48906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 796 time to create 1 rle with old method : 0.0011959075927734375 length of segment : 49 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0007479190826416016 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.12188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.90000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0009827613830566406 length of segment : 58 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 3963 time to create 1 rle with old method : 0.005289554595947266 length of segment : 98 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 2325 time to create 1 rle with old method : 0.004847049713134766 length of segment : 112 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 3890 time to create 1 rle with old method : 0.005180835723876953 length of segment : 106 length of segment : 0 time for calcul the mask position with numpy : 0.00010585784912109375 nb_pixel_total : 4441 time to create 1 rle with old method : 0.005715608596801758 length of segment : 75 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 4976 time to create 1 rle with old method : 0.006519317626953125 length of segment : 77 time for calcul the mask position with numpy : 0.00015473365783691406 nb_pixel_total : 7081 time to create 1 rle with old method : 0.009459495544433594 length of segment : 104 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.84219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 2103 time to create 1 rle with old method : 0.0027246475219726562 length of segment : 155 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0014224052429199219 length of segment : 55 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00020933151245117188 length of segment : 11 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0007755756378173828 length of segment : 17 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1086 time to create 1 rle with old method : 0.0014467239379882812 length of segment : 32 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0016012191772460938 length of segment : 33 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0020906925201416016 length of segment : 33 time for calcul the mask position with numpy : 0.0008380413055419922 nb_pixel_total : 25435 time to create 1 rle with old method : 0.03624892234802246 length of segment : 258 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0008418560028076172 length of segment : 18 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002574920654296875 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 12.00000 max: 229.00000 molded_images shape: (1, 640, 640, 3) min: -84.64922 max: 95.02031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -97.12188 max: 150.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0006601810455322266 length of segment : 17 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2394 time to create 1 rle with old method : 0.0032739639282226562 length of segment : 34 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0007011890411376953 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.63750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0002434253692626953 length of segment : 8 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005214214324951172 length of segment : 35 time for calcul the mask position with numpy : 0.00038123130798339844 nb_pixel_total : 5304 time to create 1 rle with old method : 0.006633758544921875 length of segment : 231 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005931854248046875 length of segment : 30 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00036025047302246094 length of segment : 15 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 12520 time to create 1 rle with old method : 0.01483297348022461 length of segment : 219 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.0011451244354248047 length of segment : 33 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00012040138244628906 length of segment : 13 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0004992485046386719 length of segment : 15 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.0002732276916503906 length of segment : 14 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00021457672119140625 length of segment : 20 time for calcul the mask position with numpy : 0.00033402442932128906 nb_pixel_total : 16163 time to create 1 rle with old method : 0.018210172653198242 length of segment : 143 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005016326904296875 length of segment : 30 length of segment : 0 time for calcul the mask position with numpy : 0.00036334991455078125 nb_pixel_total : 15234 time to create 1 rle with old method : 0.017850637435913086 length of segment : 151 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.33281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0013689994812011719 length of segment : 54 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 713 time to create 1 rle with old method : 0.0010077953338623047 length of segment : 36 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0008757114410400391 length of segment : 12 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002529621124267578 length of segment : 49 time for calcul the mask position with numpy : 0.00020456314086914062 nb_pixel_total : 6771 time to create 1 rle with old method : 0.007880449295043945 length of segment : 184 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1350 time to create 1 rle with old method : 0.0016241073608398438 length of segment : 39 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 1437 time to create 1 rle with old method : 0.001787424087524414 length of segment : 59 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005741119384765625 length of segment : 43 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004372596740722656 length of segment : 63 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00019168853759765625 length of segment : 17 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0003046989440917969 length of segment : 14 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.000244140625 length of segment : 15 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 1169 time to create 1 rle with old method : 0.003648996353149414 length of segment : 85 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0006747245788574219 length of segment : 31 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 928 time to create 1 rle with old method : 0.0012242794036865234 length of segment : 48 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.0009763240814208984 length of segment : 43 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006625652313232422 length of segment : 57 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.0001823902130126953 length of segment : 20 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1518 time to create 1 rle with old method : 0.0018813610076904297 length of segment : 67 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003502368927001953 length of segment : 21 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0016698837280273438 length of segment : 65 time for calcul the mask position with numpy : 0.00022411346435546875 nb_pixel_total : 919 time to create 1 rle with old method : 0.001203775405883789 length of segment : 110 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0004980564117431641 length of segment : 41 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 996 time to create 1 rle with old method : 0.0012707710266113281 length of segment : 43 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0005562305450439453 length of segment : 40 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1275 time to create 1 rle with old method : 0.0016367435455322266 length of segment : 54 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.05156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009779930114746094 nb_pixel_total : 106824 time to create 1 rle with old method : 0.14059233665466309 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.90078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00028896331787109375 length of segment : 19 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0005867481231689453 length of segment : 33 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006349086761474609 length of segment : 40 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 5731 time to create 1 rle with old method : 0.006303310394287109 length of segment : 73 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006051063537597656 length of segment : 22 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00036215782165527344 length of segment : 23 time for calcul the mask position with numpy : 2.5987625122070312e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011849403381347656 length of segment : 8 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 6035 time to create 1 rle with old method : 0.00682520866394043 length of segment : 75 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003108978271484375 length of segment : 14 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0002551078796386719 length of segment : 11 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0011556148529052734 length of segment : 50 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00017523765563964844 length of segment : 16 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00017690658569335938 length of segment : 9 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005335807800292969 length of segment : 25 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005512237548828125 length of segment : 19 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005970001220703125 length of segment : 36 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00036144256591796875 length of segment : 19 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00021648406982421875 length of segment : 26 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0004627704620361328 length of segment : 24 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 980 time to create 1 rle with old method : 0.0012466907501220703 length of segment : 55 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1074 time to create 1 rle with old method : 0.0013649463653564453 length of segment : 32 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003807544708251953 length of segment : 17 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.0001289844512939453 length of segment : 7 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.14687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.000286102294921875 length of segment : 34 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 989 time to create 1 rle with old method : 0.0015361309051513672 length of segment : 71 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002434253692626953 length of segment : 19 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 22 time for calcul the mask position with numpy : 2.6941299438476562e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00016427040100097656 length of segment : 12 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00026607513427734375 length of segment : 22 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00014925003051757812 length of segment : 26 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.000286102294921875 length of segment : 17 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003581047058105469 length of segment : 20 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0004596710205078125 length of segment : 50 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0008728504180908203 length of segment : 32 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.24297 max: 147.27578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00040912628173828125 length of segment : 29 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 43 time to create 1 rle with old method : 7.963180541992188e-05 length of segment : 16 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 968 time to create 1 rle with old method : 0.0012555122375488281 length of segment : 32 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00016689300537109375 length of segment : 14 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00043201446533203125 length of segment : 26 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1042 time to create 1 rle with old method : 0.001312255859375 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.75078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0006802082061767578 length of segment : 29 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004913806915283203 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.52031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.21563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00013756752014160156 nb_pixel_total : 5614 time to create 1 rle with old method : 0.009570121765136719 length of segment : 71 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 2522 time to create 1 rle with old method : 0.003201007843017578 length of segment : 114 time for calcul the mask position with numpy : 0.00012254714965820312 nb_pixel_total : 4690 time to create 1 rle with old method : 0.005853414535522461 length of segment : 75 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 4805 time to create 1 rle with old method : 0.005915164947509766 length of segment : 74 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.96328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1699 time to create 1 rle with old method : 0.00203704833984375 length of segment : 173 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 835 time to create 1 rle with old method : 0.0010824203491210938 length of segment : 49 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1024 time to create 1 rle with old method : 0.0013489723205566406 length of segment : 32 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0007147789001464844 length of segment : 17 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0007266998291015625 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 230.00000 molded_images shape: (1, 640, 640, 3) min: -82.31797 max: 96.70391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -96.59844 max: 150.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0005443096160888672 length of segment : 16 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2559 time to create 1 rle with old method : 0.004633188247680664 length of segment : 39 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0005521774291992188 length of segment : 16 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006380081176757812 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.39531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.0002791881561279297 length of segment : 14 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0005805492401123047 length of segment : 30 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005373954772949219 length of segment : 19 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 736 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 31 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00020360946655273438 length of segment : 10 time for calcul the mask position with numpy : 0.00029921531677246094 nb_pixel_total : 12113 time to create 1 rle with old method : 0.014211416244506836 length of segment : 230 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002028942108154297 length of segment : 16 time for calcul the mask position with numpy : 0.00036263465881347656 nb_pixel_total : 17075 time to create 1 rle with old method : 0.018790721893310547 length of segment : 136 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00028252601623535156 length of segment : 19 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00018739700317382812 length of segment : 9 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00027298927307128906 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.12578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1359 time to create 1 rle with old method : 0.0017254352569580078 length of segment : 44 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1963 time to create 1 rle with old method : 0.002275705337524414 length of segment : 78 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 658 time to create 1 rle with old method : 0.0008137226104736328 length of segment : 32 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 597 time to create 1 rle with old method : 0.001004934310913086 length of segment : 14 time for calcul the mask position with numpy : 0.00019359588623046875 nb_pixel_total : 5593 time to create 1 rle with old method : 0.00667119026184082 length of segment : 180 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00015497207641601562 length of segment : 16 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 1795 time to create 1 rle with old method : 0.0020623207092285156 length of segment : 136 length of segment : 0 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.00039887428283691406 length of segment : 63 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00023436546325683594 length of segment : 14 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.64687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 2352 time to create 1 rle with old method : 0.003022909164428711 length of segment : 96 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1762 time to create 1 rle with old method : 0.0020291805267333984 length of segment : 83 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 2132 time to create 1 rle with old method : 0.0024216175079345703 length of segment : 81 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 973 time to create 1 rle with old method : 0.00112152099609375 length of segment : 49 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007319450378417969 length of segment : 50 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.001062154769897461 length of segment : 74 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.66875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009603500366210938 nb_pixel_total : 106923 time to create 1 rle with old method : 0.11282014846801758 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.32656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006973743438720703 length of segment : 24 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00030732154846191406 length of segment : 22 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00039696693420410156 length of segment : 23 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00025773048400878906 length of segment : 11 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006399154663085938 length of segment : 32 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 3578 time to create 1 rle with old method : 0.0044248104095458984 length of segment : 112 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007727146148681641 length of segment : 38 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0016825199127197266 length of segment : 53 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0004372596740722656 length of segment : 28 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002377033233642578 length of segment : 14 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00015664100646972656 length of segment : 16 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0011529922485351562 length of segment : 43 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004918575286865234 length of segment : 25 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00025081634521484375 length of segment : 11 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0007770061492919922 length of segment : 34 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007786750793457031 length of segment : 22 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 860 time to create 1 rle with old method : 0.0010876655578613281 length of segment : 33 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.00019621849060058594 length of segment : 12 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007433891296386719 length of segment : 26 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004334449768066406 length of segment : 23 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00025963783264160156 length of segment : 18 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007421970367431641 length of segment : 21 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 676 time to create 1 rle with old method : 0.0008780956268310547 length of segment : 23 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003514289855957031 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.39297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0014505386352539062 length of segment : 75 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00022912025451660156 length of segment : 29 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002713203430175781 length of segment : 20 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003325939178466797 length of segment : 25 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021386146545410156 length of segment : 11 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 16 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0007128715515136719 length of segment : 32 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00031757354736328125 length of segment : 43 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.29375 max: 147.27578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 38 time to create 1 rle with old method : 8.678436279296875e-05 length of segment : 10 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004334449768066406 length of segment : 38 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 943 time to create 1 rle with old method : 0.0011532306671142578 length of segment : 33 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1275 time to create 1 rle with old method : 0.0017125606536865234 length of segment : 61 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00036787986755371094 length of segment : 22 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 42 time to create 1 rle with old method : 9.775161743164062e-05 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.94219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0007936954498291016 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -104.38750 max: 151.08047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 839 time to create 1 rle with old method : 0.0010764598846435547 length of segment : 41 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0004868507385253906 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -107.29766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 2698 time to create 1 rle with old method : 0.0033104419708251953 length of segment : 121 time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 5387 time to create 1 rle with old method : 0.006708860397338867 length of segment : 91 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 4772 time to create 1 rle with old method : 0.005860805511474609 length of segment : 69 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 4456 time to create 1 rle with old method : 0.005333900451660156 length of segment : 70 time for calcul the mask position with numpy : 0.00010132789611816406 nb_pixel_total : 2195 time to create 1 rle with old method : 0.0029053688049316406 length of segment : 65 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.81484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 2135 time to create 1 rle with old method : 0.002560138702392578 length of segment : 169 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006835460662841797 length of segment : 18 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0013225078582763672 length of segment : 33 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 683 time to create 1 rle with old method : 0.0008652210235595703 length of segment : 49 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00019621849060058594 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 229.00000 molded_images shape: (1, 640, 640, 3) min: -84.64922 max: 97.11016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -100.96953 max: 150.53359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 2627 time to create 1 rle with old method : 0.00513148307800293 length of segment : 38 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0016608238220214844 length of segment : 31 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004928112030029297 length of segment : 16 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0007610321044921875 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.83281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00029969215393066406 length of segment : 13 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00047135353088378906 length of segment : 15 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0007853507995605469 length of segment : 29 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.001012563705444336 length of segment : 32 time for calcul the mask position with numpy : 0.0003006458282470703 nb_pixel_total : 12041 time to create 1 rle with old method : 0.01516270637512207 length of segment : 222 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005702972412109375 length of segment : 20 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004451274871826172 length of segment : 23 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00026488304138183594 length of segment : 9 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 967 time to create 1 rle with old method : 0.001861572265625 length of segment : 16 time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 16208 time to create 1 rle with old method : 0.019320249557495117 length of segment : 132 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 2589 time to create 1 rle with old method : 0.007001161575317383 length of segment : 42 time for calcul the mask position with numpy : 0.0021741390228271484 nb_pixel_total : 16111 time to create 1 rle with old method : 0.0433354377746582 length of segment : 132 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 129 time to create 1 rle with old method : 0.00033164024353027344 length of segment : 15 time for calcul the mask position with numpy : 0.0004749298095703125 nb_pixel_total : 5916 time to create 1 rle with old method : 0.01243281364440918 length of segment : 163 time for calcul the mask position with numpy : 0.0002579689025878906 nb_pixel_total : 2366 time to create 1 rle with old method : 0.003148317337036133 length of segment : 192 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.71953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0013175010681152344 length of segment : 50 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0009915828704833984 length of segment : 37 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.00030541419982910156 length of segment : 43 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1419 time to create 1 rle with old method : 0.0017461776733398438 length of segment : 41 time for calcul the mask position with numpy : 0.0002014636993408203 nb_pixel_total : 8424 time to create 1 rle with old method : 0.009624958038330078 length of segment : 201 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.00093841552734375 length of segment : 13 time for calcul the mask position with numpy : 0.0002589225769042969 nb_pixel_total : 5391 time to create 1 rle with old method : 0.009842634201049805 length of segment : 107 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005767345428466797 length of segment : 64 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00032901763916015625 length of segment : 15 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.64687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 938 time to create 1 rle with old method : 0.0011703968048095703 length of segment : 50 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1613 time to create 1 rle with old method : 0.0019409656524658203 length of segment : 79 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1524 time to create 1 rle with old method : 0.0019350051879882812 length of segment : 65 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1941 time to create 1 rle with old method : 0.0024290084838867188 length of segment : 74 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1355 time to create 1 rle with old method : 0.0017919540405273438 length of segment : 91 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005648136138916016 length of segment : 39 time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 3434 time to create 1 rle with old method : 0.004090070724487305 length of segment : 203 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 2426 time to create 1 rle with old method : 0.0029892921447753906 length of segment : 170 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 74.34844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0014374256134033203 nb_pixel_total : 106840 time to create 1 rle with old method : 0.13755512237548828 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.80703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0009143352508544922 length of segment : 33 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.000286102294921875 length of segment : 24 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006804466247558594 length of segment : 22 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00040030479431152344 length of segment : 23 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 5068 time to create 1 rle with old method : 0.00592350959777832 length of segment : 107 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1471 time to create 1 rle with old method : 0.0038056373596191406 length of segment : 56 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0008318424224853516 length of segment : 43 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 8368 time to create 1 rle with old method : 0.010101556777954102 length of segment : 77 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00027632713317871094 length of segment : 12 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.0001304149627685547 length of segment : 8 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.00046563148498535156 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.42422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1116 time to create 1 rle with old method : 0.0014615058898925781 length of segment : 41 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.00026607513427734375 length of segment : 20 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003273487091064453 length of segment : 28 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002498626708984375 length of segment : 16 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00038051605224609375 length of segment : 20 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006356239318847656 length of segment : 23 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0004062652587890625 length of segment : 12 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.000392913818359375 length of segment : 17 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001614093780517578 length of segment : 16 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00036454200744628906 length of segment : 29 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0008664131164550781 length of segment : 34 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0006701946258544922 length of segment : 23 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0009119510650634766 length of segment : 25 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 610 time to create 1 rle with old method : 0.0011012554168701172 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.48281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002815723419189453 length of segment : 19 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00034332275390625 length of segment : 25 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00020265579223632812 length of segment : 14 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00028324127197265625 length of segment : 25 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.000507354736328125 length of segment : 25 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0003483295440673828 length of segment : 10 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00038313865661621094 length of segment : 19 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002639293670654297 length of segment : 18 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 19 time to create 1 rle with old method : 6.723403930664062e-05 length of segment : 4 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.0002334117889404297 length of segment : 41 time for calcul the mask position with numpy : 0.00046563148498535156 nb_pixel_total : 36341 time to create 1 rle with old method : 0.04048752784729004 length of segment : 235 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.43438 max: 148.58047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 27 time to create 1 rle with old method : 7.033348083496094e-05 length of segment : 9 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004379749298095703 length of segment : 31 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 952 time to create 1 rle with old method : 0.0013301372528076172 length of segment : 39 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 978 time to create 1 rle with old method : 0.0013725757598876953 length of segment : 79 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.00011086463928222656 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004942417144775391 length of segment : 25 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005114078521728516 length of segment : 43 time for calcul the mask position with numpy : 0.00029087066650390625 nb_pixel_total : 7590 time to create 1 rle with old method : 0.009099483489990234 length of segment : 390 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -90.87578 max: 151.08047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0011410713195800781 length of segment : 53 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0004787445068359375 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.90000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 7059 time to create 1 rle with old method : 0.008443593978881836 length of segment : 102 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2901 time to create 1 rle with old method : 0.003516674041748047 length of segment : 124 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 4868 time to create 1 rle with old method : 0.005709409713745117 length of segment : 71 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 4343 time to create 1 rle with old method : 0.005166530609130859 length of segment : 70 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 2072 time to create 1 rle with old method : 0.0023419857025146484 length of segment : 158 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.000823974609375 length of segment : 44 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006036758422851562 length of segment : 18 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 962 time to create 1 rle with old method : 0.0011048316955566406 length of segment : 34 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00019407272338867188 length of segment : 33 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0006976127624511719 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 227.00000 molded_images shape: (1, 640, 640, 3) min: -82.31797 max: 96.47734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.25859 max: 150.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003638267517089844 length of segment : 14 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00039386749267578125 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.10234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006582736968994141 length of segment : 34 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 13774 time to create 1 rle with old method : 0.01572418212890625 length of segment : 116 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 750 time to create 1 rle with old method : 0.0009663105010986328 length of segment : 36 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00018858909606933594 length of segment : 17 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.000164031982421875 length of segment : 8 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002522468566894531 length of segment : 15 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00022840499877929688 length of segment : 12 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.00055694580078125 length of segment : 24 time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 11422 time to create 1 rle with old method : 0.012835979461669922 length of segment : 228 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.49688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 652 time to create 1 rle with old method : 0.0010650157928466797 length of segment : 30 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0017313957214355469 length of segment : 54 time for calcul the mask position with numpy : 0.0002295970916748047 nb_pixel_total : 9361 time to create 1 rle with old method : 0.010677576065063477 length of segment : 187 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00016021728515625 length of segment : 15 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0015494823455810547 length of segment : 38 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.000835418701171875 length of segment : 12 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00025653839111328125 length of segment : 16 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0006401538848876953 length of segment : 49 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002353191375732422 length of segment : 19 time for calcul the mask position with numpy : 0.0003540515899658203 nb_pixel_total : 12148 time to create 1 rle with old method : 0.013844490051269531 length of segment : 211 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00027060508728027344 length of segment : 16 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.11953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 2135 time to create 1 rle with old method : 0.0026869773864746094 length of segment : 88 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009658336639404297 length of segment : 28 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.0010564327239990234 length of segment : 48 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 2124 time to create 1 rle with old method : 0.002698183059692383 length of segment : 191 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 1609 time to create 1 rle with old method : 0.001975536346435547 length of segment : 75 time for calcul the mask position with numpy : 0.00016927719116210938 nb_pixel_total : 2919 time to create 1 rle with old method : 0.003495454788208008 length of segment : 171 Processing 1 images image shape: (280, 400, 3) min: 2.00000 max: 210.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 81.03203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.002017974853515625 nb_pixel_total : 106536 time to create 1 rle with old method : 0.15700936317443848 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0007801055908203125 length of segment : 33 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0006883144378662109 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00030875205993652344 length of segment : 23 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 8475 time to create 1 rle with old method : 0.009853839874267578 length of segment : 75 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0007712841033935547 length of segment : 42 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004210472106933594 length of segment : 23 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 11 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 1539 time to create 1 rle with old method : 0.002512693405151367 length of segment : 57 time for calcul the mask position with numpy : 0.00019884109497070312 nb_pixel_total : 8927 time to create 1 rle with old method : 0.014351606369018555 length of segment : 74 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.77969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.00044846534729003906 length of segment : 22 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0008068084716796875 length of segment : 27 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 2223 time to create 1 rle with old method : 0.002676725387573242 length of segment : 61 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002536773681640625 length of segment : 16 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 906 time to create 1 rle with old method : 0.0012547969818115234 length of segment : 50 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009481906890869141 length of segment : 34 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.000484466552734375 length of segment : 31 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0004813671112060547 length of segment : 12 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002892017364501953 length of segment : 13 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006878376007080078 length of segment : 32 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002796649932861328 length of segment : 15 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00027751922607421875 length of segment : 16 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0005474090576171875 length of segment : 19 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.81094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0015120506286621094 length of segment : 78 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00019669532775878906 length of segment : 13 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00020956993103027344 length of segment : 11 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00027179718017578125 length of segment : 20 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0001266002655029297 nb_pixel_total : 176 time to create 1 rle with old method : 0.0008490085601806641 length of segment : 45 Detection mask done ! Trying to reset tf kernel 3979344 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 196 tf kernel not reseted sub process len(results) : 445 len(list_Values) 445 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 445 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 445 chid ids of type : 4228 Number RLEs to save : 22727 save missing photos in datou_result : time spend for datou_step_exec : 31.61650776863098 time spend to save output : 3.760735034942627 total time spend for step 1 : 35.37724280357361 step2:brightness Sat Feb 1 09:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738398026_3978966_1333333360_d9d1da415c9e1800ab7f98e30bdc55ca.jpg treat image : temp/1738398026_3978966_1333333351_7a5fcfffacce1b519bdaa3e2650cf855.jpg treat image : temp/1738398026_3978966_1333333344_74d8219da83b7d5b67370f5dcb2c0b31.jpg treat image : temp/1738398026_3978966_1333333307_252300f4dff2392d2c12bbf1e903c2e8.jpg treat image : temp/1738398026_3978966_1333333303_5cce8cba51e6a9b385211cf9cc4124c4.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.011378765106201172 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.011098861694335938 save missing photos in datou_result : time spend for datou_step_exec : 1.7622926235198975 time spend to save output : 0.027018308639526367 total time spend for step 2 : 1.7893109321594238 step3:blur_detection Sat Feb 1 09:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738398026_3978966_1333333360_d9d1da415c9e1800ab7f98e30bdc55ca.jpg resize: (1080, 1920) 1333333360 -7.781804622313755 treat image : temp/1738398026_3978966_1333333351_7a5fcfffacce1b519bdaa3e2650cf855.jpg resize: (1080, 1920) 1333333351 -7.781032637658825 treat image : temp/1738398026_3978966_1333333344_74d8219da83b7d5b67370f5dcb2c0b31.jpg resize: (1080, 1920) 1333333344 -7.788164955365587 treat image : temp/1738398026_3978966_1333333307_252300f4dff2392d2c12bbf1e903c2e8.jpg resize: (1080, 1920) 1333333307 -7.742512035321122 treat image : temp/1738398026_3978966_1333333303_5cce8cba51e6a9b385211cf9cc4124c4.jpg resize: (1080, 1920) 1333333303 -7.71590912640311 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.010712623596191406 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.011092901229858398 save missing photos in datou_result : time spend for datou_step_exec : 5.8107686042785645 time spend to save output : 0.026845693588256836 total time spend for step 3 : 5.837614297866821 step4:rle_unique_nms_with_priority Sat Feb 1 09:21:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 445 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 87 nb_hashtags : 7 time to prepare the origin masks : 1.023134708404541 time for calcul the mask position with numpy : 0.4286782741546631 nb_pixel_total : 1809588 time to create 1 rle with new method : 0.295443058013916 time for calcul the mask position with numpy : 0.008477210998535156 nb_pixel_total : 2084 time to create 1 rle with old method : 0.0023870468139648438 time for calcul the mask position with numpy : 0.00855398178100586 nb_pixel_total : 54789 time to create 1 rle with old method : 0.05988287925720215 time for calcul the mask position with numpy : 0.008489131927490234 nb_pixel_total : 414 time to create 1 rle with old method : 0.0004818439483642578 time for calcul the mask position with numpy : 0.008104801177978516 nb_pixel_total : 895 time to create 1 rle with old method : 0.0009329319000244141 time for calcul the mask position with numpy : 0.008072137832641602 nb_pixel_total : 28 time to create 1 rle with old method : 4.124641418457031e-05 time for calcul the mask position with numpy : 0.008270978927612305 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0011191368103027344 time for calcul the mask position with numpy : 0.008527755737304688 nb_pixel_total : 298 time to create 1 rle with old method : 0.00035881996154785156 time for calcul the mask position with numpy : 0.008564949035644531 nb_pixel_total : 4 time to create 1 rle with old method : 4.124641418457031e-05 time for calcul the mask position with numpy : 0.008630514144897461 nb_pixel_total : 589 time to create 1 rle with old method : 0.00070953369140625 time for calcul the mask position with numpy : 0.008719205856323242 nb_pixel_total : 2348 time to create 1 rle with old method : 0.002749919891357422 time for calcul the mask position with numpy : 0.008488893508911133 nb_pixel_total : 1625 time to create 1 rle with old method : 0.001981496810913086 time for calcul the mask position with numpy : 0.008640289306640625 nb_pixel_total : 2013 time to create 1 rle with old method : 0.0024750232696533203 time for calcul the mask position with numpy : 0.008651018142700195 nb_pixel_total : 4874 time to create 1 rle with old method : 0.00547337532043457 time for calcul the mask position with numpy : 0.008315324783325195 nb_pixel_total : 678 time to create 1 rle with old method : 0.0007679462432861328 time for calcul the mask position with numpy : 0.008500814437866211 nb_pixel_total : 1413 time to create 1 rle with old method : 0.001607656478881836 time for calcul the mask position with numpy : 0.008712530136108398 nb_pixel_total : 5 time to create 1 rle with old method : 4.291534423828125e-05 time for calcul the mask position with numpy : 0.008167266845703125 nb_pixel_total : 120 time to create 1 rle with old method : 0.00014829635620117188 time for calcul the mask position with numpy : 0.008537769317626953 nb_pixel_total : 7081 time to create 1 rle with old method : 0.007813215255737305 time for calcul the mask position with numpy : 0.00843501091003418 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001418590545654297 time for calcul the mask position with numpy : 0.008419990539550781 nb_pixel_total : 1050 time to create 1 rle with old method : 0.0011649131774902344 time for calcul the mask position with numpy : 0.008403301239013672 nb_pixel_total : 815 time to create 1 rle with old method : 0.0009517669677734375 time for calcul the mask position with numpy : 0.008417606353759766 nb_pixel_total : 528 time to create 1 rle with old method : 0.0005958080291748047 time for calcul the mask position with numpy : 0.008433818817138672 nb_pixel_total : 18 time to create 1 rle with old method : 5.435943603515625e-05 time for calcul the mask position with numpy : 0.008435964584350586 nb_pixel_total : 168 time to create 1 rle with old method : 0.00019073486328125 time for calcul the mask position with numpy : 0.008533477783203125 nb_pixel_total : 488 time to create 1 rle with old method : 0.0005831718444824219 time for calcul the mask position with numpy : 0.008516788482666016 nb_pixel_total : 4129 time to create 1 rle with old method : 0.004812002182006836 time for calcul the mask position with numpy : 0.008744239807128906 nb_pixel_total : 11959 time to create 1 rle with old method : 0.013434886932373047 time for calcul the mask position with numpy : 0.008464574813842773 nb_pixel_total : 2844 time to create 1 rle with old method : 0.0031981468200683594 time for calcul the mask position with numpy : 0.008424997329711914 nb_pixel_total : 9008 time to create 1 rle with old method : 0.010415315628051758 time for calcul the mask position with numpy : 0.008297204971313477 nb_pixel_total : 569 time to create 1 rle with old method : 0.0006093978881835938 time for calcul the mask position with numpy : 0.008964776992797852 nb_pixel_total : 2841 time to create 1 rle with old method : 0.003412961959838867 time for calcul the mask position with numpy : 0.008103370666503906 nb_pixel_total : 12 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.008530855178833008 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005304813385009766 time for calcul the mask position with numpy : 0.00846552848815918 nb_pixel_total : 326 time to create 1 rle with old method : 0.0003905296325683594 time for calcul the mask position with numpy : 0.008458614349365234 nb_pixel_total : 101 time to create 1 rle with old method : 0.00012302398681640625 time for calcul the mask position with numpy : 0.008446455001831055 nb_pixel_total : 800 time to create 1 rle with old method : 0.0008838176727294922 time for calcul the mask position with numpy : 0.008450746536254883 nb_pixel_total : 30 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.00844430923461914 nb_pixel_total : 1260 time to create 1 rle with old method : 0.001367807388305664 time for calcul the mask position with numpy : 0.008419036865234375 nb_pixel_total : 818 time to create 1 rle with old method : 0.0009434223175048828 time for calcul the mask position with numpy : 0.008472442626953125 nb_pixel_total : 1274 time to create 1 rle with old method : 0.001455068588256836 time for calcul the mask position with numpy : 0.008419275283813477 nb_pixel_total : 680 time to create 1 rle with old method : 0.0007722377777099609 time for calcul the mask position with numpy : 0.008235931396484375 nb_pixel_total : 389 time to create 1 rle with old method : 0.000461578369140625 time for calcul the mask position with numpy : 0.008414030075073242 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005471706390380859 time for calcul the mask position with numpy : 0.008119344711303711 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005278587341308594 time for calcul the mask position with numpy : 0.008309125900268555 nb_pixel_total : 190 time to create 1 rle with old method : 0.00023031234741210938 time for calcul the mask position with numpy : 0.008365869522094727 nb_pixel_total : 6174 time to create 1 rle with old method : 0.0072438716888427734 time for calcul the mask position with numpy : 0.008662223815917969 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006341934204101562 time for calcul the mask position with numpy : 0.011593103408813477 nb_pixel_total : 764 time to create 1 rle with old method : 0.001165151596069336 time for calcul the mask position with numpy : 0.00890040397644043 nb_pixel_total : 828 time to create 1 rle with old method : 0.0010209083557128906 time for calcul the mask position with numpy : 0.008500099182128906 nb_pixel_total : 981 time to create 1 rle with old method : 0.0011219978332519531 time for calcul the mask position with numpy : 0.008647441864013672 nb_pixel_total : 2550 time to create 1 rle with old method : 0.0028913021087646484 time for calcul the mask position with numpy : 0.008587121963500977 nb_pixel_total : 65 time to create 1 rle with old method : 8.487701416015625e-05 time for calcul the mask position with numpy : 0.008471965789794922 nb_pixel_total : 1643 time to create 1 rle with old method : 0.0019683837890625 time for calcul the mask position with numpy : 0.008481502532958984 nb_pixel_total : 336 time to create 1 rle with old method : 0.00040912628173828125 time for calcul the mask position with numpy : 0.008610248565673828 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005500316619873047 time for calcul the mask position with numpy : 0.011639833450317383 nb_pixel_total : 76 time to create 1 rle with old method : 0.00011730194091796875 time for calcul the mask position with numpy : 0.009159326553344727 nb_pixel_total : 106813 time to create 1 rle with old method : 0.1157996654510498 time for calcul the mask position with numpy : 0.00833439826965332 nb_pixel_total : 334 time to create 1 rle with old method : 0.0003833770751953125 time for calcul the mask position with numpy : 0.008221149444580078 nb_pixel_total : 141 time to create 1 rle with old method : 0.00020241737365722656 time for calcul the mask position with numpy : 0.008366107940673828 nb_pixel_total : 519 time to create 1 rle with old method : 0.0005717277526855469 time for calcul the mask position with numpy : 0.00831460952758789 nb_pixel_total : 119 time to create 1 rle with old method : 0.00014400482177734375 time for calcul the mask position with numpy : 0.008170366287231445 nb_pixel_total : 382 time to create 1 rle with old method : 0.00040650367736816406 time for calcul the mask position with numpy : 0.008063793182373047 nb_pixel_total : 832 time to create 1 rle with old method : 0.0009136199951171875 time for calcul the mask position with numpy : 0.008061647415161133 nb_pixel_total : 66 time to create 1 rle with old method : 8.535385131835938e-05 time for calcul the mask position with numpy : 0.00853729248046875 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004222393035888672 time for calcul the mask position with numpy : 0.008549213409423828 nb_pixel_total : 4 time to create 1 rle with old method : 5.435943603515625e-05 time for calcul the mask position with numpy : 0.008611202239990234 nb_pixel_total : 210 time to create 1 rle with old method : 0.00024890899658203125 time for calcul the mask position with numpy : 0.008824825286865234 nb_pixel_total : 135 time to create 1 rle with old method : 0.00018072128295898438 time for calcul the mask position with numpy : 0.008473634719848633 nb_pixel_total : 247 time to create 1 rle with old method : 0.00028634071350097656 time for calcul the mask position with numpy : 0.008430242538452148 nb_pixel_total : 101 time to create 1 rle with old method : 0.00012087821960449219 time for calcul the mask position with numpy : 0.008364439010620117 nb_pixel_total : 8257 time to create 1 rle with old method : 0.009001970291137695 time for calcul the mask position with numpy : 0.008420944213867188 nb_pixel_total : 978 time to create 1 rle with old method : 0.0010578632354736328 time for calcul the mask position with numpy : 0.008088827133178711 nb_pixel_total : 235 time to create 1 rle with old method : 0.0002689361572265625 time for calcul the mask position with numpy : 0.008245229721069336 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005326271057128906 time for calcul the mask position with numpy : 0.008319377899169922 nb_pixel_total : 186 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.008308887481689453 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002129077911376953 time for calcul the mask position with numpy : 0.00846409797668457 nb_pixel_total : 160 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.008444070816040039 nb_pixel_total : 523 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.008451700210571289 nb_pixel_total : 250 time to create 1 rle with old method : 0.0002932548522949219 time for calcul the mask position with numpy : 0.008517265319824219 nb_pixel_total : 509 time to create 1 rle with old method : 0.0005927085876464844 time for calcul the mask position with numpy : 0.008455991744995117 nb_pixel_total : 80 time to create 1 rle with old method : 0.0003116130828857422 time for calcul the mask position with numpy : 0.00843667984008789 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002269744873046875 time for calcul the mask position with numpy : 0.008445024490356445 nb_pixel_total : 12 time to create 1 rle with old method : 2.0265579223632812e-05 time for calcul the mask position with numpy : 0.008539438247680664 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005521774291992188 time for calcul the mask position with numpy : 0.008577823638916016 nb_pixel_total : 4217 time to create 1 rle with old method : 0.004747629165649414 time for calcul the mask position with numpy : 0.009593725204467773 nb_pixel_total : 474 time to create 1 rle with old method : 0.000957489013671875 time for calcul the mask position with numpy : 0.008474111557006836 nb_pixel_total : 125 time to create 1 rle with old method : 0.0001571178436279297 create new chi : 1.773413896560669 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006014585494995117 batch 1 Loaded 88 chid ids of type : 4230 Number RLEs to save : 9693 TO DO : save crop sub photo not yet done ! save time : 0.789719820022583 nb_obj : 105 nb_hashtags : 6 time to prepare the origin masks : 1.8599250316619873 time for calcul the mask position with numpy : 0.06203103065490723 nb_pixel_total : 1850132 time to create 1 rle with new method : 0.8063523769378662 time for calcul the mask position with numpy : 0.006550788879394531 nb_pixel_total : 2103 time to create 1 rle with old method : 0.0024137496948242188 time for calcul the mask position with numpy : 0.0067288875579833984 nb_pixel_total : 25435 time to create 1 rle with old method : 0.04028034210205078 time for calcul the mask position with numpy : 0.007615089416503906 nb_pixel_total : 13 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.0072553157806396484 nb_pixel_total : 117 time to create 1 rle with old method : 0.00018072128295898438 time for calcul the mask position with numpy : 0.006730794906616211 nb_pixel_total : 7 time to create 1 rle with old method : 0.00010156631469726562 time for calcul the mask position with numpy : 0.006083011627197266 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005383491516113281 time for calcul the mask position with numpy : 0.006079912185668945 nb_pixel_total : 796 time to create 1 rle with old method : 0.0009169578552246094 time for calcul the mask position with numpy : 0.006108760833740234 nb_pixel_total : 886 time to create 1 rle with old method : 0.0009965896606445312 time for calcul the mask position with numpy : 0.0061795711517333984 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007650852203369141 time for calcul the mask position with numpy : 0.006516933441162109 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003428459167480469 time for calcul the mask position with numpy : 0.006508827209472656 nb_pixel_total : 87 time to create 1 rle with old method : 0.00011754035949707031 time for calcul the mask position with numpy : 0.006895542144775391 nb_pixel_total : 154 time to create 1 rle with old method : 0.000225067138671875 time for calcul the mask position with numpy : 0.008545398712158203 nb_pixel_total : 1594 time to create 1 rle with old method : 0.0018684864044189453 time for calcul the mask position with numpy : 0.007182121276855469 nb_pixel_total : 2325 time to create 1 rle with old method : 0.003924369812011719 time for calcul the mask position with numpy : 0.006950855255126953 nb_pixel_total : 615 time to create 1 rle with old method : 0.0011959075927734375 time for calcul the mask position with numpy : 0.006563425064086914 nb_pixel_total : 4441 time to create 1 rle with old method : 0.005209922790527344 time for calcul the mask position with numpy : 0.0062334537506103516 nb_pixel_total : 516 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.0061647891998291016 nb_pixel_total : 3184 time to create 1 rle with old method : 0.0036406517028808594 time for calcul the mask position with numpy : 0.005757331848144531 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001323223114013672 time for calcul the mask position with numpy : 0.005547523498535156 nb_pixel_total : 15 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.005641937255859375 nb_pixel_total : 3963 time to create 1 rle with old method : 0.004029035568237305 time for calcul the mask position with numpy : 0.006029605865478516 nb_pixel_total : 94 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.006045818328857422 nb_pixel_total : 129 time to create 1 rle with old method : 0.000209808349609375 time for calcul the mask position with numpy : 0.00611567497253418 nb_pixel_total : 1086 time to create 1 rle with old method : 0.0011708736419677734 time for calcul the mask position with numpy : 0.006033420562744141 nb_pixel_total : 1007 time to create 1 rle with old method : 0.00115203857421875 time for calcul the mask position with numpy : 0.006260395050048828 nb_pixel_total : 21 time to create 1 rle with old method : 6.318092346191406e-05 time for calcul the mask position with numpy : 0.006094455718994141 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005309581756591797 time for calcul the mask position with numpy : 0.00616455078125 nb_pixel_total : 571 time to create 1 rle with old method : 0.0006926059722900391 time for calcul the mask position with numpy : 0.0060122013092041016 nb_pixel_total : 161 time to create 1 rle with old method : 0.00021338462829589844 time for calcul the mask position with numpy : 0.0062253475189208984 nb_pixel_total : 16 time to create 1 rle with old method : 3.647804260253906e-05 time for calcul the mask position with numpy : 0.006090641021728516 nb_pixel_total : 349 time to create 1 rle with old method : 0.00044727325439453125 time for calcul the mask position with numpy : 0.0061168670654296875 nb_pixel_total : 4488 time to create 1 rle with old method : 0.005312919616699219 time for calcul the mask position with numpy : 0.006737470626831055 nb_pixel_total : 12241 time to create 1 rle with old method : 0.013611793518066406 time for calcul the mask position with numpy : 0.0069980621337890625 nb_pixel_total : 5304 time to create 1 rle with old method : 0.006032228469848633 time for calcul the mask position with numpy : 0.006280422210693359 nb_pixel_total : 6771 time to create 1 rle with old method : 0.007403850555419922 time for calcul the mask position with numpy : 0.006177425384521484 nb_pixel_total : 120 time to create 1 rle with old method : 0.00015997886657714844 time for calcul the mask position with numpy : 0.006281137466430664 nb_pixel_total : 432 time to create 1 rle with old method : 0.0004944801330566406 time for calcul the mask position with numpy : 0.006109952926635742 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005955696105957031 time for calcul the mask position with numpy : 0.0063533782958984375 nb_pixel_total : 195 time to create 1 rle with old method : 0.00024390220642089844 time for calcul the mask position with numpy : 0.006002187728881836 nb_pixel_total : 134 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.005825996398925781 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0012028217315673828 time for calcul the mask position with numpy : 0.005911111831665039 nb_pixel_total : 1350 time to create 1 rle with old method : 0.00142669677734375 time for calcul the mask position with numpy : 0.0059223175048828125 nb_pixel_total : 803 time to create 1 rle with old method : 0.0009443759918212891 time for calcul the mask position with numpy : 0.006292104721069336 nb_pixel_total : 53 time to create 1 rle with old method : 7.486343383789062e-05 time for calcul the mask position with numpy : 0.005734920501708984 nb_pixel_total : 71 time to create 1 rle with old method : 9.34600830078125e-05 time for calcul the mask position with numpy : 0.005839824676513672 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008256435394287109 time for calcul the mask position with numpy : 0.006209135055541992 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003647804260253906 time for calcul the mask position with numpy : 0.0062677860260009766 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001201629638671875 time for calcul the mask position with numpy : 0.006182432174682617 nb_pixel_total : 131 time to create 1 rle with old method : 0.00017309188842773438 time for calcul the mask position with numpy : 0.006300926208496094 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005719661712646484 time for calcul the mask position with numpy : 0.0061261653900146484 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005025863647460938 time for calcul the mask position with numpy : 0.006314516067504883 nb_pixel_total : 17 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.0062220096588134766 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.006024599075317383 nb_pixel_total : 919 time to create 1 rle with old method : 0.0010769367218017578 time for calcul the mask position with numpy : 0.006161928176879883 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012350082397460938 time for calcul the mask position with numpy : 0.0061604976654052734 nb_pixel_total : 389 time to create 1 rle with old method : 0.00044155120849609375 time for calcul the mask position with numpy : 0.0061151981353759766 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0013401508331298828 time for calcul the mask position with numpy : 0.006085872650146484 nb_pixel_total : 357 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.006192684173583984 nb_pixel_total : 803 time to create 1 rle with old method : 0.0009541511535644531 time for calcul the mask position with numpy : 0.005884408950805664 nb_pixel_total : 2394 time to create 1 rle with old method : 0.0024766921997070312 time for calcul the mask position with numpy : 0.005695343017578125 nb_pixel_total : 150 time to create 1 rle with old method : 0.00020360946655273438 time for calcul the mask position with numpy : 0.005825042724609375 nb_pixel_total : 996 time to create 1 rle with old method : 0.0011131763458251953 time for calcul the mask position with numpy : 0.0060329437255859375 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003333091735839844 time for calcul the mask position with numpy : 0.005852222442626953 nb_pixel_total : 354 time to create 1 rle with old method : 0.00045037269592285156 time for calcul the mask position with numpy : 0.005671262741088867 nb_pixel_total : 255 time to create 1 rle with old method : 0.0002703666687011719 time for calcul the mask position with numpy : 0.005909442901611328 nb_pixel_total : 48 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.005905628204345703 nb_pixel_total : 1518 time to create 1 rle with old method : 0.0016891956329345703 time for calcul the mask position with numpy : 0.006025552749633789 nb_pixel_total : 324 time to create 1 rle with old method : 0.00040221214294433594 time for calcul the mask position with numpy : 0.0066869258880615234 nb_pixel_total : 1437 time to create 1 rle with old method : 0.001619577407836914 time for calcul the mask position with numpy : 0.006556987762451172 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005652904510498047 time for calcul the mask position with numpy : 0.008082866668701172 nb_pixel_total : 70 time to create 1 rle with old method : 0.00010728836059570312 time for calcul the mask position with numpy : 0.007083892822265625 nb_pixel_total : 403 time to create 1 rle with old method : 0.00047898292541503906 time for calcul the mask position with numpy : 0.007018327713012695 nb_pixel_total : 106824 time to create 1 rle with old method : 0.11867284774780273 time for calcul the mask position with numpy : 0.006587982177734375 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020599365234375 time for calcul the mask position with numpy : 0.006065845489501953 nb_pixel_total : 162 time to create 1 rle with old method : 0.00022029876708984375 time for calcul the mask position with numpy : 0.006063938140869141 nb_pixel_total : 137 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.0059812068939208984 nb_pixel_total : 344 time to create 1 rle with old method : 0.00043463706970214844 time for calcul the mask position with numpy : 0.006130218505859375 nb_pixel_total : 948 time to create 1 rle with old method : 0.0010707378387451172 time for calcul the mask position with numpy : 0.006032705307006836 nb_pixel_total : 72 time to create 1 rle with old method : 9.989738464355469e-05 time for calcul the mask position with numpy : 0.006052970886230469 nb_pixel_total : 422 time to create 1 rle with old method : 0.00044727325439453125 time for calcul the mask position with numpy : 0.006120443344116211 nb_pixel_total : 257 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.006038188934326172 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.006300926208496094 nb_pixel_total : 119 time to create 1 rle with old method : 0.00013899803161621094 time for calcul the mask position with numpy : 0.0061397552490234375 nb_pixel_total : 438 time to create 1 rle with old method : 0.0004961490631103516 time for calcul the mask position with numpy : 0.006167411804199219 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002484321594238281 time for calcul the mask position with numpy : 0.0067446231842041016 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003437995910644531 time for calcul the mask position with numpy : 0.006438016891479492 nb_pixel_total : 1074 time to create 1 rle with old method : 0.0011906623840332031 time for calcul the mask position with numpy : 0.008034944534301758 nb_pixel_total : 244 time to create 1 rle with old method : 0.00029397010803222656 time for calcul the mask position with numpy : 0.008639335632324219 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005717277526855469 time for calcul the mask position with numpy : 0.00849771499633789 nb_pixel_total : 183 time to create 1 rle with old method : 0.00021147727966308594 time for calcul the mask position with numpy : 0.008507966995239258 nb_pixel_total : 113 time to create 1 rle with old method : 0.00013756752014160156 time for calcul the mask position with numpy : 0.008548974990844727 nb_pixel_total : 204 time to create 1 rle with old method : 0.00025177001953125 time for calcul the mask position with numpy : 0.008440494537353516 nb_pixel_total : 269 time to create 1 rle with old method : 0.0002961158752441406 time for calcul the mask position with numpy : 0.008424520492553711 nb_pixel_total : 103 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.007925748825073242 nb_pixel_total : 500 time to create 1 rle with old method : 0.0005254745483398438 time for calcul the mask position with numpy : 0.007951021194458008 nb_pixel_total : 217 time to create 1 rle with old method : 0.00023937225341796875 time for calcul the mask position with numpy : 0.007966756820678711 nb_pixel_total : 220 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.00814366340637207 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005023479461669922 time for calcul the mask position with numpy : 0.008240699768066406 nb_pixel_total : 989 time to create 1 rle with old method : 0.001129150390625 time for calcul the mask position with numpy : 0.008216142654418945 nb_pixel_total : 5731 time to create 1 rle with old method : 0.006348133087158203 time for calcul the mask position with numpy : 0.008566617965698242 nb_pixel_total : 339 time to create 1 rle with old method : 0.0004990100860595703 time for calcul the mask position with numpy : 0.008448362350463867 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006203651428222656 time for calcul the mask position with numpy : 0.00843358039855957 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0011868476867675781 time for calcul the mask position with numpy : 0.008593559265136719 nb_pixel_total : 224 time to create 1 rle with old method : 0.00027251243591308594 time for calcul the mask position with numpy : 0.008523702621459961 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001742839813232422 create new chi : 1.842707872390747 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0015807151794433594 batch 1 Loaded 106 chid ids of type : 4230 Number RLEs to save : 10401 TO DO : save crop sub photo not yet done ! save time : 0.9460747241973877 nb_obj : 80 nb_hashtags : 7 time to prepare the origin masks : 1.29811429977417 time for calcul the mask position with numpy : 0.021602630615234375 nb_pixel_total : 1889643 time to create 1 rle with new method : 0.03370070457458496 time for calcul the mask position with numpy : 0.006464958190917969 nb_pixel_total : 1699 time to create 1 rle with old method : 0.0018591880798339844 time for calcul the mask position with numpy : 0.005967140197753906 nb_pixel_total : 109 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.005967140197753906 nb_pixel_total : 43 time to create 1 rle with old method : 6.890296936035156e-05 time for calcul the mask position with numpy : 0.0060613155364990234 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004525184631347656 time for calcul the mask position with numpy : 0.005891084671020508 nb_pixel_total : 968 time to create 1 rle with old method : 0.0011196136474609375 time for calcul the mask position with numpy : 0.006120920181274414 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001227855682373047 time for calcul the mask position with numpy : 0.006159543991088867 nb_pixel_total : 345 time to create 1 rle with old method : 0.00042128562927246094 time for calcul the mask position with numpy : 0.005955934524536133 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003097057342529297 time for calcul the mask position with numpy : 0.006016731262207031 nb_pixel_total : 196 time to create 1 rle with old method : 0.00025916099548339844 time for calcul the mask position with numpy : 0.006009817123413086 nb_pixel_total : 2522 time to create 1 rle with old method : 0.0028116703033447266 time for calcul the mask position with numpy : 0.006038665771484375 nb_pixel_total : 4690 time to create 1 rle with old method : 0.005177736282348633 time for calcul the mask position with numpy : 0.006032466888427734 nb_pixel_total : 160 time to create 1 rle with old method : 0.0003230571746826172 time for calcul the mask position with numpy : 0.006082296371459961 nb_pixel_total : 5614 time to create 1 rle with old method : 0.006278276443481445 time for calcul the mask position with numpy : 0.00605463981628418 nb_pixel_total : 1024 time to create 1 rle with old method : 0.0012145042419433594 time for calcul the mask position with numpy : 0.00594639778137207 nb_pixel_total : 835 time to create 1 rle with old method : 0.0009768009185791016 time for calcul the mask position with numpy : 0.00592494010925293 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005054473876953125 time for calcul the mask position with numpy : 0.005759239196777344 nb_pixel_total : 45 time to create 1 rle with old method : 8.20159912109375e-05 time for calcul the mask position with numpy : 0.0058019161224365234 nb_pixel_total : 597 time to create 1 rle with old method : 0.0006999969482421875 time for calcul the mask position with numpy : 0.005842447280883789 nb_pixel_total : 157 time to create 1 rle with old method : 0.00018978118896484375 time for calcul the mask position with numpy : 0.005945920944213867 nb_pixel_total : 343 time to create 1 rle with old method : 0.000408172607421875 time for calcul the mask position with numpy : 0.006529331207275391 nb_pixel_total : 5634 time to create 1 rle with old method : 0.006491661071777344 time for calcul the mask position with numpy : 0.00652766227722168 nb_pixel_total : 11949 time to create 1 rle with old method : 0.014021635055541992 time for calcul the mask position with numpy : 0.007438182830810547 nb_pixel_total : 5593 time to create 1 rle with old method : 0.008411407470703125 time for calcul the mask position with numpy : 0.006121397018432617 nb_pixel_total : 418 time to create 1 rle with old method : 0.0004990100860595703 time for calcul the mask position with numpy : 0.00605010986328125 nb_pixel_total : 106 time to create 1 rle with old method : 0.00014781951904296875 time for calcul the mask position with numpy : 0.0060291290283203125 nb_pixel_total : 1359 time to create 1 rle with old method : 0.0015292167663574219 time for calcul the mask position with numpy : 0.0058934688568115234 nb_pixel_total : 1963 time to create 1 rle with old method : 0.0028281211853027344 time for calcul the mask position with numpy : 0.006751060485839844 nb_pixel_total : 973 time to create 1 rle with old method : 0.001361846923828125 time for calcul the mask position with numpy : 0.006660938262939453 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006833076477050781 time for calcul the mask position with numpy : 0.006709098815917969 nb_pixel_total : 1795 time to create 1 rle with old method : 0.002063274383544922 time for calcul the mask position with numpy : 0.006351470947265625 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006334781646728516 time for calcul the mask position with numpy : 0.006650209426879883 nb_pixel_total : 148 time to create 1 rle with old method : 0.00021886825561523438 time for calcul the mask position with numpy : 0.007063388824462891 nb_pixel_total : 118 time to create 1 rle with old method : 0.00018930435180664062 time for calcul the mask position with numpy : 0.007635831832885742 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006241798400878906 time for calcul the mask position with numpy : 0.0069637298583984375 nb_pixel_total : 2352 time to create 1 rle with old method : 0.0031363964080810547 time for calcul the mask position with numpy : 0.007090568542480469 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001571178436279297 time for calcul the mask position with numpy : 0.006891727447509766 nb_pixel_total : 51 time to create 1 rle with old method : 0.00015616416931152344 time for calcul the mask position with numpy : 0.006898403167724609 nb_pixel_total : 736 time to create 1 rle with old method : 0.0010097026824951172 time for calcul the mask position with numpy : 0.007308483123779297 nb_pixel_total : 267 time to create 1 rle with old method : 0.0004115104675292969 time for calcul the mask position with numpy : 0.007399559020996094 nb_pixel_total : 2559 time to create 1 rle with old method : 0.003402233123779297 time for calcul the mask position with numpy : 0.007432699203491211 nb_pixel_total : 804 time to create 1 rle with old method : 0.0012011528015136719 time for calcul the mask position with numpy : 0.008717536926269531 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007648468017578125 time for calcul the mask position with numpy : 0.00809621810913086 nb_pixel_total : 1762 time to create 1 rle with old method : 0.002158641815185547 time for calcul the mask position with numpy : 0.006903171539306641 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004546642303466797 time for calcul the mask position with numpy : 0.006932735443115234 nb_pixel_total : 182 time to create 1 rle with old method : 0.00025773048400878906 time for calcul the mask position with numpy : 0.007279157638549805 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003082752227783203 time for calcul the mask position with numpy : 0.007651329040527344 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001709461212158203 time for calcul the mask position with numpy : 0.008864164352416992 nb_pixel_total : 106923 time to create 1 rle with old method : 0.14544105529785156 time for calcul the mask position with numpy : 0.006789207458496094 nb_pixel_total : 174 time to create 1 rle with old method : 0.00025725364685058594 time for calcul the mask position with numpy : 0.008281946182250977 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003199577331542969 time for calcul the mask position with numpy : 0.007632732391357422 nb_pixel_total : 18 time to create 1 rle with old method : 8.96453857421875e-05 time for calcul the mask position with numpy : 0.007382869720458984 nb_pixel_total : 570 time to create 1 rle with old method : 0.0006973743438720703 time for calcul the mask position with numpy : 0.006386995315551758 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003330707550048828 time for calcul the mask position with numpy : 0.0063190460205078125 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0015668869018554688 time for calcul the mask position with numpy : 0.006445169448852539 nb_pixel_total : 873 time to create 1 rle with old method : 0.001007080078125 time for calcul the mask position with numpy : 0.0068209171295166016 nb_pixel_total : 132 time to create 1 rle with old method : 0.00018024444580078125 time for calcul the mask position with numpy : 0.006342649459838867 nb_pixel_total : 125 time to create 1 rle with old method : 0.00018405914306640625 time for calcul the mask position with numpy : 0.0064699649810791016 nb_pixel_total : 150 time to create 1 rle with old method : 0.0001895427703857422 time for calcul the mask position with numpy : 0.005849361419677734 nb_pixel_total : 860 time to create 1 rle with old method : 0.000957489013671875 time for calcul the mask position with numpy : 0.005837202072143555 nb_pixel_total : 115 time to create 1 rle with old method : 0.00014162063598632812 time for calcul the mask position with numpy : 0.006422758102416992 nb_pixel_total : 30 time to create 1 rle with old method : 9.679794311523438e-05 time for calcul the mask position with numpy : 0.006743192672729492 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004999637603759766 time for calcul the mask position with numpy : 0.007883071899414062 nb_pixel_total : 409 time to create 1 rle with old method : 0.0006051063537597656 time for calcul the mask position with numpy : 0.007824897766113281 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002803802490234375 time for calcul the mask position with numpy : 0.007856130599975586 nb_pixel_total : 156 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.007323503494262695 nb_pixel_total : 283 time to create 1 rle with old method : 0.00037932395935058594 time for calcul the mask position with numpy : 0.006543636322021484 nb_pixel_total : 617 time to create 1 rle with old method : 0.0007145404815673828 time for calcul the mask position with numpy : 0.006491184234619141 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001823902130126953 time for calcul the mask position with numpy : 0.007111549377441406 nb_pixel_total : 98 time to create 1 rle with old method : 0.00013589859008789062 time for calcul the mask position with numpy : 0.006713390350341797 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002300739288330078 time for calcul the mask position with numpy : 0.007109642028808594 nb_pixel_total : 550 time to create 1 rle with old method : 0.0008120536804199219 time for calcul the mask position with numpy : 0.00903463363647461 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.008217096328735352 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006651878356933594 time for calcul the mask position with numpy : 0.007672548294067383 nb_pixel_total : 245 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.007550954818725586 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0016460418701171875 time for calcul the mask position with numpy : 0.008235931396484375 nb_pixel_total : 503 time to create 1 rle with old method : 0.0007274150848388672 time for calcul the mask position with numpy : 0.007850170135498047 nb_pixel_total : 3578 time to create 1 rle with old method : 0.0049839019775390625 time for calcul the mask position with numpy : 0.007573843002319336 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007920265197753906 time for calcul the mask position with numpy : 0.007277250289916992 nb_pixel_total : 179 time to create 1 rle with old method : 0.000240325927734375 time for calcul the mask position with numpy : 0.00683140754699707 nb_pixel_total : 138 time to create 1 rle with old method : 0.00018310546875 create new chi : 0.8461713790893555 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001352071762084961 batch 1 Loaded 81 chid ids of type : 4230 Number RLEs to save : 7978 TO DO : save crop sub photo not yet done ! save time : 0.47318553924560547 nb_obj : 90 nb_hashtags : 6 time to prepare the origin masks : 1.337634801864624 time for calcul the mask position with numpy : 0.026002883911132812 nb_pixel_total : 1827848 time to create 1 rle with new method : 0.20199131965637207 time for calcul the mask position with numpy : 0.007157802581787109 nb_pixel_total : 2135 time to create 1 rle with old method : 0.002493619918823242 time for calcul the mask position with numpy : 0.006803035736083984 nb_pixel_total : 38 time to create 1 rle with old method : 7.152557373046875e-05 time for calcul the mask position with numpy : 0.006171703338623047 nb_pixel_total : 943 time to create 1 rle with old method : 0.001069784164428711 time for calcul the mask position with numpy : 0.006018400192260742 nb_pixel_total : 307 time to create 1 rle with old method : 0.00034999847412109375 time for calcul the mask position with numpy : 0.0061686038970947266 nb_pixel_total : 1275 time to create 1 rle with old method : 0.001369476318359375 time for calcul the mask position with numpy : 0.005970001220703125 nb_pixel_total : 369 time to create 1 rle with old method : 0.00045299530029296875 time for calcul the mask position with numpy : 0.006096601486206055 nb_pixel_total : 17 time to create 1 rle with old method : 4.4345855712890625e-05 time for calcul the mask position with numpy : 0.006130695343017578 nb_pixel_total : 151 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.005808591842651367 nb_pixel_total : 839 time to create 1 rle with old method : 0.0008914470672607422 time for calcul the mask position with numpy : 0.00568699836730957 nb_pixel_total : 2698 time to create 1 rle with old method : 0.0031375885009765625 time for calcul the mask position with numpy : 0.007888317108154297 nb_pixel_total : 112 time to create 1 rle with old method : 0.00021386146545410156 time for calcul the mask position with numpy : 0.006076812744140625 nb_pixel_total : 4772 time to create 1 rle with old method : 0.005095005035400391 time for calcul the mask position with numpy : 0.00655055046081543 nb_pixel_total : 2195 time to create 1 rle with old method : 0.0025415420532226562 time for calcul the mask position with numpy : 0.006070375442504883 nb_pixel_total : 5387 time to create 1 rle with old method : 0.0060999393463134766 time for calcul the mask position with numpy : 0.005990505218505859 nb_pixel_total : 118 time to create 1 rle with old method : 0.00015783309936523438 time for calcul the mask position with numpy : 0.0060312747955322266 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0011913776397705078 time for calcul the mask position with numpy : 0.006060361862182617 nb_pixel_total : 683 time to create 1 rle with old method : 0.0007832050323486328 time for calcul the mask position with numpy : 0.006037473678588867 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005471706390380859 time for calcul the mask position with numpy : 0.006135463714599609 nb_pixel_total : 265 time to create 1 rle with old method : 0.00034332275390625 time for calcul the mask position with numpy : 0.0060312747955322266 nb_pixel_total : 180 time to create 1 rle with old method : 0.00022149085998535156 time for calcul the mask position with numpy : 0.006143331527709961 nb_pixel_total : 529 time to create 1 rle with old method : 0.0006880760192871094 time for calcul the mask position with numpy : 0.006919145584106445 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004353523254394531 time for calcul the mask position with numpy : 0.006312370300292969 nb_pixel_total : 12041 time to create 1 rle with old method : 0.013258934020996094 time for calcul the mask position with numpy : 0.006212472915649414 nb_pixel_total : 967 time to create 1 rle with old method : 0.0011587142944335938 time for calcul the mask position with numpy : 0.006045341491699219 nb_pixel_total : 47 time to create 1 rle with old method : 0.00014901161193847656 time for calcul the mask position with numpy : 0.005932807922363281 nb_pixel_total : 5016 time to create 1 rle with old method : 0.009799480438232422 time for calcul the mask position with numpy : 0.006302833557128906 nb_pixel_total : 2589 time to create 1 rle with old method : 0.0029268264770507812 time for calcul the mask position with numpy : 0.005979061126708984 nb_pixel_total : 8424 time to create 1 rle with old method : 0.009204387664794922 time for calcul the mask position with numpy : 0.006222963333129883 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003204345703125 time for calcul the mask position with numpy : 0.005825519561767578 nb_pixel_total : 5232 time to create 1 rle with old method : 0.005784749984741211 time for calcul the mask position with numpy : 0.005986928939819336 nb_pixel_total : 154 time to create 1 rle with old method : 0.00020551681518554688 time for calcul the mask position with numpy : 0.0060577392578125 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003731250762939453 time for calcul the mask position with numpy : 0.006025791168212891 nb_pixel_total : 5736 time to create 1 rle with old method : 0.006522655487060547 time for calcul the mask position with numpy : 0.005973339080810547 nb_pixel_total : 938 time to create 1 rle with old method : 0.0010623931884765625 time for calcul the mask position with numpy : 0.006047725677490234 nb_pixel_total : 1419 time to create 1 rle with old method : 0.001590728759765625 time for calcul the mask position with numpy : 0.005953788757324219 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0011916160583496094 time for calcul the mask position with numpy : 0.00597381591796875 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002772808074951172 time for calcul the mask position with numpy : 0.0060045719146728516 nb_pixel_total : 758 time to create 1 rle with old method : 0.0008924007415771484 time for calcul the mask position with numpy : 0.006044149398803711 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005018711090087891 time for calcul the mask position with numpy : 0.006447792053222656 nb_pixel_total : 3434 time to create 1 rle with old method : 0.0038857460021972656 time for calcul the mask position with numpy : 0.006178855895996094 nb_pixel_total : 447 time to create 1 rle with old method : 0.0005228519439697266 time for calcul the mask position with numpy : 0.0062525272369384766 nb_pixel_total : 125 time to create 1 rle with old method : 0.0001780986785888672 time for calcul the mask position with numpy : 0.010136604309082031 nb_pixel_total : 100 time to create 1 rle with old method : 0.00022673606872558594 time for calcul the mask position with numpy : 0.00980830192565918 nb_pixel_total : 106 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.008518695831298828 nb_pixel_total : 548 time to create 1 rle with old method : 0.0005948543548583984 time for calcul the mask position with numpy : 0.005769491195678711 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007245540618896484 time for calcul the mask position with numpy : 0.005816221237182617 nb_pixel_total : 1524 time to create 1 rle with old method : 0.0016756057739257812 time for calcul the mask position with numpy : 0.005902290344238281 nb_pixel_total : 129 time to create 1 rle with old method : 0.00015878677368164062 time for calcul the mask position with numpy : 0.006092548370361328 nb_pixel_total : 605 time to create 1 rle with old method : 0.0006420612335205078 time for calcul the mask position with numpy : 0.005633831024169922 nb_pixel_total : 140 time to create 1 rle with old method : 0.00021886825561523438 time for calcul the mask position with numpy : 0.005776882171630859 nb_pixel_total : 727 time to create 1 rle with old method : 0.000762939453125 time for calcul the mask position with numpy : 0.006303310394287109 nb_pixel_total : 2627 time to create 1 rle with old method : 0.002753734588623047 time for calcul the mask position with numpy : 0.005922555923461914 nb_pixel_total : 1613 time to create 1 rle with old method : 0.0018200874328613281 time for calcul the mask position with numpy : 0.0060710906982421875 nb_pixel_total : 323 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.005968570709228516 nb_pixel_total : 259 time to create 1 rle with old method : 0.00031185150146484375 time for calcul the mask position with numpy : 0.0070192813873291016 nb_pixel_total : 106840 time to create 1 rle with old method : 0.12037873268127441 time for calcul the mask position with numpy : 0.006014823913574219 nb_pixel_total : 161 time to create 1 rle with old method : 0.00018930435180664062 time for calcul the mask position with numpy : 0.0059337615966796875 nb_pixel_total : 11 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.00588536262512207 nb_pixel_total : 235 time to create 1 rle with old method : 0.00028061866760253906 time for calcul the mask position with numpy : 0.0059413909912109375 nb_pixel_total : 98 time to create 1 rle with old method : 0.00015306472778320312 time for calcul the mask position with numpy : 0.005968332290649414 nb_pixel_total : 274 time to create 1 rle with old method : 0.00032019615173339844 time for calcul the mask position with numpy : 0.006100654602050781 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005445480346679688 time for calcul the mask position with numpy : 0.006084918975830078 nb_pixel_total : 1471 time to create 1 rle with old method : 0.0016465187072753906 time for calcul the mask position with numpy : 0.005784273147583008 nb_pixel_total : 1116 time to create 1 rle with old method : 0.0012519359588623047 time for calcul the mask position with numpy : 0.0062220096588134766 nb_pixel_total : 273 time to create 1 rle with old method : 0.00032138824462890625 time for calcul the mask position with numpy : 0.005998373031616211 nb_pixel_total : 2 time to create 1 rle with old method : 2.2649765014648438e-05 time for calcul the mask position with numpy : 0.005978584289550781 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001838207244873047 time for calcul the mask position with numpy : 0.006221294403076172 nb_pixel_total : 36341 time to create 1 rle with old method : 0.03920722007751465 time for calcul the mask position with numpy : 0.006010770797729492 nb_pixel_total : 64 time to create 1 rle with old method : 9.369850158691406e-05 time for calcul the mask position with numpy : 0.0059778690338134766 nb_pixel_total : 710 time to create 1 rle with old method : 0.00078582763671875 time for calcul the mask position with numpy : 0.006299495697021484 nb_pixel_total : 197 time to create 1 rle with old method : 0.00027441978454589844 time for calcul the mask position with numpy : 0.0059506893157958984 nb_pixel_total : 342 time to create 1 rle with old method : 0.00036334991455078125 time for calcul the mask position with numpy : 0.00577855110168457 nb_pixel_total : 174 time to create 1 rle with old method : 0.00019884109497070312 time for calcul the mask position with numpy : 0.005574226379394531 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003256797790527344 time for calcul the mask position with numpy : 0.005976676940917969 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001537799835205078 time for calcul the mask position with numpy : 0.006268739700317383 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013566017150878906 time for calcul the mask position with numpy : 0.0061419010162353516 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002384185791015625 time for calcul the mask position with numpy : 0.006928205490112305 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002772808074951172 time for calcul the mask position with numpy : 0.006142616271972656 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003294944763183594 time for calcul the mask position with numpy : 0.006339311599731445 nb_pixel_total : 498 time to create 1 rle with old method : 0.0005774497985839844 time for calcul the mask position with numpy : 0.00621342658996582 nb_pixel_total : 229 time to create 1 rle with old method : 0.00027108192443847656 time for calcul the mask position with numpy : 0.006366252899169922 nb_pixel_total : 337 time to create 1 rle with old method : 0.0003592967987060547 time for calcul the mask position with numpy : 0.006338834762573242 nb_pixel_total : 19 time to create 1 rle with old method : 9.942054748535156e-05 time for calcul the mask position with numpy : 0.0061452388763427734 nb_pixel_total : 492 time to create 1 rle with old method : 0.0005900859832763672 time for calcul the mask position with numpy : 0.00591278076171875 nb_pixel_total : 4032 time to create 1 rle with old method : 0.004532575607299805 time for calcul the mask position with numpy : 0.006190061569213867 nb_pixel_total : 5068 time to create 1 rle with old method : 0.005330085754394531 time for calcul the mask position with numpy : 0.005927324295043945 nb_pixel_total : 621 time to create 1 rle with old method : 0.0007109642028808594 time for calcul the mask position with numpy : 0.005896091461181641 nb_pixel_total : 165 time to create 1 rle with old method : 0.00018835067749023438 time for calcul the mask position with numpy : 0.005917072296142578 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004374980926513672 time for calcul the mask position with numpy : 0.006088733673095703 nb_pixel_total : 116 time to create 1 rle with old method : 0.00015354156494140625 create new chi : 1.0792081356048584 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014255046844482422 batch 1 Loaded 91 chid ids of type : 4230 Number RLEs to save : 9468 TO DO : save crop sub photo not yet done ! save time : 0.5294179916381836 nb_obj : 76 nb_hashtags : 8 time to prepare the origin masks : 1.2621402740478516 time for calcul the mask position with numpy : 0.024509668350219727 nb_pixel_total : 1861936 time to create 1 rle with new method : 0.25479936599731445 time for calcul the mask position with numpy : 0.006184577941894531 nb_pixel_total : 2072 time to create 1 rle with old method : 0.002440214157104492 time for calcul the mask position with numpy : 0.005977630615234375 nb_pixel_total : 27 time to create 1 rle with old method : 5.602836608886719e-05 time for calcul the mask position with numpy : 0.0061397552490234375 nb_pixel_total : 978 time to create 1 rle with old method : 0.0012359619140625 time for calcul the mask position with numpy : 0.005998373031616211 nb_pixel_total : 348 time to create 1 rle with old method : 0.00042176246643066406 time for calcul the mask position with numpy : 0.0060122013092041016 nb_pixel_total : 327 time to create 1 rle with old method : 0.0003859996795654297 time for calcul the mask position with numpy : 0.005887746810913086 nb_pixel_total : 952 time to create 1 rle with old method : 0.0012466907501220703 time for calcul the mask position with numpy : 0.008813142776489258 nb_pixel_total : 318 time to create 1 rle with old method : 0.0005781650543212891 time for calcul the mask position with numpy : 0.009107112884521484 nb_pixel_total : 14 time to create 1 rle with old method : 6.079673767089844e-05 time for calcul the mask position with numpy : 0.009582042694091797 nb_pixel_total : 712 time to create 1 rle with old method : 0.001524209976196289 time for calcul the mask position with numpy : 0.00747370719909668 nb_pixel_total : 2901 time to create 1 rle with old method : 0.004056453704833984 time for calcul the mask position with numpy : 0.006171703338623047 nb_pixel_total : 7590 time to create 1 rle with old method : 0.008941411972045898 time for calcul the mask position with numpy : 0.0063457489013671875 nb_pixel_total : 4868 time to create 1 rle with old method : 0.005354642868041992 time for calcul the mask position with numpy : 0.00641942024230957 nb_pixel_total : 49 time to create 1 rle with old method : 0.00012063980102539062 time for calcul the mask position with numpy : 0.006280422210693359 nb_pixel_total : 145 time to create 1 rle with old method : 0.00018906593322753906 time for calcul the mask position with numpy : 0.006968259811401367 nb_pixel_total : 7059 time to create 1 rle with old method : 0.007819414138793945 time for calcul the mask position with numpy : 0.006852626800537109 nb_pixel_total : 962 time to create 1 rle with old method : 0.0010979175567626953 time for calcul the mask position with numpy : 0.006653785705566406 nb_pixel_total : 716 time to create 1 rle with old method : 0.0008165836334228516 time for calcul the mask position with numpy : 0.0070438385009765625 nb_pixel_total : 54 time to create 1 rle with old method : 0.00010228157043457031 time for calcul the mask position with numpy : 0.006925821304321289 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005633831024169922 time for calcul the mask position with numpy : 0.0073146820068359375 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003197193145751953 time for calcul the mask position with numpy : 0.006885528564453125 nb_pixel_total : 20 time to create 1 rle with old method : 7.224082946777344e-05 time for calcul the mask position with numpy : 0.006951332092285156 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.006807088851928711 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006165504455566406 time for calcul the mask position with numpy : 0.006797313690185547 nb_pixel_total : 2998 time to create 1 rle with old method : 0.0034584999084472656 time for calcul the mask position with numpy : 0.006774187088012695 nb_pixel_total : 11624 time to create 1 rle with old method : 0.012947797775268555 time for calcul the mask position with numpy : 0.006577968597412109 nb_pixel_total : 9361 time to create 1 rle with old method : 0.01018071174621582 time for calcul the mask position with numpy : 0.006129026412963867 nb_pixel_total : 13774 time to create 1 rle with old method : 0.015132427215576172 time for calcul the mask position with numpy : 0.006295680999755859 nb_pixel_total : 494 time to create 1 rle with old method : 0.0005724430084228516 time for calcul the mask position with numpy : 0.00620722770690918 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013303756713867188 time for calcul the mask position with numpy : 0.0061833858489990234 nb_pixel_total : 807 time to create 1 rle with old method : 0.0009458065032958984 time for calcul the mask position with numpy : 0.006679058074951172 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0013954639434814453 time for calcul the mask position with numpy : 0.007308006286621094 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0014002323150634766 time for calcul the mask position with numpy : 0.006899118423461914 nb_pixel_total : 141 time to create 1 rle with old method : 0.00019049644470214844 time for calcul the mask position with numpy : 0.006798267364501953 nb_pixel_total : 652 time to create 1 rle with old method : 0.0008542537689208984 time for calcul the mask position with numpy : 0.006743907928466797 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005345344543457031 time for calcul the mask position with numpy : 0.007264614105224609 nb_pixel_total : 2124 time to create 1 rle with old method : 0.0024194717407226562 time for calcul the mask position with numpy : 0.00709986686706543 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006191730499267578 time for calcul the mask position with numpy : 0.0065860748291015625 nb_pixel_total : 129 time to create 1 rle with old method : 0.00017833709716796875 time for calcul the mask position with numpy : 0.006274223327636719 nb_pixel_total : 1255 time to create 1 rle with old method : 0.0015032291412353516 time for calcul the mask position with numpy : 0.006345272064208984 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013780593872070312 time for calcul the mask position with numpy : 0.006438493728637695 nb_pixel_total : 119 time to create 1 rle with old method : 0.00016117095947265625 time for calcul the mask position with numpy : 0.0064258575439453125 nb_pixel_total : 2135 time to create 1 rle with old method : 0.0023665428161621094 time for calcul the mask position with numpy : 0.0061452388763427734 nb_pixel_total : 235 time to create 1 rle with old method : 0.00037789344787597656 time for calcul the mask position with numpy : 0.006218910217285156 nb_pixel_total : 750 time to create 1 rle with old method : 0.0010149478912353516 time for calcul the mask position with numpy : 0.006249427795410156 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003516674041748047 time for calcul the mask position with numpy : 0.006439208984375 nb_pixel_total : 9 time to create 1 rle with old method : 3.886222839355469e-05 time for calcul the mask position with numpy : 0.006404399871826172 nb_pixel_total : 1596 time to create 1 rle with old method : 0.0017914772033691406 time for calcul the mask position with numpy : 0.006646394729614258 nb_pixel_total : 173 time to create 1 rle with old method : 0.00021457672119140625 time for calcul the mask position with numpy : 0.007200002670288086 nb_pixel_total : 106536 time to create 1 rle with old method : 0.12082982063293457 time for calcul the mask position with numpy : 0.005972623825073242 nb_pixel_total : 205 time to create 1 rle with old method : 0.000278472900390625 time for calcul the mask position with numpy : 0.006016254425048828 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002396106719970703 time for calcul the mask position with numpy : 0.0059435367584228516 nb_pixel_total : 2223 time to create 1 rle with old method : 0.0026781558990478516 time for calcul the mask position with numpy : 0.006074190139770508 nb_pixel_total : 1539 time to create 1 rle with old method : 0.0018529891967773438 time for calcul the mask position with numpy : 0.005959987640380859 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003604888916015625 time for calcul the mask position with numpy : 0.00594639778137207 nb_pixel_total : 906 time to create 1 rle with old method : 0.0011019706726074219 time for calcul the mask position with numpy : 0.005945920944213867 nb_pixel_total : 118 time to create 1 rle with old method : 0.00017595291137695312 time for calcul the mask position with numpy : 0.006176471710205078 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007061958312988281 time for calcul the mask position with numpy : 0.006299257278442383 nb_pixel_total : 177 time to create 1 rle with old method : 0.00025272369384765625 time for calcul the mask position with numpy : 0.006075382232666016 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006198883056640625 time for calcul the mask position with numpy : 0.00722193717956543 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004520416259765625 time for calcul the mask position with numpy : 0.006247758865356445 nb_pixel_total : 158 time to create 1 rle with old method : 0.000225067138671875 time for calcul the mask position with numpy : 0.006405830383300781 nb_pixel_total : 316 time to create 1 rle with old method : 0.00040221214294433594 time for calcul the mask position with numpy : 0.006066560745239258 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003840923309326172 time for calcul the mask position with numpy : 0.0060503482818603516 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008709430694580078 time for calcul the mask position with numpy : 0.006047248840332031 nb_pixel_total : 126 time to create 1 rle with old method : 0.00017762184143066406 time for calcul the mask position with numpy : 0.006031513214111328 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.005999326705932617 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002906322479248047 time for calcul the mask position with numpy : 0.005940675735473633 nb_pixel_total : 500 time to create 1 rle with old method : 0.0005872249603271484 time for calcul the mask position with numpy : 0.00592350959777832 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0014896392822265625 time for calcul the mask position with numpy : 0.005724906921386719 nb_pixel_total : 478 time to create 1 rle with old method : 0.0006158351898193359 time for calcul the mask position with numpy : 0.006006479263305664 nb_pixel_total : 765 time to create 1 rle with old method : 0.0009868144989013672 time for calcul the mask position with numpy : 0.006005764007568359 nb_pixel_total : 8475 time to create 1 rle with old method : 0.00972127914428711 time for calcul the mask position with numpy : 0.006022214889526367 nb_pixel_total : 619 time to create 1 rle with old method : 0.0007565021514892578 time for calcul the mask position with numpy : 0.006051063537597656 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.006134033203125 nb_pixel_total : 11 time to create 1 rle with old method : 4.291534423828125e-05 time for calcul the mask position with numpy : 0.005999088287353516 nb_pixel_total : 112 time to create 1 rle with old method : 0.00015997886657714844 create new chi : 1.0202739238739014 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013728141784667969 batch 1 Loaded 77 chid ids of type : 4230 Number RLEs to save : 8859 TO DO : save crop sub photo not yet done ! save time : 0.5401132106781006 map_output_result : {1333333360: (0.0, 'Should be the crop_list due to order', 0.0), 1333333351: (0.0, 'Should be the crop_list due to order', 0.0), 1333333344: (0.0, 'Should be the crop_list due to order', 0.0), 1333333307: (0.0, 'Should be the crop_list due to order', 0.0), 1333333303: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333333360, 1333333351, 1333333344, 1333333307, 1333333303] Looping around the photos to save general results len do output : 5 /1333333360.Didn't retrieve data . /1333333351.Didn't retrieve data . /1333333344.Didn't retrieve data . /1333333307.Didn't retrieve data . /1333333303.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333360', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333351', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333344', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333307', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333303', None, None, None, None, None, '2536931') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.015831947326660156 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.19065499305725 time spend to save output : 0.016349077224731445 total time spend for step 4 : 17.207004070281982 step5:crop_condition Sat Feb 1 09:21:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 443 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 198 About to insert : list_path_to_insert length 198 new photo from crops ! About to upload 198 photos upload in portfolio : 4869462 init cache_photo without model_param we have 198 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398091_3978966 we have uploaded 198 photos in the portfolio 4869462 time of upload the photos Elapsed time : 43.36416554450989 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 4869462 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398136_3978966 we have uploaded 54 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.317564725875854 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 4869462 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398148_3978966 we have uploaded 12 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.1922144889831543 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398152_3978966 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.927520751953125 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 4869462 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398157_3978966 we have uploaded 49 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.733027219772339 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398170_3978966 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6511390209197998 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398170_3978966 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7283248901367188 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333333360, 1333333351, 1333333344, 1333333307, 1333333303] Looping around the photos to save general results len do output : 330 /1333655828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333655999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333656531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333360', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333351', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333344', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333307', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333303', None, None, None, None, None, '2536931') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 995 time used for this insertion : 0.04966378211975098 save_final save missing photos in datou_result : time spend for datou_step_exec : 83.53432273864746 time spend to save output : 0.05812692642211914 total time spend for step 5 : 83.59244966506958 step6:thcl Sat Feb 1 09:22:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01841282844543457 time to convert the images to numpy array : 0.10888361930847168 time to import caffe and check if the image exist : 0.015966415405273438 time to convert the images to numpy array : 0.11942887306213379 time to import caffe and check if the image exist : 0.032247304916381836 time to convert the images to numpy array : 0.10858964920043945 time to import caffe and check if the image exist : 0.02797102928161621 time to convert the images to numpy array : 0.11429047584533691 time to import caffe and check if the image exist : 0.03811764717102051 time to convert the images to numpy array : 0.10482263565063477 time to import caffe and check if the image exist : 0.03098440170288086 time to convert the images to numpy array : 0.11178779602050781 time to import caffe and check if the image exist : 0.029077529907226562 time to convert the images to numpy array : 0.11568927764892578 time to import caffe and check if the image exist : 0.02791595458984375 time to convert the images to numpy array : 0.11916160583496094 time to import caffe and check if the image exist : 0.05232977867126465 time to convert the images to numpy array : 0.09508848190307617 time to import caffe and check if the image exist : 0.02906203269958496 time to convert the images to numpy array : 0.11924123764038086 total time to convert the images to numpy array : 0.3837575912475586 list photo_ids error: [] list photo_ids correct : [1333656278, 1333656282, 1333656286, 1333656290, 1333656294, 1333656298, 1333656301, 1333656305, 1333656309, 1333656313, 1333656317, 1333656321, 1333656325, 1333656329, 1333656478, 1333656479, 1333656480, 1333656481, 1333656482, 1333656483, 1333656484, 1333656485, 1333656486, 1333656487, 1333656488, 1333656489, 1333656490, 1333656491, 1333656492, 1333656493, 1333656494, 1333656495, 1333656496, 1333656497, 1333656498, 1333656499, 1333656500, 1333656501, 1333656502, 1333656503, 1333656504, 1333656505, 1333656506, 1333656507, 1333656508, 1333656509, 1333656510, 1333656511, 1333656512, 1333656513, 1333656515, 1333656516, 1333656517, 1333656518, 1333656519, 1333656520, 1333656521, 1333656522, 1333656523, 1333656524, 1333656525, 1333656526, 1333656527, 1333656529, 1333656530, 1333656531, 1333655894, 1333655895, 1333655896, 1333655897, 1333655898, 1333655899, 1333655900, 1333655901, 1333655902, 1333655903, 1333655904, 1333655905, 1333655906, 1333655907, 1333655908, 1333655909, 1333655910, 1333655911, 1333655912, 1333655913, 1333655914, 1333655915, 1333655916, 1333655917, 1333655918, 1333655919, 1333655920, 1333655921, 1333655922, 1333655923, 1333655924, 1333655925, 1333655926, 1333655861, 1333655862, 1333655863, 1333655864, 1333655865, 1333655866, 1333655867, 1333655868, 1333655869, 1333655870, 1333655871, 1333655872, 1333655873, 1333655874, 1333655875, 1333655876, 1333655877, 1333655878, 1333655879, 1333655880, 1333655881, 1333655882, 1333655883, 1333655884, 1333655885, 1333655886, 1333655887, 1333655888, 1333655889, 1333655890, 1333655891, 1333655892, 1333655893, 1333655927, 1333655928, 1333655929, 1333655930, 1333655931, 1333655932, 1333655934, 1333655938, 1333655942, 1333655946, 1333655950, 1333655951, 1333655952, 1333655953, 1333655954, 1333655955, 1333655956, 1333655957, 1333655958, 1333655959, 1333655960, 1333655961, 1333655962, 1333655963, 1333655964, 1333655965, 1333655966, 1333655967, 1333655968, 1333655969, 1333655970, 1333655971, 1333655973, 1333656067, 1333656068, 1333656069, 1333656070, 1333656071, 1333656072, 1333656073, 1333656074, 1333656075, 1333656076, 1333656077, 1333656078, 1333656079, 1333656080, 1333656081, 1333656082, 1333656083, 1333656084, 1333656085, 1333656086, 1333656087, 1333656088, 1333656089, 1333656090, 1333656091, 1333656092, 1333656093, 1333656094, 1333656095, 1333656096, 1333656097, 1333656098, 1333656099, 1333655974, 1333655975, 1333655976, 1333655977, 1333655978, 1333655979, 1333655980, 1333655981, 1333655982, 1333655983, 1333655984, 1333655985, 1333655986, 1333655987, 1333655988, 1333655989, 1333655990, 1333655991, 1333655992, 1333655993, 1333655994, 1333655995, 1333655996, 1333655997, 1333655998, 1333655999, 1333656000, 1333656001, 1333656002, 1333656003, 1333656004, 1333656005, 1333656006, 1333655828, 1333655829, 1333655830, 1333655831, 1333655832, 1333655833, 1333655834, 1333655835, 1333655836, 1333655837, 1333655838, 1333655839, 1333655840, 1333655841, 1333655842, 1333655843, 1333655844, 1333655845, 1333655846, 1333655847, 1333655848, 1333655849, 1333655850, 1333655851, 1333655852, 1333655853, 1333655854, 1333655855, 1333655856, 1333655857, 1333655858, 1333655859, 1333655860, 1333656007, 1333656008, 1333656009, 1333656010, 1333656011, 1333656012, 1333656013, 1333656014, 1333656015, 1333656016, 1333656017, 1333656018, 1333656019, 1333656021, 1333656022, 1333656023, 1333656024, 1333656025, 1333656026, 1333656027, 1333656028, 1333656029, 1333656030, 1333656031, 1333656032, 1333656033, 1333656034, 1333656035, 1333656036, 1333656037, 1333656038, 1333656039, 1333656040, 1333656100, 1333656101, 1333656102, 1333656103, 1333656104, 1333656105, 1333656106, 1333656107, 1333656108, 1333656109, 1333656110, 1333656111, 1333656112, 1333656113, 1333656114, 1333656115, 1333656116, 1333656117, 1333656118, 1333656119, 1333656120, 1333656135, 1333656136, 1333656137, 1333656138, 1333656139, 1333656140, 1333656141, 1333656142, 1333656143, 1333656144, 1333656145, 1333656146] number of photos to traite : 330 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10555 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.4353504180908203 time used to do the prediction : 1.1371803283691406 save descriptor for thcl : 3237 time to traite the descriptors : 1.75565505027771 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333656278 To insert : 1333656282 To insert : 1333656286 To insert : 1333656290 To insert : 1333656294 To insert : 1333656298 To insert : 1333656301 To insert : 1333656305 To insert : 1333656309 To insert : 1333656313 To insert : 1333656317 To insert : 1333656321 To insert : 1333656325 To insert : 1333656329 To insert : 1333656478 To insert : 1333656479 To insert : 1333656480 To insert : 1333656481 To insert : 1333656482 To insert : 1333656483 To insert : 1333656484 To insert : 1333656485 To insert : 1333656486 To insert : 1333656487 To insert : 1333656488 To insert : 1333656489 To insert : 1333656490 To insert : 1333656491 To insert : 1333656492 To insert : 1333656493 To insert : 1333656494 To insert : 1333656495 To insert : 1333656496 To insert : 1333656497 To insert : 1333656498 To insert : 1333656499 To insert : 1333656500 To insert : 1333656501 To insert : 1333656502 To insert : 1333656503 To insert : 1333656504 To insert : 1333656505 To insert : 1333656506 To insert : 1333656507 To insert : 1333656508 To insert : 1333656509 To insert : 1333656510 To insert : 1333656511 To insert : 1333656512 To insert : 1333656513 To insert : 1333656515 To insert : 1333656516 To insert : 1333656517 To insert : 1333656518 To insert : 1333656519 To insert : 1333656520 To insert : 1333656521 To insert : 1333656522 To insert : 1333656523 To insert : 1333656524 To insert : 1333656525 To insert : 1333656526 To insert : 1333656527 To insert : 1333656529 To insert : 1333656530 To insert : 1333656531 To insert : 1333655894 To insert : 1333655895 To insert : 1333655896 To insert : 1333655897 To insert : 1333655898 To insert : 1333655899 To insert : 1333655900 To insert : 1333655901 To insert : 1333655902 To insert : 1333655903 To insert : 1333655904 To insert : 1333655905 To insert : 1333655906 To insert : 1333655907 To insert : 1333655908 To insert : 1333655909 To insert : 1333655910 To insert : 1333655911 To insert : 1333655912 To insert : 1333655913 To insert : 1333655914 To insert : 1333655915 To insert : 1333655916 To insert : 1333655917 To insert : 1333655918 To insert : 1333655919 To insert : 1333655920 To insert : 1333655921 To insert : 1333655922 To insert : 1333655923 To insert : 1333655924 To insert : 1333655925 To insert : 1333655926 To insert : 1333655861 To insert : 1333655862 To insert : 1333655863 To insert : 1333655864 To insert : 1333655865 To insert : 1333655866 To insert : 1333655867 To insert : 1333655868 To insert : 1333655869 To insert : 1333655870 To insert : 1333655871 To insert : 1333655872 To insert : 1333655873 To insert : 1333655874 To insert : 1333655875 To insert : 1333655876 To insert : 1333655877 To insert : 1333655878 To insert : 1333655879 To insert : 1333655880 To insert : 1333655881 To insert : 1333655882 To insert : 1333655883 To insert : 1333655884 To insert : 1333655885 To insert : 1333655886 To insert : 1333655887 To insert : 1333655888 To insert : 1333655889 To insert : 1333655890 To insert : 1333655891 To insert : 1333655892 To insert : 1333655893 To insert : 1333655927 To insert : 1333655928 To insert : 1333655929 To insert : 1333655930 To insert : 1333655931 To insert : 1333655932 To insert : 1333655934 To insert : 1333655938 To insert : 1333655942 To insert : 1333655946 To insert : 1333655950 To insert : 1333655951 To insert : 1333655952 To insert : 1333655953 To insert : 1333655954 To insert : 1333655955 To insert : 1333655956 To insert : 1333655957 To insert : 1333655958 To insert : 1333655959 To insert : 1333655960 To insert : 1333655961 To insert : 1333655962 To insert : 1333655963 To insert : 1333655964 To insert : 1333655965 To insert : 1333655966 To insert : 1333655967 To insert : 1333655968 To insert : 1333655969 To insert : 1333655970 To insert : 1333655971 To insert : 1333655973 To insert : 1333656067 To insert : 1333656068 To insert : 1333656069 To insert : 1333656070 To insert : 1333656071 To insert : 1333656072 To insert : 1333656073 To insert : 1333656074 To insert : 1333656075 To insert : 1333656076 To insert : 1333656077 To insert : 1333656078 To insert : 1333656079 To insert : 1333656080 To insert : 1333656081 To insert : 1333656082 To insert : 1333656083 To insert : 1333656084 To insert : 1333656085 To insert : 1333656086 To insert : 1333656087 To insert : 1333656088 To insert : 1333656089 To insert : 1333656090 To insert : 1333656091 To insert : 1333656092 To insert : 1333656093 To insert : 1333656094 To insert : 1333656095 To insert : 1333656096 To insert : 1333656097 To insert : 1333656098 To insert : 1333656099 To insert : 1333655974 To insert : 1333655975 To insert : 1333655976 To insert : 1333655977 To insert : 1333655978 To insert : 1333655979 To insert : 1333655980 To insert : 1333655981 To insert : 1333655982 To insert : 1333655983 To insert : 1333655984 To insert : 1333655985 To insert : 1333655986 To insert : 1333655987 To insert : 1333655988 To insert : 1333655989 To insert : 1333655990 To insert : 1333655991 To insert : 1333655992 To insert : 1333655993 To insert : 1333655994 To insert : 1333655995 To insert : 1333655996 To insert : 1333655997 To insert : 1333655998 To insert : 1333655999 To insert : 1333656000 To insert : 1333656001 To insert : 1333656002 To insert : 1333656003 To insert : 1333656004 To insert : 1333656005 To insert : 1333656006 To insert : 1333655828 To insert : 1333655829 To insert : 1333655830 To insert : 1333655831 To insert : 1333655832 To insert : 1333655833 To insert : 1333655834 To insert : 1333655835 To insert : 1333655836 To insert : 1333655837 To insert : 1333655838 To insert : 1333655839 To insert : 1333655840 To insert : 1333655841 To insert : 1333655842 To insert : 1333655843 To insert : 1333655844 To insert : 1333655845 To insert : 1333655846 To insert : 1333655847 To insert : 1333655848 To insert : 1333655849 To insert : 1333655850 To insert : 1333655851 To insert : 1333655852 To insert : 1333655853 To insert : 1333655854 To insert : 1333655855 To insert : 1333655856 To insert : 1333655857 To insert : 1333655858 To insert : 1333655859 To insert : 1333655860 To insert : 1333656007 To insert : 1333656008 To insert : 1333656009 To insert : 1333656010 To insert : 1333656011 To insert : 1333656012 To insert : 1333656013 To insert : 1333656014 To insert : 1333656015 To insert : 1333656016 To insert : 1333656017 To insert : 1333656018 To insert : 1333656019 To insert : 1333656021 To insert : 1333656022 To insert : 1333656023 To insert : 1333656024 To insert : 1333656025 To insert : 1333656026 To insert : 1333656027 To insert : 1333656028 To insert : 1333656029 To insert : 1333656030 To insert : 1333656031 To insert : 1333656032 To insert : 1333656033 To insert : 1333656034 To insert : 1333656035 To insert : 1333656036 To insert : 1333656037 To insert : 1333656038 To insert : 1333656039 To insert : 1333656040 To insert : 1333656100 To insert : 1333656101 To insert : 1333656102 To insert : 1333656103 To insert : 1333656104 To insert : 1333656105 To insert : 1333656106 To insert : 1333656107 To insert : 1333656108 To insert : 1333656109 To insert : 1333656110 To insert : 1333656111 To insert : 1333656112 To insert : 1333656113 To insert : 1333656114 To insert : 1333656115 To insert : 1333656116 To insert : 1333656117 To insert : 1333656118 To insert : 1333656119 To insert : 1333656120 To insert : 1333656135 To insert : 1333656136 To insert : 1333656137 To insert : 1333656138 To insert : 1333656139 To insert : 1333656140 To insert : 1333656141 To insert : 1333656142 To insert : 1333656143 To insert : 1333656144 To insert : 1333656145 To insert : 1333656146 time to insert the descriptors : 54.73568654060364 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 514 time used for this insertion : 0.04604506492614746 save missing photos in datou_result : time spend for datou_step_exec : 63.49713921546936 time spend to save output : 0.09791684150695801 total time spend for step 6 : 63.59505605697632 step7:ventilate_hashtags_in_portfolio Sat Feb 1 09:23:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20138024 get user id for portfolio 20138024 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20138024 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PEHD','Papier','environnement','PET_fonce','carton','metal','papier','mal_croppe','Carton','flou','refus','Film_plastique','pet_clair','pehd','pet_fonce','PET_clair','Tetrapak','autre')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20138024 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PEHD','Papier','environnement','PET_fonce','carton','metal','papier','mal_croppe','Carton','flou','refus','Film_plastique','pet_clair','pehd','pet_fonce','PET_clair','Tetrapak','autre')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20138024 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PEHD','Papier','environnement','PET_fonce','carton','metal','papier','mal_croppe','Carton','flou','refus','Film_plastique','pet_clair','pehd','pet_fonce','PET_clair','Tetrapak','autre')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20138024 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PEHD','Papier','environnement','PET_fonce','carton','metal','papier','mal_croppe','Carton','flou','refus','Film_plastique','pet_clair','pehd','pet_fonce','PET_clair','Tetrapak','autre')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20138420,20138413,20138409,20138421,20138415,20138412,20138414,20138416,20138417,20138418,20138422,20138423,20138424?tags=pehd,papier,environnement,pet_fonce,carton,metal,mal_croppe,flou,refus,film_plastique,pet_clair,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20138024 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333333360, 1333333351, 1333333344, 1333333307, 1333333303] Looping around the photos to save general results len do output : 1 /20138024. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333360', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333351', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333344', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333307', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333303', None, None, None, None, None, '2536931') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012506246566772461 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.215733051300049 time spend to save output : 0.012808799743652344 total time spend for step 7 : 2.228541851043701 step8:final Sat Feb 1 09:23:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333333360: ('0.15874775508776967',), 1333333351: ('0.15874775508776967',), 1333333344: ('0.15874775508776967',), 1333333307: ('0.15874775508776967',), 1333333303: ('0.15874775508776967',)} new output for save of step final : {1333333360: ('0.15874775508776967',), 1333333351: ('0.15874775508776967',), 1333333344: ('0.15874775508776967',), 1333333307: ('0.15874775508776967',), 1333333303: ('0.15874775508776967',)} [1333333360, 1333333351, 1333333344, 1333333307, 1333333303] Looping around the photos to save general results len do output : 5 /1333333360.Didn't retrieve data . /1333333351.Didn't retrieve data . /1333333344.Didn't retrieve data . /1333333307.Didn't retrieve data . /1333333303.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333360', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333351', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333344', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333307', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333303', None, None, None, None, None, '2536931') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.011775493621826172 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11620903015136719 time spend to save output : 0.012021780014038086 total time spend for step 8 : 0.12823081016540527 step9:velours_tree Sat Feb 1 09:23:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20138420,20138413,20138409,20138421,20138415,20138412,20138414,20138416,20138417,20138418,20138422,20138423,20138424 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138420 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138413 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138409 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138421 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138415 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138412 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138414 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138416 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138417 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138418 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138422 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138423 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138424 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 330 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 5 4 4 2 1 0 4 0 4 0 4 2 0 0 3 3 4 0 4 0 0 0 3 2 0 0 3 2 2 4 4 2 0 2 4 0 2 4 4 2 2 5 5 4 4 1 0 0 3 4 4 0 4 2 0 3 3 3 0 0 0 0 0 2 0 0 2 3 2 2 4 4 4 0 4 2 0 4 2 0 2 2 2 0 5 5 4 4 2 1 0 0 0 4 4 0 0 2 3 4 4 3 5 3 0 0 0 0 0 0 0 2 0 0 0 0 4 0 4 0 4 4 0 2 5 4 4 2 1 0 4 4 0 4 2 4 0 4 0 0 4 0 2 0 0 0 2 0 0 0 3 2 4 4 0 4 0 4 4 2 4 2 5 5 4 4 1 0 0 4 4 0 4 2 4 4 0 0 4 0 0 0 2 0 0 0 0 4 4 0 0 4 0 4 4 2 2 5 3 3 2 0 3 0 0 2 3 0 5 2 0 0 0 2 0 4 3 0 0 3 0 2 0 0 5 0 2 3 0 0 0 2 3 5 5 2 4 0 2 3 0 0 0 2 3 5 5 0 0 3 2 0 1 2 0 2 2 0 2 0 1 0 1 4 0 4 4 4 2 4 2 0 0 4 2 3 4 3 2 2 0 0 1 0 2 3 2 2 0 4 0 2 0 1 1 0 2 3 2 2 4 2 0 1 1 2 0 2 2 3 0 2 4 0 0 1 2 3 2 4 0 2 0 2 1 2 2 0 2] Elapsed time: 0.059953927993774414 graph_id used : 75001 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20138420,20138413,20138409,20138421,20138415,20138412,20138414,20138416,20138417,20138418,20138422,20138423,20138424?tags=pehd,papier,environnement,pet_fonce,carton,metal,mal_croppe,flou,refus,film_plastique,pet_clair,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20138024&tree_id=75001 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1333333360, 1333333351, 1333333344, 1333333307, 1333333303] Looping around the photos to save general results len do output : 1 /20138024Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333360', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333351', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333344', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333307', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333303', None, None, None, None, None, '2536931') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012066841125488281 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.827672481536865 time spend to save output : 0.012371301651000977 total time spend for step 9 : 19.840043783187866 step10:send_mail_cod Sat Feb 1 09:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20138024_01-02-2025_09_24_17.pdf 20138402 change filename to text .imagette201384021738398257 20138395 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201383951738398257 20138403 change filename to text .change filename to text .imagette201384031738398258 20138397 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201383971738398258 20138394 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201383941738398259 20138396 imagette201383961738398260 20138398 imagette201383981738398260 20138399 imagette201383991738398260 20138400 imagette201384001738398260 20138404 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201384041738398260 20138405 imagette201384051738398261 20138406 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201384061738398261 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20138024 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20138420,20138413,20138409,20138421,20138415,20138412,20138414,20138416,20138417,20138418,20138422,20138423,20138424?tags=pehd,papier,environnement,pet_fonce,carton,metal,mal_croppe,flou,refus,film_plastique,pet_clair,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20138024&tree_id=75001 your option no_mail is active, we will not send the real mail to your client args[1333333360] : ((1333333360, -7.781804622313755, 492609224), (1333333360, -0.4544796485543658, 496442774), '0.15874775508776967') We are sending mail with results at cod@fotonower.com args[1333333351] : ((1333333351, -7.781032637658825, 492609224), (1333333351, -0.44956051454943263, 496442774), '0.15874775508776967') We are sending mail with results at cod@fotonower.com args[1333333344] : ((1333333344, -7.788164955365587, 492609224), (1333333344, -0.4452714720884697, 496442774), '0.15874775508776967') We are sending mail with results at cod@fotonower.com args[1333333307] : ((1333333307, -7.742512035321122, 492609224), (1333333307, -0.42838086830706446, 496442774), '0.15874775508776967') We are sending mail with results at cod@fotonower.com args[1333333303] : ((1333333303, -7.71590912640311, 492609224), (1333333303, -0.41600314192352245, 496442774), '0.15874775508776967') We are sending mail with results at cod@fotonower.com refus_total : 0.15874775508776967 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20138024 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20138024_01-02-2025_09_24_17.pdf results_Qualipapia_P20138024_01-02-2025_09_24_17.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20138024_01-02-2025_09_24_17.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20138024','results_Qualipapia_P20138024_01-02-2025_09_24_17.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20138024_01-02-2025_09_24_17.pdf','pdf','','0.2','0.15874775508776967') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333333360, 1333333351, 1333333344, 1333333307, 1333333303] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333360', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333351', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333344', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333307', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333303', None, None, None, None, None, '2536931') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.011823654174804688 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.673718690872192 time spend to save output : 0.011976957321166992 total time spend for step 10 : 5.685695648193359 step11:split_time_score Sat Feb 1 09:24:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 29012025 20138024 Nombre de photos uploadées : 8 / 23040 (0%) 29012025 20138024 Nombre de photos taguées (types de déchets): 8 / 8 (100%) 29012025 20138024 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00043010711669921875 elapsed_time : insert_dashboard_record_day_entry 0.021392345428466797 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.18600294426201236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20036368_29-01-2025_07_35_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20036368 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20036368 AND mptpi.`type`=4230 To do Qualite : 0.20842441869573625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20036910_29-01-2025_08_32_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20036910 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20036910 AND mptpi.`type`=4230 To do Qualite : 0.21443482252902535 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20036911_29-01-2025_08_17_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20036911 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20036911 AND mptpi.`type`=4230 To do Qualite : 0.1707806461722293 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20037385_29-01-2025_08_47_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20037385 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20037385 AND mptpi.`type`=4230 To do Qualite : 0.22718956815356856 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20037387_29-01-2025_09_46_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20037387 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20037387 AND mptpi.`type`=4230 To do Qualite : 0.15570633666357359 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20039916_29-01-2025_10_46_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20039916 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20039916 AND mptpi.`type`=4230 To do Qualite : 0.185431169976521 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20040379_29-01-2025_11_33_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040379 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20040379 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040819 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040822 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040824 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040825 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040827 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040829 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040843 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040857 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040859 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040861 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040863 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040864 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040865 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040867 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040869 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040870 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040871 order by id desc limit 1 Qualite : 0.1725364253445854 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20040873_29-01-2025_11_47_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040873 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20040873 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20040876 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20041512 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20041514 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20041516 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20041517 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20041519 order by id desc limit 1 Qualite : 0.17738300282712463 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20041521_29-01-2025_12_17_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20041521 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20041521 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046214 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046215 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046216 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046217 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046218 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046219 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046629 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046631 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046632 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046633 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046634 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046635 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046636 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046637 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046638 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046639 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046640 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046641 order by id desc limit 1 Qualite : 0.10710785513467565 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20046642_29-01-2025_18_19_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046642 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20046642 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046643 order by id desc limit 1 Qualite : 0.1891340072151034 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20046644_29-01-2025_18_33_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046644 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20046644 AND mptpi.`type`=4230 To do Qualite : 0.0929841680947616 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20046645_29-01-2025_18_12_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20046645 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20046645 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047135 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047136 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047137 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047138 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047140 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047141 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047143 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047145 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047147 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047150 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047152 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047154 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047155 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047156 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047157 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047158 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047159 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047160 order by id desc limit 1 Qualite : 0.17156971783674083 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20047161_29-01-2025_18_47_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047161 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20047161 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047162 order by id desc limit 1 Qualite : 0.17286710916783982 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20047163_29-01-2025_18_37_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047163 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20047163 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047663 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047665 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047667 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047669 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047670 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047671 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047672 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047673 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047674 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047675 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047676 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047677 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047678 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047679 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047680 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047681 order by id desc limit 1 Qualite : 0.19741147539227544 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20047682_29-01-2025_19_36_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047682 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20047682 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20047683 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048005 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048007 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048008 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048009 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048028 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048047 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048048 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048049 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048050 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048051 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048052 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048053 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048054 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048055 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048056 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048057 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048437 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048440 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048441 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048442 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048479 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048480 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048482 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048484 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048502 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048504 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048505 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048506 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048507 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048508 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048509 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048510 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048511 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048512 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048513 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048514 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048515 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048516 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048517 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048518 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048519 order by id desc limit 1 Qualite : 0.14973108246497321 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20048520_29-01-2025_20_32_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048520 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20048520 AND mptpi.`type`=4230 To do Qualite : 0.16950915367944153 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20048521_29-01-2025_20_18_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048521 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20048521 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048974 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048976 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048977 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048978 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048979 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048980 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048981 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048982 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048983 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048984 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048985 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048986 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048987 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048988 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048989 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048990 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048991 order by id desc limit 1 Qualite : 0.12018572342141506 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20048992_29-01-2025_20_49_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048992 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20048992 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20048993 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049397 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049398 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049400 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049403 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049406 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049409 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049413 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049416 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049420 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049422 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049424 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049427 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049430 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049432 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049435 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049437 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049440 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049442 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049445 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049447 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049466 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049483 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049486 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049488 order by id desc limit 1 Qualite : 0.1681746191167481 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20049490_29-01-2025_21_39_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049490 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20049490 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049846 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049847 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049849 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049851 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049853 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049855 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049857 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049859 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049860 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049861 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049862 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049863 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049864 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049865 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049867 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049886 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049903 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049904 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049905 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049906 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049907 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049908 order by id desc limit 1 Qualite : 0.18755535669973325 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20049909_29-01-2025_21_47_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049909 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20049909 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20049910 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050427 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050428 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050430 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050431 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050432 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050433 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050434 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050435 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050436 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050437 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050438 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050439 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050440 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050441 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050442 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050443 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050444 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050445 order by id desc limit 1 Qualite : 0.14794936234357733 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20050446_29-01-2025_22_32_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050446 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20050446 AND mptpi.`type`=4230 To do Qualite : 0.1489294083265289 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20050447_29-01-2025_22_38_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050447 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20050447 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050974 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050975 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050976 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050977 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052289 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052291 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052292 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052294 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052295 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052296 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052297 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052298 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052300 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050979 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050980 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050981 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050982 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050983 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050984 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050985 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050986 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050987 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050988 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050989 order by id desc limit 1 Qualite : 0.1698637489722732 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20050990_29-01-2025_22_37_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050990 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20050990 AND mptpi.`type`=4230 To do Qualite : 0.13696542889686095 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20050991_29-01-2025_23_48_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050991 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20050991 AND mptpi.`type`=4230 To do Qualite : 0.1479244128457368 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20050992_29-01-2025_23_33_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050992 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20050992 AND mptpi.`type`=4230 To do Qualite : 0.2154763446779573 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20050993_29-01-2025_22_46_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20050993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20050993 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052301 order by id desc limit 1 Qualite : 0.165225964097651 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052302_30-01-2025_06_48_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052302 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052303 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052304 order by id desc limit 1 Qualite : 0.14395412600510105 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052305_30-01-2025_06_52_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052305 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052305 AND mptpi.`type`=4230 To do Qualite : 0.12960143257453027 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052306_30-01-2025_05_48_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052306 AND mptpi.`type`=4230 To do Qualite : 0.1278488035858833 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052307_30-01-2025_04_34_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052307 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052307 AND mptpi.`type`=4230 To do Qualite : 0.1369486497233854 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052308_30-01-2025_05_22_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052308 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052308 AND mptpi.`type`=4230 To do Qualite : 0.13106712808949925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052309_30-01-2025_01_32_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052309 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052309 AND mptpi.`type`=4230 To do Qualite : 0.1698274774879824 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052310_30-01-2025_00_32_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052310 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052310 AND mptpi.`type`=4230 To do Qualite : 0.14055845555494811 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052311_30-01-2025_00_49_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052311 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052311 AND mptpi.`type`=4230 To do Qualite : 0.13664770660582215 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20052312_30-01-2025_00_17_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20052312 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20052312 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20138020 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20138021 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20138022 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20138023 order by id desc limit 1 Qualite : 0.15874775508776967 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20138024_01-02-2025_09_24_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20138024 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20138024 AND mptpi.`type`=4230 To do Qualite : 0.18309675346393697 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20138025_01-02-2025_09_00_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20138025 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20138025 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'29012025': {'nb_upload': 8, 'nb_taggue_class': 8, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333333360, 1333333351, 1333333344, 1333333307, 1333333303] Looping around the photos to save general results len do output : 1 /20138024Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333360', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333351', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333344', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333307', None, None, None, None, None, '2536931') ('4234', None, None, None, None, None, None, None, '2536931') ('4234', '20138024', '1333333303', None, None, None, None, None, '2536931') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01371145248413086 save_final save missing photos in datou_result : time spend for datou_step_exec : 186.7070460319519 time spend to save output : 0.013953208923339844 total time spend for step 11 : 186.72099924087524 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 57.27user 37.33system 7:04.76elapsed 22%CPU (0avgtext+0avgdata 2491512maxresident)k 18264inputs+23472outputs (36major+2423649minor)pagefaults 0swaps