python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2504677 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 9>5 please execute split_portfolio.py -i 20776132 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2610153'] with mtr_portfolio_ids : ['20776132'] and first list_photo_ids : [] new path : /proc/2504677/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.5523872375488281 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Feb 24 23:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-24 23:20:30.964863: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-24 23:20:30.991230: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-24 23:20:30.992809: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9ec8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-24 23:20:30.992863: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-24 23:20:30.995621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-24 23:20:31.230639: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x24474300 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-24 23:20:31.230695: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-24 23:20:31.231804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 23:20:31.232117: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 23:20:31.234307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 23:20:31.240159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 23:20:31.240641: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 23:20:31.243413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 23:20:31.244554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 23:20:31.249859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 23:20:31.251468: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 23:20:31.251560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 23:20:31.252364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-24 23:20:31.252380: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-24 23:20:31.252389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-24 23:20:31.253798: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-24 23:20:31.530085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 23:20:31.530207: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 23:20:31.530225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 23:20:31.530240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 23:20:31.530254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 23:20:31.530268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 23:20:31.530281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 23:20:31.530296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 23:20:31.531568: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 23:20:31.532836: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 23:20:31.532882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 23:20:31.532898: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 23:20:31.532912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 23:20:31.532926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 23:20:31.532940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 23:20:31.532954: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 23:20:31.532968: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 23:20:31.534163: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 23:20:31.534197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-24 23:20:31.534205: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-24 23:20:31.534212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-24 23:20:31.535476: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-24 23:20:40.296614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 23:20:40.486878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.15703 max: 144.79922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00010919570922851562 nb_pixel_total : 853 time to create 1 rle with old method : 0.001898050308227539 length of segment : 45 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00021910667419433594 length of segment : 29 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.0001666545867919922 length of segment : 32 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00018143653869628906 length of segment : 28 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.002147674560546875 length of segment : 37 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0005848407745361328 length of segment : 37 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0004951953887939453 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.96172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 163 time to create 1 rle with old method : 0.0005867481231689453 length of segment : 22 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0012888908386230469 length of segment : 34 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 41 time to create 1 rle with old method : 8.678436279296875e-05 length of segment : 7 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 40 time to create 1 rle with old method : 8.273124694824219e-05 length of segment : 7 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.41875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00011610984802246094 nb_pixel_total : 3016 time to create 1 rle with old method : 0.004081010818481445 length of segment : 115 time for calcul the mask position with numpy : 0.00017118453979492188 nb_pixel_total : 5040 time to create 1 rle with old method : 0.006413936614990234 length of segment : 120 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 1978 time to create 1 rle with old method : 0.002937793731689453 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0007627010345458984 length of segment : 28 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.00034165382385253906 length of segment : 24 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.00032520294189453125 length of segment : 27 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 204.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 76.94375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0009496212005615234 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 175.00000 molded_images shape: (1, 640, 640, 3) min: -98.37578 max: 54.61172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.73516 max: 137.92812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 406 time to create 1 rle with old method : 0.0008237361907958984 length of segment : 23 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003876686096191406 length of segment : 44 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0003037452697753906 length of segment : 17 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003871917724609375 length of segment : 13 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0004496574401855469 length of segment : 22 time for calcul the mask position with numpy : 0.0003573894500732422 nb_pixel_total : 18074 time to create 1 rle with old method : 0.025138378143310547 length of segment : 241 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.000415802001953125 length of segment : 17 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.000774383544921875 length of segment : 26 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.00045609474182128906 length of segment : 15 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0004405975341796875 length of segment : 15 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00025391578674316406 length of segment : 20 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.000644683837890625 length of segment : 25 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0003428459167480469 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.12188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004544258117675781 length of segment : 17 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 689 time to create 1 rle with old method : 0.0008897781372070312 length of segment : 41 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0004372596740722656 length of segment : 22 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1028 time to create 1 rle with old method : 0.0013604164123535156 length of segment : 44 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 2592 time to create 1 rle with old method : 0.003518819808959961 length of segment : 52 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 665 time to create 1 rle with old method : 0.0009465217590332031 length of segment : 43 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0010802745819091797 length of segment : 74 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0010175704956054688 length of segment : 25 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006821155548095703 length of segment : 29 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0012879371643066406 length of segment : 36 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.0009512901306152344 length of segment : 40 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0006856918334960938 length of segment : 36 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003764629364013672 length of segment : 18 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0006220340728759766 length of segment : 24 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0004169940948486328 length of segment : 18 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 681 time to create 1 rle with old method : 0.0010406970977783203 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.92266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 799 time to create 1 rle with old method : 0.0010361671447753906 length of segment : 44 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1129 time to create 1 rle with old method : 0.0015845298767089844 length of segment : 34 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1078 time to create 1 rle with old method : 0.00162506103515625 length of segment : 36 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 7671 time to create 1 rle with old method : 0.010226011276245117 length of segment : 268 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004930496215820312 length of segment : 43 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 1729 time to create 1 rle with old method : 0.0024213790893554688 length of segment : 123 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 1374 time to create 1 rle with old method : 0.0018362998962402344 length of segment : 43 time for calcul the mask position with numpy : 0.0003972053527832031 nb_pixel_total : 15381 time to create 1 rle with old method : 0.01968836784362793 length of segment : 217 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 1517 time to create 1 rle with old method : 0.0022420883178710938 length of segment : 43 time for calcul the mask position with numpy : 0.0005633831024169922 nb_pixel_total : 12880 time to create 1 rle with old method : 0.0163424015045166 length of segment : 257 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 1606 time to create 1 rle with old method : 0.0021719932556152344 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 198.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 82.74062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 733 time to create 1 rle with old method : 0.001016855239868164 length of segment : 30 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 1494 time to create 1 rle with old method : 0.002076387405395508 length of segment : 146 time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 3739 time to create 1 rle with old method : 0.004967212677001953 length of segment : 215 time for calcul the mask position with numpy : 0.00011396408081054688 nb_pixel_total : 1677 time to create 1 rle with old method : 0.0022895336151123047 length of segment : 106 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0017046928405761719 length of segment : 69 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 2884 time to create 1 rle with old method : 0.003891468048095703 length of segment : 181 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 166.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 50.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009949207305908203 nb_pixel_total : 105459 time to create 1 rle with old method : 0.12474322319030762 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 131.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0004341602325439453 length of segment : 16 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005440711975097656 length of segment : 25 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0010781288146972656 length of segment : 52 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00033926963806152344 length of segment : 21 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00017952919006347656 length of segment : 13 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00048232078552246094 length of segment : 18 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 3737 time to create 1 rle with old method : 0.005003929138183594 length of segment : 69 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0019578933715820312 length of segment : 49 time for calcul the mask position with numpy : 0.0007135868072509766 nb_pixel_total : 49024 time to create 1 rle with old method : 0.05745697021484375 length of segment : 243 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1425 time to create 1 rle with old method : 0.001834869384765625 length of segment : 47 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00016379356384277344 length of segment : 13 time for calcul the mask position with numpy : 0.00010538101196289062 nb_pixel_total : 3148 time to create 1 rle with old method : 0.004223823547363281 length of segment : 50 time for calcul the mask position with numpy : 0.00013017654418945312 nb_pixel_total : 3807 time to create 1 rle with old method : 0.004958391189575195 length of segment : 63 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.0001823902130126953 length of segment : 14 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003764629364013672 length of segment : 25 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00016689300537109375 length of segment : 15 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 822 time to create 1 rle with old method : 0.0011501312255859375 length of segment : 29 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004115104675292969 length of segment : 18 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006852149963378906 length of segment : 54 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0007543563842773438 length of segment : 21 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018930435180664062 length of segment : 13 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005137920379638672 length of segment : 26 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.00034618377685546875 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00016450881958007812 length of segment : 17 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003161430358886719 length of segment : 16 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0008134841918945312 length of segment : 43 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0011303424835205078 length of segment : 37 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00018858909606933594 length of segment : 13 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0006194114685058594 length of segment : 23 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002512931823730469 length of segment : 14 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003876686096191406 length of segment : 17 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00044655799865722656 length of segment : 21 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004591941833496094 length of segment : 29 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00011181831359863281 length of segment : 12 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00013446807861328125 length of segment : 8 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 1697 time to create 1 rle with old method : 0.0021872520446777344 length of segment : 71 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.00087738037109375 length of segment : 32 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0007464885711669922 length of segment : 19 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003299713134765625 length of segment : 25 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.000457763671875 length of segment : 19 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002994537353515625 length of segment : 15 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00025463104248046875 length of segment : 10 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003123283386230469 length of segment : 17 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006151199340820312 length of segment : 31 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005826950073242188 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.05703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 499 time to create 1 rle with old method : 0.001070261001586914 length of segment : 30 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1183 time to create 1 rle with old method : 0.002292156219482422 length of segment : 38 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 2 time to create 1 rle with old method : 2.47955322265625e-05 length of segment : 2 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0008311271667480469 length of segment : 18 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0007503032684326172 length of segment : 37 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0002529621124267578 length of segment : 12 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00027823448181152344 length of segment : 21 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 19 time to create 1 rle with old method : 5.2928924560546875e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.20391 max: 145.65469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 15 time to create 1 rle with old method : 5.602836608886719e-05 length of segment : 9 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 951 time to create 1 rle with old method : 0.0012826919555664062 length of segment : 44 time for calcul the mask position with numpy : 0.00016689300537109375 nb_pixel_total : 1387 time to create 1 rle with old method : 0.0020880699157714844 length of segment : 70 length of segment : 0 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00046896934509277344 length of segment : 22 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001633167266845703 length of segment : 29 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.0004909038543701172 length of segment : 33 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1442 time to create 1 rle with old method : 0.0019085407257080078 length of segment : 67 length of segment : 0 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 971 time to create 1 rle with old method : 0.0013141632080078125 length of segment : 39 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.0001366138458251953 length of segment : 27 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003387928009033203 length of segment : 35 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0013415813446044922 length of segment : 45 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.43438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.00067901611328125 length of segment : 28 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0008816719055175781 length of segment : 46 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003998279571533203 length of segment : 35 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007295608520507812 length of segment : 28 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 2427 time to create 1 rle with old method : 0.003206491470336914 length of segment : 50 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 40 time to create 1 rle with old method : 9.1552734375e-05 length of segment : 6 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.0011382102966308594 length of segment : 39 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 2658 time to create 1 rle with old method : 0.0034754276275634766 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -95.21172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2716 time to create 1 rle with old method : 0.0036487579345703125 length of segment : 108 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007786750793457031 length of segment : 23 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 2373 time to create 1 rle with old method : 0.0032601356506347656 length of segment : 62 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.24297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005660057067871094 length of segment : 43 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 9848 time to create 1 rle with old method : 0.012821197509765625 length of segment : 84 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005466938018798828 length of segment : 24 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0007734298706054688 length of segment : 26 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 70.13125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0008645057678222656 length of segment : 23 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003006458282470703 length of segment : 16 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1261 time to create 1 rle with old method : 0.0017361640930175781 length of segment : 33 time for calcul the mask position with numpy : 0.0006945133209228516 nb_pixel_total : 66629 time to create 1 rle with old method : 0.08332061767578125 length of segment : 271 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 169.00000 molded_images shape: (1, 640, 640, 3) min: -96.51641 max: 49.17422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.73125 max: 141.37734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0006031990051269531 length of segment : 23 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002949237823486328 length of segment : 43 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 24 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00040411949157714844 length of segment : 16 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 732 time to create 1 rle with old method : 0.0010471343994140625 length of segment : 39 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004286766052246094 length of segment : 34 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003750324249267578 length of segment : 15 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 18 time for calcul the mask position with numpy : 0.00016689300537109375 nb_pixel_total : 8097 time to create 1 rle with old method : 0.010466814041137695 length of segment : 105 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00035834312438964844 length of segment : 18 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.00043392181396484375 length of segment : 43 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1510 time to create 1 rle with old method : 0.0019643306732177734 length of segment : 61 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 732 time to create 1 rle with old method : 0.0011222362518310547 length of segment : 44 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009486675262451172 length of segment : 38 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00041604042053222656 length of segment : 21 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 2158 time to create 1 rle with old method : 0.002743244171142578 length of segment : 54 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00026297569274902344 length of segment : 15 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0007181167602539062 length of segment : 29 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0009739398956298828 length of segment : 75 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 828 time to create 1 rle with old method : 0.0012440681457519531 length of segment : 36 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001823902130126953 length of segment : 15 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00021505355834960938 length of segment : 17 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 705 time to create 1 rle with old method : 0.0008533000946044922 length of segment : 30 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.00075531005859375 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.07500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 811 time to create 1 rle with old method : 0.000997304916381836 length of segment : 45 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0015146732330322266 length of segment : 36 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003898143768310547 length of segment : 26 time for calcul the mask position with numpy : 0.0002262592315673828 nb_pixel_total : 9054 time to create 1 rle with old method : 0.011181831359863281 length of segment : 281 time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 1497 time to create 1 rle with old method : 0.0018072128295898438 length of segment : 114 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1362 time to create 1 rle with old method : 0.0017044544219970703 length of segment : 46 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1622 time to create 1 rle with old method : 0.0021834373474121094 length of segment : 43 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005276203155517578 length of segment : 23 time for calcul the mask position with numpy : 0.0003838539123535156 nb_pixel_total : 19676 time to create 1 rle with old method : 0.023926973342895508 length of segment : 199 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 10211 time to create 1 rle with old method : 0.012642145156860352 length of segment : 221 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1385 time to create 1 rle with old method : 0.0017955303192138672 length of segment : 42 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 195.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 78.86562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 848 time to create 1 rle with old method : 0.0011219978332519531 length of segment : 34 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1209 time to create 1 rle with old method : 0.0015881061553955078 length of segment : 62 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1295 time to create 1 rle with old method : 0.001622915267944336 length of segment : 64 time for calcul the mask position with numpy : 0.0001773834228515625 nb_pixel_total : 3937 time to create 1 rle with old method : 0.0048406124114990234 length of segment : 215 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 3496 time to create 1 rle with old method : 0.006036043167114258 length of segment : 194 Processing 1 images image shape: (280, 400, 3) min: 9.00000 max: 170.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 52.81875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001195669174194336 nb_pixel_total : 105464 time to create 1 rle with old method : 0.12218093872070312 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 240.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.76406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00035381317138671875 length of segment : 15 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 583 time to create 1 rle with old method : 0.0008194446563720703 length of segment : 37 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001709461212158203 length of segment : 11 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.00046181678771972656 length of segment : 24 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0018303394317626953 length of segment : 48 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00036907196044921875 length of segment : 19 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0010764598846435547 length of segment : 31 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0004534721374511719 length of segment : 24 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009114742279052734 length of segment : 51 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.00012874603271484375 length of segment : 13 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 3435 time to create 1 rle with old method : 0.004278898239135742 length of segment : 51 time for calcul the mask position with numpy : 0.0005805492401123047 nb_pixel_total : 48786 time to create 1 rle with old method : 0.056923866271972656 length of segment : 274 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1307 time to create 1 rle with old method : 0.0016894340515136719 length of segment : 45 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005371570587158203 length of segment : 33 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003762245178222656 length of segment : 28 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.00041675567626953125 length of segment : 20 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00019097328186035156 length of segment : 13 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.000553131103515625 length of segment : 25 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004875659942626953 length of segment : 26 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00010228157043457031 length of segment : 11 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006766319274902344 length of segment : 38 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00021839141845703125 length of segment : 12 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.00042319297790527344 length of segment : 21 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007905960083007812 length of segment : 37 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005600452423095703 length of segment : 28 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002830028533935547 length of segment : 21 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.0010704994201660156 length of segment : 35 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0005230903625488281 length of segment : 21 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.0002377033233642578 length of segment : 16 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002834796905517578 length of segment : 10 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00022077560424804688 length of segment : 11 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003676414489746094 length of segment : 24 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0010602474212646484 length of segment : 35 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002465248107910156 length of segment : 17 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0006363391876220703 length of segment : 22 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006461143493652344 length of segment : 31 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.20156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005602836608886719 length of segment : 27 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0017333030700683594 length of segment : 39 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005316734313964844 length of segment : 19 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001728534698486328 length of segment : 18 length of segment : 0 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00018644332885742188 length of segment : 12 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1230 time to create 1 rle with old method : 0.0016748905181884766 length of segment : 42 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 37152 time to create 1 rle with old method : 0.044335126876831055 length of segment : 223 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.29375 max: 149.34609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00014972686767578125 length of segment : 31 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1056 time to create 1 rle with old method : 0.0014700889587402344 length of segment : 40 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 996 time to create 1 rle with old method : 0.0013515949249267578 length of segment : 42 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 14 time to create 1 rle with old method : 5.53131103515625e-05 length of segment : 10 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00035381317138671875 length of segment : 20 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 4717 time to create 1 rle with old method : 0.005993843078613281 length of segment : 61 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 906 time to create 1 rle with old method : 0.0011942386627197266 length of segment : 44 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00031495094299316406 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.47734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0010309219360351562 length of segment : 34 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007143020629882812 length of segment : 34 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 2098 time to create 1 rle with old method : 0.002705812454223633 length of segment : 53 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0011143684387207031 length of segment : 37 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 668 time to create 1 rle with old method : 0.0009641647338867188 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -97.93438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 4035 time to create 1 rle with old method : 0.00500178337097168 length of segment : 64 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 2191 time to create 1 rle with old method : 0.002927541732788086 length of segment : 49 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1913 time to create 1 rle with old method : 0.002602815628051758 length of segment : 45 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 8045 time to create 1 rle with old method : 0.009616851806640625 length of segment : 112 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1304 time to create 1 rle with old method : 0.001710653305053711 length of segment : 70 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.0008351802825927734 length of segment : 48 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.40078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0008730888366699219 length of segment : 25 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 719 time to create 1 rle with old method : 0.0010263919830322266 length of segment : 45 time for calcul the mask position with numpy : 0.0007386207580566406 nb_pixel_total : 72195 time to create 1 rle with old method : 0.08527135848999023 length of segment : 302 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 164.00000 molded_images shape: (1, 640, 640, 3) min: -93.68828 max: 44.19375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013146400451660156 nb_pixel_total : 151262 time to create 1 rle with new method : 0.0018925666809082031 length of segment : 395 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.45781 max: 130.56875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005698204040527344 length of segment : 24 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.0004258155822753906 length of segment : 15 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0001952648162841797 length of segment : 17 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.00039696693420410156 length of segment : 25 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00042557716369628906 length of segment : 23 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.000152587890625 length of segment : 41 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00030517578125 length of segment : 16 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0004706382751464844 length of segment : 19 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00018334388732910156 length of segment : 14 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0008306503295898438 length of segment : 41 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 561 time to create 1 rle with old method : 0.0008907318115234375 length of segment : 24 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00033926963806152344 length of segment : 20 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 669 time to create 1 rle with old method : 0.0009710788726806641 length of segment : 41 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1354 time to create 1 rle with old method : 0.0017971992492675781 length of segment : 82 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0003170967102050781 length of segment : 15 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.00045013427734375 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.11016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 920 time to create 1 rle with old method : 0.0012209415435791016 length of segment : 45 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0010058879852294922 length of segment : 46 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00042629241943359375 length of segment : 19 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 977 time to create 1 rle with old method : 0.0013012886047363281 length of segment : 35 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.000202178955078125 length of segment : 13 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003075599670410156 length of segment : 18 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.000629425048828125 length of segment : 25 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 851 time to create 1 rle with old method : 0.0016241073608398438 length of segment : 78 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.0002574920654296875 length of segment : 19 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0008380413055419922 length of segment : 28 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1257 time to create 1 rle with old method : 0.0017919540405273438 length of segment : 49 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 2108 time to create 1 rle with old method : 0.0028395652770996094 length of segment : 50 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 2104 time to create 1 rle with old method : 0.002756357192993164 length of segment : 45 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 762 time to create 1 rle with old method : 0.0014717578887939453 length of segment : 36 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 2107 time to create 1 rle with old method : 0.0030646324157714844 length of segment : 51 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 746 time to create 1 rle with old method : 0.0009639263153076172 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.02422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1052 time to create 1 rle with old method : 0.0020742416381835938 length of segment : 35 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0013511180877685547 length of segment : 42 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0007252693176269531 length of segment : 24 time for calcul the mask position with numpy : 0.0001418590545654297 nb_pixel_total : 1515 time to create 1 rle with old method : 0.002661466598510742 length of segment : 120 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 2169 time to create 1 rle with old method : 0.0028867721557617188 length of segment : 49 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1320 time to create 1 rle with old method : 0.0017480850219726562 length of segment : 41 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0017821788787841797 length of segment : 42 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 2114 time to create 1 rle with old method : 0.002808809280395508 length of segment : 48 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 179.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 60.27187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 1534 time to create 1 rle with old method : 0.002286672592163086 length of segment : 79 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.0007166862487792969 length of segment : 65 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0015501976013183594 length of segment : 74 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0008711814880371094 length of segment : 28 time for calcul the mask position with numpy : 0.0001628398895263672 nb_pixel_total : 2762 time to create 1 rle with old method : 0.0035631656646728516 length of segment : 177 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 3419 time to create 1 rle with old method : 0.004872560501098633 length of segment : 214 Processing 1 images image shape: (280, 400, 3) min: 7.00000 max: 159.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 46.43594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0011560916900634766 nb_pixel_total : 105683 time to create 1 rle with old method : 0.12015557289123535 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 122.26797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005679130554199219 length of segment : 25 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007669925689697266 length of segment : 35 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00030732154846191406 length of segment : 16 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.0002257823944091797 length of segment : 17 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008590221405029297 length of segment : 23 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 3680 time to create 1 rle with old method : 0.004662275314331055 length of segment : 199 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.00038814544677734375 length of segment : 17 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1321 time to create 1 rle with old method : 0.001795053482055664 length of segment : 50 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.0001342296600341797 length of segment : 13 time for calcul the mask position with numpy : 0.0006425380706787109 nb_pixel_total : 51309 time to create 1 rle with old method : 0.05858302116394043 length of segment : 246 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 675 time to create 1 rle with old method : 0.0009763240814208984 length of segment : 48 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005321502685546875 length of segment : 33 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0004725456237792969 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 118.63125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 983 time to create 1 rle with old method : 0.0013401508331298828 length of segment : 40 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005309581756591797 length of segment : 31 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005066394805908203 length of segment : 24 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0010030269622802734 length of segment : 41 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0006227493286132812 length of segment : 16 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00037407875061035156 length of segment : 19 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00012254714965820312 length of segment : 8 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007693767547607422 length of segment : 40 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006225109100341797 length of segment : 32 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00017213821411132812 length of segment : 13 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.00106048583984375 length of segment : 36 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0003407001495361328 length of segment : 11 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.33828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00022101402282714844 length of segment : 17 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00039505958557128906 length of segment : 24 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 19 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00021147727966308594 length of segment : 14 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1105 time to create 1 rle with old method : 0.0024254322052001953 length of segment : 40 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 1150 time to create 1 rle with old method : 0.0014600753784179688 length of segment : 39 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 20 time to create 1 rle with old method : 5.555152893066406e-05 length of segment : 4 time for calcul the mask position with numpy : 0.0004425048828125 nb_pixel_total : 37745 time to create 1 rle with old method : 0.04805397987365723 length of segment : 252 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.05547 max: 145.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.00010895729064941406 length of segment : 20 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1026 time to create 1 rle with old method : 0.0013935565948486328 length of segment : 40 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.0013041496276855469 length of segment : 36 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0014023780822753906 length of segment : 38 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0002148151397705078 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.10625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 745 time to create 1 rle with old method : 0.0010662078857421875 length of segment : 38 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2473 time to create 1 rle with old method : 0.0032591819763183594 length of segment : 51 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004944801330566406 length of segment : 31 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005435943603515625 length of segment : 43 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0010306835174560547 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -93.48906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 4742 time to create 1 rle with old method : 0.006177425384521484 length of segment : 72 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 2119 time to create 1 rle with old method : 0.002813100814819336 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.00469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0015723705291748047 length of segment : 73 time for calcul the mask position with numpy : 0.00012302398681640625 nb_pixel_total : 8805 time to create 1 rle with old method : 0.011215448379516602 length of segment : 79 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 422 time to create 1 rle with old method : 0.0007407665252685547 length of segment : 26 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 688 time to create 1 rle with old method : 0.0009415149688720703 length of segment : 46 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0008387565612792969 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.00234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007612705230712891 length of segment : 22 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1277 time to create 1 rle with old method : 0.0017495155334472656 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 24.00000 max: 171.00000 molded_images shape: (1, 640, 640, 3) min: -92.87578 max: 51.42422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 224.00000 molded_images shape: (1, 640, 640, 3) min: -113.43438 max: 110.66641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.00028967857360839844 length of segment : 34 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005724430084228516 length of segment : 24 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00040793418884277344 length of segment : 20 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003669261932373047 length of segment : 14 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002422332763671875 length of segment : 11 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.00112152099609375 length of segment : 25 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.001085519790649414 length of segment : 66 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002655982971191406 length of segment : 13 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.00045943260192871094 length of segment : 23 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00027370452880859375 length of segment : 15 time for calcul the mask position with numpy : 0.000217437744140625 nb_pixel_total : 7297 time to create 1 rle with old method : 0.009659290313720703 length of segment : 187 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00036716461181640625 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.62188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004868507385253906 length of segment : 28 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0009477138519287109 length of segment : 43 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0011353492736816406 length of segment : 33 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003142356872558594 length of segment : 19 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 1210 time to create 1 rle with old method : 0.0016071796417236328 length of segment : 55 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1506 time to create 1 rle with old method : 0.002206563949584961 length of segment : 47 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005168914794921875 length of segment : 22 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005691051483154297 length of segment : 40 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 735 time to create 1 rle with old method : 0.0010182857513427734 length of segment : 35 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010612010955810547 length of segment : 31 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 743 time to create 1 rle with old method : 0.001018524169921875 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.59453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008225440979003906 length of segment : 41 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.001445770263671875 length of segment : 34 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1963 time to create 1 rle with old method : 0.002526521682739258 length of segment : 131 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003924369812011719 length of segment : 21 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1745 time to create 1 rle with old method : 0.0024673938751220703 length of segment : 39 time for calcul the mask position with numpy : 0.0003077983856201172 nb_pixel_total : 8576 time to create 1 rle with old method : 0.012176990509033203 length of segment : 116 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004642009735107422 length of segment : 48 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1403 time to create 1 rle with old method : 0.0018134117126464844 length of segment : 44 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1416 time to create 1 rle with old method : 0.0018603801727294922 length of segment : 45 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 166.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 50.99062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 15.00000 max: 161.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 47.36953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009834766387939453 nb_pixel_total : 105788 time to create 1 rle with old method : 0.12234139442443848 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 127.52578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 15 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006916522979736328 length of segment : 32 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005304813385009766 length of segment : 24 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.00186920166015625 length of segment : 108 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.0001513957977294922 length of segment : 12 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0005729198455810547 length of segment : 26 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 2390 time to create 1 rle with old method : 0.003239870071411133 length of segment : 67 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003974437713623047 length of segment : 18 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 948 time to create 1 rle with old method : 0.0012922286987304688 length of segment : 50 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004718303680419922 length of segment : 28 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 21 time to create 1 rle with old method : 5.8650970458984375e-05 length of segment : 7 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005767345428466797 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.47891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005309581756591797 length of segment : 26 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1026 time to create 1 rle with old method : 0.0014302730560302734 length of segment : 40 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009353160858154297 length of segment : 40 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0008718967437744141 length of segment : 16 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004382133483886719 length of segment : 29 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 904 time to create 1 rle with old method : 0.0013642311096191406 length of segment : 49 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006756782531738281 length of segment : 31 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.001046895980834961 length of segment : 36 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0004096031188964844 length of segment : 20 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001697540283203125 length of segment : 12 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 872 time to create 1 rle with old method : 0.0011751651763916016 length of segment : 32 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.83828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 length of segment : 0 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006012916564941406 length of segment : 27 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00034046173095703125 length of segment : 20 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003485679626464844 length of segment : 21 length of segment : 0 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018644332885742188 length of segment : 12 length of segment : 0 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00035691261291503906 length of segment : 16 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003955364227294922 length of segment : 19 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 15 time to create 1 rle with old method : 5.1021575927734375e-05 length of segment : 3 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005991458892822266 length of segment : 34 Detection mask done ! Trying to reset tf kernel 2505241 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 555 tf kernel not reseted sub process len(results) : 425 len(list_Values) 425 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 425 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5844 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 425 chid ids of type : 4228 Number RLEs to save : 20079 save missing photos in datou_result : time spend for datou_step_exec : 30.600142240524292 time spend to save output : 1.299806833267212 total time spend for step 1 : 31.899949073791504 step2:brightness Mon Feb 24 23:21:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740435627_2504677_1339355524_a44c02ec676c6598df05d5c5a7afc3aa.jpg treat image : temp/1740435627_2504677_1339355523_2756d1672480e9f6b409f4eea40004b2.jpg treat image : temp/1740435627_2504677_1339355521_3f1a84bb9fefe09fae89acab80345fb9.jpg treat image : temp/1740435627_2504677_1339355518_bdf06fed86203438a967eb88a820ba39.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.01393270492553711 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.012655258178710938 save missing photos in datou_result : time spend for datou_step_exec : 0.9149086475372314 time spend to save output : 0.03240656852722168 total time spend for step 2 : 0.9473152160644531 step3:blur_detection Mon Feb 24 23:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740435627_2504677_1339355524_a44c02ec676c6598df05d5c5a7afc3aa.jpg resize: (1080, 1920) 1339355524 -7.068925290264646 treat image : temp/1740435627_2504677_1339355523_2756d1672480e9f6b409f4eea40004b2.jpg resize: (1080, 1920) 1339355523 -7.008183180293233 treat image : temp/1740435627_2504677_1339355521_3f1a84bb9fefe09fae89acab80345fb9.jpg resize: (1080, 1920) 1339355521 -6.622860098694158 treat image : temp/1740435627_2504677_1339355518_bdf06fed86203438a967eb88a820ba39.jpg resize: (1080, 1920) 1339355518 -6.398674612915458 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.013959407806396484 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.014730691909790039 save missing photos in datou_result : time spend for datou_step_exec : 3.923618793487549 time spend to save output : 0.03422069549560547 total time spend for step 3 : 3.9578394889831543 step4:rle_unique_nms_with_priority Mon Feb 24 23:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 425 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 114 nb_hashtags : 5 time to prepare the origin masks : 1.112203598022461 time for calcul the mask position with numpy : 0.06398200988769531 nb_pixel_total : 1808897 time to create 1 rle with new method : 0.797020435333252 time for calcul the mask position with numpy : 0.009911060333251953 nb_pixel_total : 5040 time to create 1 rle with old method : 0.005742788314819336 time for calcul the mask position with numpy : 0.008485078811645508 nb_pixel_total : 853 time to create 1 rle with old method : 0.0010216236114501953 time for calcul the mask position with numpy : 0.008426666259765625 nb_pixel_total : 229 time to create 1 rle with old method : 0.00027489662170410156 time for calcul the mask position with numpy : 0.008381366729736328 nb_pixel_total : 23 time to create 1 rle with old method : 3.4332275390625e-05 time for calcul the mask position with numpy : 0.008397102355957031 nb_pixel_total : 55 time to create 1 rle with old method : 7.152557373046875e-05 time for calcul the mask position with numpy : 0.008348464965820312 nb_pixel_total : 11 time to create 1 rle with old method : 2.193450927734375e-05 time for calcul the mask position with numpy : 0.008374691009521484 nb_pixel_total : 72 time to create 1 rle with old method : 9.1552734375e-05 time for calcul the mask position with numpy : 0.008395910263061523 nb_pixel_total : 163 time to create 1 rle with old method : 0.00020503997802734375 time for calcul the mask position with numpy : 0.00837850570678711 nb_pixel_total : 141 time to create 1 rle with old method : 0.0001971721649169922 time for calcul the mask position with numpy : 0.008380413055419922 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003859996795654297 time for calcul the mask position with numpy : 0.008356332778930664 nb_pixel_total : 41 time to create 1 rle with old method : 5.2928924560546875e-05 time for calcul the mask position with numpy : 0.00834798812866211 nb_pixel_total : 188 time to create 1 rle with old method : 0.00023055076599121094 time for calcul the mask position with numpy : 0.008403778076171875 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002713203430175781 time for calcul the mask position with numpy : 0.008365392684936523 nb_pixel_total : 1978 time to create 1 rle with old method : 0.0023179054260253906 time for calcul the mask position with numpy : 0.008377790451049805 nb_pixel_total : 476 time to create 1 rle with old method : 0.0005755424499511719 time for calcul the mask position with numpy : 0.008322954177856445 nb_pixel_total : 3016 time to create 1 rle with old method : 0.0037229061126708984 time for calcul the mask position with numpy : 0.008365154266357422 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006718635559082031 time for calcul the mask position with numpy : 0.008335113525390625 nb_pixel_total : 7671 time to create 1 rle with old method : 0.009255647659301758 time for calcul the mask position with numpy : 0.0083770751953125 nb_pixel_total : 799 time to create 1 rle with old method : 0.0009493827819824219 time for calcul the mask position with numpy : 0.008576393127441406 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003037452697753906 time for calcul the mask position with numpy : 0.008422374725341797 nb_pixel_total : 1374 time to create 1 rle with old method : 0.001583099365234375 time for calcul the mask position with numpy : 0.008447885513305664 nb_pixel_total : 1129 time to create 1 rle with old method : 0.0013303756713867188 time for calcul the mask position with numpy : 0.008473396301269531 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003211498260498047 time for calcul the mask position with numpy : 0.008506059646606445 nb_pixel_total : 17828 time to create 1 rle with old method : 0.02030777931213379 time for calcul the mask position with numpy : 0.008487939834594727 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004241466522216797 time for calcul the mask position with numpy : 0.008407831192016602 nb_pixel_total : 12742 time to create 1 rle with old method : 0.014481306076049805 time for calcul the mask position with numpy : 0.008495330810546875 nb_pixel_total : 733 time to create 1 rle with old method : 0.0008637905120849609 time for calcul the mask position with numpy : 0.008441448211669922 nb_pixel_total : 1494 time to create 1 rle with old method : 0.00177764892578125 time for calcul the mask position with numpy : 0.008293628692626953 nb_pixel_total : 3739 time to create 1 rle with old method : 0.00442814826965332 time for calcul the mask position with numpy : 0.008347272872924805 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007965564727783203 time for calcul the mask position with numpy : 0.00836038589477539 nb_pixel_total : 15381 time to create 1 rle with old method : 0.01727890968322754 time for calcul the mask position with numpy : 0.00849151611328125 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003466606140136719 time for calcul the mask position with numpy : 0.00838470458984375 nb_pixel_total : 51 time to create 1 rle with old method : 0.0001201629638671875 time for calcul the mask position with numpy : 0.008362054824829102 nb_pixel_total : 1327 time to create 1 rle with old method : 0.0015344619750976562 time for calcul the mask position with numpy : 0.008305072784423828 nb_pixel_total : 1729 time to create 1 rle with old method : 0.0020127296447753906 time for calcul the mask position with numpy : 0.008358478546142578 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003287792205810547 time for calcul the mask position with numpy : 0.008324861526489258 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008356571197509766 time for calcul the mask position with numpy : 0.00834202766418457 nb_pixel_total : 114 time to create 1 rle with old method : 0.00013780593872070312 time for calcul the mask position with numpy : 0.008366584777832031 nb_pixel_total : 834 time to create 1 rle with old method : 0.0009791851043701172 time for calcul the mask position with numpy : 0.008373022079467773 nb_pixel_total : 112 time to create 1 rle with old method : 0.00013828277587890625 time for calcul the mask position with numpy : 0.008383750915527344 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002338886260986328 time for calcul the mask position with numpy : 0.008347511291503906 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003337860107421875 time for calcul the mask position with numpy : 0.008359432220458984 nb_pixel_total : 689 time to create 1 rle with old method : 0.0007970333099365234 time for calcul the mask position with numpy : 0.008353471755981445 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003151893615722656 time for calcul the mask position with numpy : 0.008358001708984375 nb_pixel_total : 665 time to create 1 rle with old method : 0.0007729530334472656 time for calcul the mask position with numpy : 0.008357048034667969 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007450580596923828 time for calcul the mask position with numpy : 0.008349180221557617 nb_pixel_total : 406 time to create 1 rle with old method : 0.00047087669372558594 time for calcul the mask position with numpy : 0.00837564468383789 nb_pixel_total : 14 time to create 1 rle with old method : 3.361701965332031e-05 time for calcul the mask position with numpy : 0.008371114730834961 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003275871276855469 time for calcul the mask position with numpy : 0.008399486541748047 nb_pixel_total : 27 time to create 1 rle with old method : 5.14984130859375e-05 time for calcul the mask position with numpy : 0.00835871696472168 nb_pixel_total : 247 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.008368492126464844 nb_pixel_total : 231 time to create 1 rle with old method : 0.00026607513427734375 time for calcul the mask position with numpy : 0.00836038589477539 nb_pixel_total : 1028 time to create 1 rle with old method : 0.0011653900146484375 time for calcul the mask position with numpy : 0.008350610733032227 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0014493465423583984 time for calcul the mask position with numpy : 0.00834202766418457 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0012955665588378906 time for calcul the mask position with numpy : 0.008365631103515625 nb_pixel_total : 2592 time to create 1 rle with old method : 0.0029196739196777344 time for calcul the mask position with numpy : 0.008473873138427734 nb_pixel_total : 19 time to create 1 rle with old method : 5.650520324707031e-05 time for calcul the mask position with numpy : 0.008449792861938477 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005254745483398438 time for calcul the mask position with numpy : 0.008412361145019531 nb_pixel_total : 37 time to create 1 rle with old method : 9.250640869140625e-05 time for calcul the mask position with numpy : 0.008370161056518555 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008604526519775391 time for calcul the mask position with numpy : 0.008381843566894531 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005130767822265625 time for calcul the mask position with numpy : 0.008396387100219727 nb_pixel_total : 26 time to create 1 rle with old method : 4.744529724121094e-05 time for calcul the mask position with numpy : 0.008380889892578125 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002799034118652344 time for calcul the mask position with numpy : 0.008378028869628906 nb_pixel_total : 74 time to create 1 rle with old method : 0.00010037422180175781 time for calcul the mask position with numpy : 0.00908970832824707 nb_pixel_total : 105459 time to create 1 rle with old method : 0.11660051345825195 time for calcul the mask position with numpy : 0.00850367546081543 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.00853109359741211 nb_pixel_total : 261 time to create 1 rle with old method : 0.00036334991455078125 time for calcul the mask position with numpy : 0.008575201034545898 nb_pixel_total : 63 time to create 1 rle with old method : 0.00011086463928222656 time for calcul the mask position with numpy : 0.008777618408203125 nb_pixel_total : 44975 time to create 1 rle with old method : 0.05241990089416504 time for calcul the mask position with numpy : 0.008413314819335938 nb_pixel_total : 1697 time to create 1 rle with old method : 0.0019512176513671875 time for calcul the mask position with numpy : 0.008388757705688477 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003159046173095703 time for calcul the mask position with numpy : 0.0083770751953125 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002830028533935547 time for calcul the mask position with numpy : 0.008373498916625977 nb_pixel_total : 108 time to create 1 rle with old method : 0.00013256072998046875 time for calcul the mask position with numpy : 0.008371353149414062 nb_pixel_total : 13 time to create 1 rle with old method : 2.5272369384765625e-05 time for calcul the mask position with numpy : 0.008339405059814453 nb_pixel_total : 3496 time to create 1 rle with old method : 0.00396275520324707 time for calcul the mask position with numpy : 0.008362531661987305 nb_pixel_total : 256 time to create 1 rle with old method : 0.00033211708068847656 time for calcul the mask position with numpy : 0.008380889892578125 nb_pixel_total : 92 time to create 1 rle with old method : 0.00011348724365234375 time for calcul the mask position with numpy : 0.008350372314453125 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001316070556640625 time for calcul the mask position with numpy : 0.008358001708984375 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005953311920166016 time for calcul the mask position with numpy : 0.008339643478393555 nb_pixel_total : 114 time to create 1 rle with old method : 0.00014472007751464844 time for calcul the mask position with numpy : 0.008358478546142578 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006015300750732422 time for calcul the mask position with numpy : 0.008340597152709961 nb_pixel_total : 594 time to create 1 rle with old method : 0.0006852149963378906 time for calcul the mask position with numpy : 0.008331060409545898 nb_pixel_total : 93 time to create 1 rle with old method : 0.00011181831359863281 time for calcul the mask position with numpy : 0.00834512710571289 nb_pixel_total : 213 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.008353948593139648 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005354881286621094 time for calcul the mask position with numpy : 0.008359909057617188 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004074573516845703 time for calcul the mask position with numpy : 0.008327484130859375 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009305477142333984 time for calcul the mask position with numpy : 0.008332490921020508 nb_pixel_total : 190 time to create 1 rle with old method : 0.00022649765014648438 time for calcul the mask position with numpy : 0.008335351943969727 nb_pixel_total : 307 time to create 1 rle with old method : 0.000370025634765625 time for calcul the mask position with numpy : 0.008348226547241211 nb_pixel_total : 1183 time to create 1 rle with old method : 0.0014269351959228516 time for calcul the mask position with numpy : 0.008349180221557617 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003540515899658203 time for calcul the mask position with numpy : 0.008368492126464844 nb_pixel_total : 107 time to create 1 rle with old method : 0.00013828277587890625 time for calcul the mask position with numpy : 0.008361101150512695 nb_pixel_total : 182 time to create 1 rle with old method : 0.00021839141845703125 time for calcul the mask position with numpy : 0.008340835571289062 nb_pixel_total : 232 time to create 1 rle with old method : 0.000274658203125 time for calcul the mask position with numpy : 0.008352518081665039 nb_pixel_total : 437 time to create 1 rle with old method : 0.0004975795745849609 time for calcul the mask position with numpy : 0.008372783660888672 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004429817199707031 time for calcul the mask position with numpy : 0.00840902328491211 nb_pixel_total : 55 time to create 1 rle with old method : 0.00012874603271484375 time for calcul the mask position with numpy : 0.008351802825927734 nb_pixel_total : 143 time to create 1 rle with old method : 0.00018262863159179688 time for calcul the mask position with numpy : 0.008344411849975586 nb_pixel_total : 19 time to create 1 rle with old method : 2.956390380859375e-05 time for calcul the mask position with numpy : 0.008363962173461914 nb_pixel_total : 106 time to create 1 rle with old method : 0.00013136863708496094 time for calcul the mask position with numpy : 0.008331775665283203 nb_pixel_total : 737 time to create 1 rle with old method : 0.0008473396301269531 time for calcul the mask position with numpy : 0.00834345817565918 nb_pixel_total : 142 time to create 1 rle with old method : 0.00018072128295898438 time for calcul the mask position with numpy : 0.008361577987670898 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006239414215087891 time for calcul the mask position with numpy : 0.008341789245605469 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0017290115356445312 time for calcul the mask position with numpy : 0.00836038589477539 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004317760467529297 time for calcul the mask position with numpy : 0.008340597152709961 nb_pixel_total : 405 time to create 1 rle with old method : 0.0004870891571044922 time for calcul the mask position with numpy : 0.008345603942871094 nb_pixel_total : 2 time to create 1 rle with old method : 8.821487426757812e-06 time for calcul the mask position with numpy : 0.008362770080566406 nb_pixel_total : 62 time to create 1 rle with old method : 8.273124694824219e-05 time for calcul the mask position with numpy : 0.008368968963623047 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004100799560546875 time for calcul the mask position with numpy : 0.008371829986572266 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003108978271484375 time for calcul the mask position with numpy : 0.008374452590942383 nb_pixel_total : 246 time to create 1 rle with old method : 0.00027942657470703125 time for calcul the mask position with numpy : 0.00835728645324707 nb_pixel_total : 90 time to create 1 rle with old method : 0.00010967254638671875 time for calcul the mask position with numpy : 0.00839543342590332 nb_pixel_total : 422 time to create 1 rle with old method : 0.0004870891571044922 time for calcul the mask position with numpy : 0.008342742919921875 nb_pixel_total : 52 time to create 1 rle with old method : 7.82012939453125e-05 create new chi : 2.133784532546997 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0071680545806884766 batch 1 Loaded 115 chid ids of type : 4230 Number RLEs to save : 10805 TO DO : save crop sub photo not yet done ! save time : 0.8926727771759033 nb_obj : 113 nb_hashtags : 6 time to prepare the origin masks : 2.326827049255371 time for calcul the mask position with numpy : 0.04011106491088867 nb_pixel_total : 1705563 time to create 1 rle with new method : 0.4788177013397217 time for calcul the mask position with numpy : 0.0067291259765625 nb_pixel_total : 951 time to create 1 rle with old method : 0.0011115074157714844 time for calcul the mask position with numpy : 0.00826716423034668 nb_pixel_total : 66483 time to create 1 rle with old method : 0.07491135597229004 time for calcul the mask position with numpy : 0.008388042449951172 nb_pixel_total : 319 time to create 1 rle with old method : 0.0004994869232177734 time for calcul the mask position with numpy : 0.007630825042724609 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001385211944580078 time for calcul the mask position with numpy : 0.006076335906982422 nb_pixel_total : 1442 time to create 1 rle with old method : 0.0017964839935302734 time for calcul the mask position with numpy : 0.005855560302734375 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006926059722900391 time for calcul the mask position with numpy : 0.0058934688568115234 nb_pixel_total : 525 time to create 1 rle with old method : 0.0005717277526855469 time for calcul the mask position with numpy : 0.0058383941650390625 nb_pixel_total : 10 time to create 1 rle with old method : 3.886222839355469e-05 time for calcul the mask position with numpy : 0.006678342819213867 nb_pixel_total : 523 time to create 1 rle with old method : 0.0005929470062255859 time for calcul the mask position with numpy : 0.007170677185058594 nb_pixel_total : 91 time to create 1 rle with old method : 0.00015115737915039062 time for calcul the mask position with numpy : 0.008069515228271484 nb_pixel_total : 7 time to create 1 rle with old method : 3.457069396972656e-05 time for calcul the mask position with numpy : 0.009315013885498047 nb_pixel_total : 42 time to create 1 rle with old method : 9.870529174804688e-05 time for calcul the mask position with numpy : 0.008824586868286133 nb_pixel_total : 40 time to create 1 rle with old method : 7.05718994140625e-05 time for calcul the mask position with numpy : 0.007406473159790039 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003085136413574219 time for calcul the mask position with numpy : 0.00836634635925293 nb_pixel_total : 231 time to create 1 rle with old method : 0.00031948089599609375 time for calcul the mask position with numpy : 0.009046077728271484 nb_pixel_total : 2427 time to create 1 rle with old method : 0.0029082298278808594 time for calcul the mask position with numpy : 0.009118318557739258 nb_pixel_total : 4 time to create 1 rle with old method : 3.1948089599609375e-05 time for calcul the mask position with numpy : 0.009476661682128906 nb_pixel_total : 15 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.009125471115112305 nb_pixel_total : 412 time to create 1 rle with old method : 0.0004868507385253906 time for calcul the mask position with numpy : 0.009001016616821289 nb_pixel_total : 1387 time to create 1 rle with old method : 0.0017044544219970703 time for calcul the mask position with numpy : 0.009502410888671875 nb_pixel_total : 381 time to create 1 rle with old method : 0.00042748451232910156 time for calcul the mask position with numpy : 0.009018182754516602 nb_pixel_total : 875 time to create 1 rle with old method : 0.0010356903076171875 time for calcul the mask position with numpy : 0.009474039077758789 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006873607635498047 time for calcul the mask position with numpy : 0.01059865951538086 nb_pixel_total : 456 time to create 1 rle with old method : 0.0005679130554199219 time for calcul the mask position with numpy : 0.012744665145874023 nb_pixel_total : 260 time to create 1 rle with old method : 0.00063323974609375 time for calcul the mask position with numpy : 0.012427330017089844 nb_pixel_total : 2716 time to create 1 rle with old method : 0.003935337066650391 time for calcul the mask position with numpy : 0.009742975234985352 nb_pixel_total : 9848 time to create 1 rle with old method : 0.01111912727355957 time for calcul the mask position with numpy : 0.008935689926147461 nb_pixel_total : 192 time to create 1 rle with old method : 0.00023031234741210938 time for calcul the mask position with numpy : 0.009213924407958984 nb_pixel_total : 1261 time to create 1 rle with old method : 0.0015451908111572266 time for calcul the mask position with numpy : 0.009098052978515625 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007474422454833984 time for calcul the mask position with numpy : 0.009211063385009766 nb_pixel_total : 9054 time to create 1 rle with old method : 0.010721683502197266 time for calcul the mask position with numpy : 0.008656978607177734 nb_pixel_total : 705 time to create 1 rle with old method : 0.0008065700531005859 time for calcul the mask position with numpy : 0.006441354751586914 nb_pixel_total : 811 time to create 1 rle with old method : 0.0009658336639404297 time for calcul the mask position with numpy : 0.006391286849975586 nb_pixel_total : 35 time to create 1 rle with old method : 7.414817810058594e-05 time for calcul the mask position with numpy : 0.006301164627075195 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002617835998535156 time for calcul the mask position with numpy : 0.006285190582275391 nb_pixel_total : 316 time to create 1 rle with old method : 0.0003952980041503906 time for calcul the mask position with numpy : 0.006423234939575195 nb_pixel_total : 1362 time to create 1 rle with old method : 0.0016164779663085938 time for calcul the mask position with numpy : 0.006316184997558594 nb_pixel_total : 267 time to create 1 rle with old method : 0.00034046173095703125 time for calcul the mask position with numpy : 0.006170988082885742 nb_pixel_total : 8097 time to create 1 rle with old method : 0.009004592895507812 time for calcul the mask position with numpy : 0.006116390228271484 nb_pixel_total : 241 time to create 1 rle with old method : 0.0002846717834472656 time for calcul the mask position with numpy : 0.006170034408569336 nb_pixel_total : 848 time to create 1 rle with old method : 0.000980377197265625 time for calcul the mask position with numpy : 0.0061457157135009766 nb_pixel_total : 19521 time to create 1 rle with old method : 0.021795988082885742 time for calcul the mask position with numpy : 0.006214618682861328 nb_pixel_total : 3937 time to create 1 rle with old method : 0.004554271697998047 time for calcul the mask position with numpy : 0.006114482879638672 nb_pixel_total : 1209 time to create 1 rle with old method : 0.001522064208984375 time for calcul the mask position with numpy : 0.0060236454010009766 nb_pixel_total : 114 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.005955934524536133 nb_pixel_total : 52 time to create 1 rle with old method : 0.0001239776611328125 time for calcul the mask position with numpy : 0.006268501281738281 nb_pixel_total : 10211 time to create 1 rle with old method : 0.01572275161743164 time for calcul the mask position with numpy : 0.009469032287597656 nb_pixel_total : 1622 time to create 1 rle with old method : 0.0020558834075927734 time for calcul the mask position with numpy : 0.00637364387512207 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002636909484863281 time for calcul the mask position with numpy : 0.00597834587097168 nb_pixel_total : 1497 time to create 1 rle with old method : 0.0018091201782226562 time for calcul the mask position with numpy : 0.0060579776763916016 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005486011505126953 time for calcul the mask position with numpy : 0.006783246994018555 nb_pixel_total : 273 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.006025791168212891 nb_pixel_total : 723 time to create 1 rle with old method : 0.0008878707885742188 time for calcul the mask position with numpy : 0.005927324295043945 nb_pixel_total : 828 time to create 1 rle with old method : 0.00103759765625 time for calcul the mask position with numpy : 0.006354808807373047 nb_pixel_total : 732 time to create 1 rle with old method : 0.0009310245513916016 time for calcul the mask position with numpy : 0.006712913513183594 nb_pixel_total : 137 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.006561279296875 nb_pixel_total : 582 time to create 1 rle with old method : 0.0007140636444091797 time for calcul the mask position with numpy : 0.006356954574584961 nb_pixel_total : 233 time to create 1 rle with old method : 0.00027942657470703125 time for calcul the mask position with numpy : 0.006381988525390625 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003674030303955078 time for calcul the mask position with numpy : 0.0065479278564453125 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009109973907470703 time for calcul the mask position with numpy : 0.006418466567993164 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005168914794921875 time for calcul the mask position with numpy : 0.006448030471801758 nb_pixel_total : 732 time to create 1 rle with old method : 0.0008909702301025391 time for calcul the mask position with numpy : 0.006470918655395508 nb_pixel_total : 229 time to create 1 rle with old method : 0.00029778480529785156 time for calcul the mask position with numpy : 0.006078481674194336 nb_pixel_total : 253 time to create 1 rle with old method : 0.00031948089599609375 time for calcul the mask position with numpy : 0.010186195373535156 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0012917518615722656 time for calcul the mask position with numpy : 0.0060193538665771484 nb_pixel_total : 1509 time to create 1 rle with old method : 0.001832723617553711 time for calcul the mask position with numpy : 0.006483316421508789 nb_pixel_total : 2158 time to create 1 rle with old method : 0.0025937557220458984 time for calcul the mask position with numpy : 0.0064427852630615234 nb_pixel_total : 292 time to create 1 rle with old method : 0.00038623809814453125 time for calcul the mask position with numpy : 0.006447315216064453 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002219676971435547 time for calcul the mask position with numpy : 0.0067255496978759766 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001437664031982422 time for calcul the mask position with numpy : 0.0063762664794921875 nb_pixel_total : 721 time to create 1 rle with old method : 0.000904083251953125 time for calcul the mask position with numpy : 0.006665945053100586 nb_pixel_total : 25 time to create 1 rle with old method : 6.413459777832031e-05 time for calcul the mask position with numpy : 0.007291078567504883 nb_pixel_total : 105464 time to create 1 rle with old method : 0.11887025833129883 time for calcul the mask position with numpy : 0.006602764129638672 nb_pixel_total : 224 time to create 1 rle with old method : 0.00028228759765625 time for calcul the mask position with numpy : 0.006850242614746094 nb_pixel_total : 99 time to create 1 rle with old method : 0.00014209747314453125 time for calcul the mask position with numpy : 0.0067484378814697266 nb_pixel_total : 44309 time to create 1 rle with old method : 0.04953408241271973 time for calcul the mask position with numpy : 0.006264448165893555 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003116130828857422 time for calcul the mask position with numpy : 0.006479024887084961 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003178119659423828 time for calcul the mask position with numpy : 0.006186485290527344 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001327991485595703 time for calcul the mask position with numpy : 0.006745338439941406 nb_pixel_total : 465 time to create 1 rle with old method : 0.0005884170532226562 time for calcul the mask position with numpy : 0.00669407844543457 nb_pixel_total : 37152 time to create 1 rle with old method : 0.04162907600402832 time for calcul the mask position with numpy : 0.006823062896728516 nb_pixel_total : 246 time to create 1 rle with old method : 0.00030159950256347656 time for calcul the mask position with numpy : 0.006659746170043945 nb_pixel_total : 682 time to create 1 rle with old method : 0.0008168220520019531 time for calcul the mask position with numpy : 0.0071141719818115234 nb_pixel_total : 3435 time to create 1 rle with old method : 0.004115581512451172 time for calcul the mask position with numpy : 0.007291316986083984 nb_pixel_total : 134 time to create 1 rle with old method : 0.00018930435180664062 time for calcul the mask position with numpy : 0.00789332389831543 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007562637329101562 time for calcul the mask position with numpy : 0.00749659538269043 nb_pixel_total : 262 time to create 1 rle with old method : 0.0004220008850097656 time for calcul the mask position with numpy : 0.007405281066894531 nb_pixel_total : 343 time to create 1 rle with old method : 0.00042748451232910156 time for calcul the mask position with numpy : 0.007612466812133789 nb_pixel_total : 773 time to create 1 rle with old method : 0.0009343624114990234 time for calcul the mask position with numpy : 0.007293701171875 nb_pixel_total : 374 time to create 1 rle with old method : 0.00046896934509277344 time for calcul the mask position with numpy : 0.007378816604614258 nb_pixel_total : 25 time to create 1 rle with old method : 0.0001227855682373047 time for calcul the mask position with numpy : 0.007045745849609375 nb_pixel_total : 46 time to create 1 rle with old method : 0.00013256072998046875 time for calcul the mask position with numpy : 0.007245302200317383 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0015425682067871094 time for calcul the mask position with numpy : 0.006847381591796875 nb_pixel_total : 281 time to create 1 rle with old method : 0.00040984153747558594 time for calcul the mask position with numpy : 0.006503105163574219 nb_pixel_total : 113 time to create 1 rle with old method : 0.00015354156494140625 time for calcul the mask position with numpy : 0.006439208984375 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002086162567138672 time for calcul the mask position with numpy : 0.006443500518798828 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001659393310546875 time for calcul the mask position with numpy : 0.00648045539855957 nb_pixel_total : 152 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.006461381912231445 nb_pixel_total : 322 time to create 1 rle with old method : 0.0003979206085205078 time for calcul the mask position with numpy : 0.006233930587768555 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004954338073730469 time for calcul the mask position with numpy : 0.00644993782043457 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001976490020751953 time for calcul the mask position with numpy : 0.007115840911865234 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004425048828125 time for calcul the mask position with numpy : 0.007252693176269531 nb_pixel_total : 53 time to create 1 rle with old method : 9.107589721679688e-05 time for calcul the mask position with numpy : 0.0074121952056884766 nb_pixel_total : 167 time to create 1 rle with old method : 0.00021529197692871094 time for calcul the mask position with numpy : 0.007383108139038086 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001659393310546875 time for calcul the mask position with numpy : 0.007338285446166992 nb_pixel_total : 583 time to create 1 rle with old method : 0.0007307529449462891 time for calcul the mask position with numpy : 0.0074312686920166016 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0018579959869384766 time for calcul the mask position with numpy : 0.007188081741333008 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005903244018554688 time for calcul the mask position with numpy : 0.007972002029418945 nb_pixel_total : 355 time to create 1 rle with old method : 0.0007565021514892578 time for calcul the mask position with numpy : 0.00763249397277832 nb_pixel_total : 107 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.0071523189544677734 nb_pixel_total : 369 time to create 1 rle with old method : 0.00046539306640625 time for calcul the mask position with numpy : 0.0071392059326171875 nb_pixel_total : 188 time to create 1 rle with old method : 0.00024700164794921875 time for calcul the mask position with numpy : 0.007246971130371094 nb_pixel_total : 28 time to create 1 rle with old method : 7.033348083496094e-05 create new chi : 1.7789034843444824 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016736984252929688 batch 1 Loaded 114 chid ids of type : 4230 Number RLEs to save : 11307 TO DO : save crop sub photo not yet done ! save time : 0.6430413722991943 nb_obj : 103 nb_hashtags : 6 time to prepare the origin masks : 1.6792387962341309 time for calcul the mask position with numpy : 0.02175283432006836 nb_pixel_total : 1582275 time to create 1 rle with new method : 0.0426175594329834 time for calcul the mask position with numpy : 0.008301258087158203 nb_pixel_total : 72195 time to create 1 rle with old method : 0.08844876289367676 time for calcul the mask position with numpy : 0.007250308990478516 nb_pixel_total : 721 time to create 1 rle with old method : 0.0010037422180175781 time for calcul the mask position with numpy : 0.007464408874511719 nb_pixel_total : 65 time to create 1 rle with old method : 0.0001289844512939453 time for calcul the mask position with numpy : 0.00707554817199707 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007390975952148438 time for calcul the mask position with numpy : 0.007271528244018555 nb_pixel_total : 1056 time to create 1 rle with old method : 0.0013892650604248047 time for calcul the mask position with numpy : 0.0072820186614990234 nb_pixel_total : 197 time to create 1 rle with old method : 0.00040078163146972656 time for calcul the mask position with numpy : 0.0077838897705078125 nb_pixel_total : 80 time to create 1 rle with old method : 0.00013637542724609375 time for calcul the mask position with numpy : 0.011549234390258789 nb_pixel_total : 14 time to create 1 rle with old method : 5.030632019042969e-05 time for calcul the mask position with numpy : 0.0073986053466796875 nb_pixel_total : 4035 time to create 1 rle with old method : 0.0052525997161865234 time for calcul the mask position with numpy : 0.008412837982177734 nb_pixel_total : 13 time to create 1 rle with old method : 8.869171142578125e-05 time for calcul the mask position with numpy : 0.008075714111328125 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002760887145996094 time for calcul the mask position with numpy : 0.007674694061279297 nb_pixel_total : 7 time to create 1 rle with old method : 5.602836608886719e-05 time for calcul the mask position with numpy : 0.00773167610168457 nb_pixel_total : 2098 time to create 1 rle with old method : 0.002948760986328125 time for calcul the mask position with numpy : 0.007132053375244141 nb_pixel_total : 1913 time to create 1 rle with old method : 0.0023927688598632812 time for calcul the mask position with numpy : 0.006773233413696289 nb_pixel_total : 4717 time to create 1 rle with old method : 0.005797386169433594 time for calcul the mask position with numpy : 0.0068225860595703125 nb_pixel_total : 1304 time to create 1 rle with old method : 0.0016176700592041016 time for calcul the mask position with numpy : 0.0068395137786865234 nb_pixel_total : 625 time to create 1 rle with old method : 0.0007622241973876953 time for calcul the mask position with numpy : 0.0068705081939697266 nb_pixel_total : 866 time to create 1 rle with old method : 0.0011088848114013672 time for calcul the mask position with numpy : 0.0068323612213134766 nb_pixel_total : 2191 time to create 1 rle with old method : 0.002666950225830078 time for calcul the mask position with numpy : 0.006708621978759766 nb_pixel_total : 8045 time to create 1 rle with old method : 0.009852170944213867 time for calcul the mask position with numpy : 0.007455587387084961 nb_pixel_total : 719 time to create 1 rle with old method : 0.000986337661743164 time for calcul the mask position with numpy : 0.007113456726074219 nb_pixel_total : 596 time to create 1 rle with old method : 0.0008721351623535156 time for calcul the mask position with numpy : 0.00800180435180664 nb_pixel_total : 151262 time to create 1 rle with new method : 0.032431840896606445 time for calcul the mask position with numpy : 0.00659942626953125 nb_pixel_total : 1257 time to create 1 rle with old method : 0.0015773773193359375 time for calcul the mask position with numpy : 0.0067272186279296875 nb_pixel_total : 1354 time to create 1 rle with old method : 0.0015728473663330078 time for calcul the mask position with numpy : 0.006544589996337891 nb_pixel_total : 621 time to create 1 rle with old method : 0.0007636547088623047 time for calcul the mask position with numpy : 0.006569385528564453 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009319782257080078 time for calcul the mask position with numpy : 0.0075604915618896484 nb_pixel_total : 97 time to create 1 rle with old method : 0.00015115737915039062 time for calcul the mask position with numpy : 0.007506132125854492 nb_pixel_total : 1320 time to create 1 rle with old method : 0.0016524791717529297 time for calcul the mask position with numpy : 0.007649421691894531 nb_pixel_total : 54 time to create 1 rle with old method : 0.00015735626220703125 time for calcul the mask position with numpy : 0.007892131805419922 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005373954772949219 time for calcul the mask position with numpy : 0.008247137069702148 nb_pixel_total : 517 time to create 1 rle with old method : 0.0007150173187255859 time for calcul the mask position with numpy : 0.007673740386962891 nb_pixel_total : 1002 time to create 1 rle with old method : 0.001405954360961914 time for calcul the mask position with numpy : 0.007037639617919922 nb_pixel_total : 2169 time to create 1 rle with old method : 0.002625703811645508 time for calcul the mask position with numpy : 0.007166147232055664 nb_pixel_total : 2762 time to create 1 rle with old method : 0.0034291744232177734 time for calcul the mask position with numpy : 0.007082939147949219 nb_pixel_total : 1113 time to create 1 rle with old method : 0.001321554183959961 time for calcul the mask position with numpy : 0.00683283805847168 nb_pixel_total : 22 time to create 1 rle with old method : 0.00012350082397460938 time for calcul the mask position with numpy : 0.007002353668212891 nb_pixel_total : 93 time to create 1 rle with old method : 0.000156402587890625 time for calcul the mask position with numpy : 0.007307529449462891 nb_pixel_total : 1515 time to create 1 rle with old method : 0.0018999576568603516 time for calcul the mask position with numpy : 0.007162570953369141 nb_pixel_total : 296 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.006812572479248047 nb_pixel_total : 851 time to create 1 rle with old method : 0.0010194778442382812 time for calcul the mask position with numpy : 0.00678253173828125 nb_pixel_total : 123 time to create 1 rle with old method : 0.00016427040100097656 time for calcul the mask position with numpy : 0.00685429573059082 nb_pixel_total : 561 time to create 1 rle with old method : 0.0007295608520507812 time for calcul the mask position with numpy : 0.007115840911865234 nb_pixel_total : 115 time to create 1 rle with old method : 0.00016236305236816406 time for calcul the mask position with numpy : 0.007365703582763672 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003325939178466797 time for calcul the mask position with numpy : 0.007124900817871094 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007317066192626953 time for calcul the mask position with numpy : 0.007568836212158203 nb_pixel_total : 125 time to create 1 rle with old method : 0.00019478797912597656 time for calcul the mask position with numpy : 0.007467985153198242 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009698867797851562 time for calcul the mask position with numpy : 0.007040977478027344 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002830028533935547 time for calcul the mask position with numpy : 0.006780385971069336 nb_pixel_total : 304 time to create 1 rle with old method : 0.00038695335388183594 time for calcul the mask position with numpy : 0.007578372955322266 nb_pixel_total : 977 time to create 1 rle with old method : 0.0012962818145751953 time for calcul the mask position with numpy : 0.0077991485595703125 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003256797790527344 time for calcul the mask position with numpy : 0.007768154144287109 nb_pixel_total : 649 time to create 1 rle with old method : 0.0008389949798583984 time for calcul the mask position with numpy : 0.007502317428588867 nb_pixel_total : 762 time to create 1 rle with old method : 0.0010187625885009766 time for calcul the mask position with numpy : 0.007535219192504883 nb_pixel_total : 11 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.007020235061645508 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005512237548828125 time for calcul the mask position with numpy : 0.007539033889770508 nb_pixel_total : 185 time to create 1 rle with old method : 0.00030493736267089844 time for calcul the mask position with numpy : 0.00740361213684082 nb_pixel_total : 920 time to create 1 rle with old method : 0.0012614727020263672 time for calcul the mask position with numpy : 0.007071733474731445 nb_pixel_total : 107 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.0070650577545166016 nb_pixel_total : 140 time to create 1 rle with old method : 0.00021648406982421875 time for calcul the mask position with numpy : 0.007733821868896484 nb_pixel_total : 2108 time to create 1 rle with old method : 0.0027587413787841797 time for calcul the mask position with numpy : 0.00730133056640625 nb_pixel_total : 114 time to create 1 rle with old method : 0.00021910667419433594 time for calcul the mask position with numpy : 0.007517814636230469 nb_pixel_total : 1534 time to create 1 rle with old method : 0.002029895782470703 time for calcul the mask position with numpy : 0.008733749389648438 nb_pixel_total : 32 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.010700702667236328 nb_pixel_total : 1052 time to create 1 rle with old method : 0.001527547836303711 time for calcul the mask position with numpy : 0.010398387908935547 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004642009735107422 time for calcul the mask position with numpy : 0.009645223617553711 nb_pixel_total : 215 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.011565685272216797 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002739429473876953 time for calcul the mask position with numpy : 0.011705636978149414 nb_pixel_total : 293 time to create 1 rle with old method : 0.0003895759582519531 time for calcul the mask position with numpy : 0.011235713958740234 nb_pixel_total : 279 time to create 1 rle with old method : 0.00038361549377441406 time for calcul the mask position with numpy : 0.010186433792114258 nb_pixel_total : 33 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.01046442985534668 nb_pixel_total : 105683 time to create 1 rle with old method : 0.13306856155395508 time for calcul the mask position with numpy : 0.009708404541015625 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008068084716796875 time for calcul the mask position with numpy : 0.01148223876953125 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.011731863021850586 nb_pixel_total : 50482 time to create 1 rle with old method : 0.07222795486450195 time for calcul the mask position with numpy : 0.011582612991333008 nb_pixel_total : 279 time to create 1 rle with old method : 0.0004220008850097656 time for calcul the mask position with numpy : 0.011394023895263672 nb_pixel_total : 2 time to create 1 rle with old method : 3.9577484130859375e-05 time for calcul the mask position with numpy : 0.010039091110229492 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003604888916015625 time for calcul the mask position with numpy : 0.011077165603637695 nb_pixel_total : 983 time to create 1 rle with old method : 0.0013692378997802734 time for calcul the mask position with numpy : 0.008992910385131836 nb_pixel_total : 138 time to create 1 rle with old method : 0.00021457672119140625 time for calcul the mask position with numpy : 0.0074994564056396484 nb_pixel_total : 37745 time to create 1 rle with old method : 0.0500943660736084 time for calcul the mask position with numpy : 0.008520126342773438 nb_pixel_total : 3680 time to create 1 rle with old method : 0.0050356388092041016 time for calcul the mask position with numpy : 0.00741267204284668 nb_pixel_total : 585 time to create 1 rle with old method : 0.000911712646484375 time for calcul the mask position with numpy : 0.008001327514648438 nb_pixel_total : 709 time to create 1 rle with old method : 0.0014667510986328125 time for calcul the mask position with numpy : 0.009095430374145508 nb_pixel_total : 209 time to create 1 rle with old method : 0.0004260540008544922 time for calcul the mask position with numpy : 0.00756382942199707 nb_pixel_total : 350 time to create 1 rle with old method : 0.0006170272827148438 time for calcul the mask position with numpy : 0.007532596588134766 nb_pixel_total : 778 time to create 1 rle with old method : 0.0010797977447509766 time for calcul the mask position with numpy : 0.007353782653808594 nb_pixel_total : 1105 time to create 1 rle with old method : 0.0015637874603271484 time for calcul the mask position with numpy : 0.006947994232177734 nb_pixel_total : 61 time to create 1 rle with old method : 0.000125885009765625 time for calcul the mask position with numpy : 0.007211923599243164 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003535747528076172 time for calcul the mask position with numpy : 0.007616996765136719 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001575946807861328 time for calcul the mask position with numpy : 0.008692741394042969 nb_pixel_total : 272 time to create 1 rle with old method : 0.0006792545318603516 time for calcul the mask position with numpy : 0.008133888244628906 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004975795745849609 time for calcul the mask position with numpy : 0.00793910026550293 nb_pixel_total : 134 time to create 1 rle with old method : 0.00023794174194335938 time for calcul the mask position with numpy : 0.008481740951538086 nb_pixel_total : 20 time to create 1 rle with old method : 7.748603820800781e-05 time for calcul the mask position with numpy : 0.00831460952758789 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.00696253776550293 nb_pixel_total : 101 time to create 1 rle with old method : 0.00017976760864257812 time for calcul the mask position with numpy : 0.007263660430908203 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007665157318115234 time for calcul the mask position with numpy : 0.007519245147705078 nb_pixel_total : 460 time to create 1 rle with old method : 0.0007112026214599609 time for calcul the mask position with numpy : 0.00708770751953125 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005440711975097656 time for calcul the mask position with numpy : 0.007302999496459961 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0017521381378173828 time for calcul the mask position with numpy : 0.007576704025268555 nb_pixel_total : 66 time to create 1 rle with old method : 0.00011801719665527344 time for calcul the mask position with numpy : 0.007207155227661133 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005691051483154297 create new chi : 1.3662512302398682 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001811981201171875 batch 1 Loaded 104 chid ids of type : 4230 Number RLEs to save : 10993 TO DO : save crop sub photo not yet done ! save time : 0.6790673732757568 nb_obj : 83 nb_hashtags : 6 time to prepare the origin masks : 1.256620168685913 time for calcul the mask position with numpy : 0.02811145782470703 nb_pixel_total : 1894904 time to create 1 rle with new method : 0.04537510871887207 time for calcul the mask position with numpy : 0.006068229675292969 nb_pixel_total : 745 time to create 1 rle with old method : 0.000926971435546875 time for calcul the mask position with numpy : 0.005934000015258789 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004825592041015625 time for calcul the mask position with numpy : 0.005969524383544922 nb_pixel_total : 1026 time to create 1 rle with old method : 0.001255035400390625 time for calcul the mask position with numpy : 0.005815744400024414 nb_pixel_total : 118 time to create 1 rle with old method : 0.00017309188842773438 time for calcul the mask position with numpy : 0.0060939788818359375 nb_pixel_total : 48 time to create 1 rle with old method : 8.654594421386719e-05 time for calcul the mask position with numpy : 0.006062984466552734 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004265308380126953 time for calcul the mask position with numpy : 0.006005048751831055 nb_pixel_total : 43 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.006386518478393555 nb_pixel_total : 12 time to create 1 rle with old method : 6.365776062011719e-05 time for calcul the mask position with numpy : 0.006205320358276367 nb_pixel_total : 24 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.006075859069824219 nb_pixel_total : 4742 time to create 1 rle with old method : 0.0057408809661865234 time for calcul the mask position with numpy : 0.0060176849365234375 nb_pixel_total : 2473 time to create 1 rle with old method : 0.0029952526092529297 time for calcul the mask position with numpy : 0.005987644195556641 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0015802383422851562 time for calcul the mask position with numpy : 0.005906343460083008 nb_pixel_total : 688 time to create 1 rle with old method : 0.0008521080017089844 time for calcul the mask position with numpy : 0.005935192108154297 nb_pixel_total : 12 time to create 1 rle with old method : 3.170967102050781e-05 time for calcul the mask position with numpy : 0.00813150405883789 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005555152893066406 time for calcul the mask position with numpy : 0.0059626102447509766 nb_pixel_total : 2119 time to create 1 rle with old method : 0.0024635791778564453 time for calcul the mask position with numpy : 0.006021261215209961 nb_pixel_total : 8805 time to create 1 rle with old method : 0.010381221771240234 time for calcul the mask position with numpy : 0.005793094635009766 nb_pixel_total : 1277 time to create 1 rle with old method : 0.001535654067993164 time for calcul the mask position with numpy : 0.005789995193481445 nb_pixel_total : 520 time to create 1 rle with old method : 0.0006670951843261719 time for calcul the mask position with numpy : 0.0058023929595947266 nb_pixel_total : 771 time to create 1 rle with old method : 0.0009543895721435547 time for calcul the mask position with numpy : 0.005927562713623047 nb_pixel_total : 7279 time to create 1 rle with old method : 0.008482694625854492 time for calcul the mask position with numpy : 0.0059642791748046875 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008223056793212891 time for calcul the mask position with numpy : 0.005711078643798828 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.0057964324951171875 nb_pixel_total : 29 time to create 1 rle with old method : 7.772445678710938e-05 time for calcul the mask position with numpy : 0.005751609802246094 nb_pixel_total : 1403 time to create 1 rle with old method : 0.0016570091247558594 time for calcul the mask position with numpy : 0.005839347839355469 nb_pixel_total : 248 time to create 1 rle with old method : 0.00036334991455078125 time for calcul the mask position with numpy : 0.006071329116821289 nb_pixel_total : 280 time to create 1 rle with old method : 0.000377655029296875 time for calcul the mask position with numpy : 0.006082057952880859 nb_pixel_total : 8576 time to create 1 rle with old method : 0.0098724365234375 time for calcul the mask position with numpy : 0.005778074264526367 nb_pixel_total : 1963 time to create 1 rle with old method : 0.002354145050048828 time for calcul the mask position with numpy : 0.0057218074798583984 nb_pixel_total : 1745 time to create 1 rle with old method : 0.0021021366119384766 time for calcul the mask position with numpy : 0.005711078643798828 nb_pixel_total : 317 time to create 1 rle with old method : 0.00048828125 time for calcul the mask position with numpy : 0.005781650543212891 nb_pixel_total : 1210 time to create 1 rle with old method : 0.0014510154724121094 time for calcul the mask position with numpy : 0.005986928939819336 nb_pixel_total : 722 time to create 1 rle with old method : 0.0009112358093261719 time for calcul the mask position with numpy : 0.005905866622924805 nb_pixel_total : 763 time to create 1 rle with old method : 0.0008873939514160156 time for calcul the mask position with numpy : 0.00583195686340332 nb_pixel_total : 199 time to create 1 rle with old method : 0.00024080276489257812 time for calcul the mask position with numpy : 0.006127357482910156 nb_pixel_total : 707 time to create 1 rle with old method : 0.0012769699096679688 time for calcul the mask position with numpy : 0.006426334381103516 nb_pixel_total : 167 time to create 1 rle with old method : 0.00032210350036621094 time for calcul the mask position with numpy : 0.006451129913330078 nb_pixel_total : 686 time to create 1 rle with old method : 0.0012183189392089844 time for calcul the mask position with numpy : 0.006447315216064453 nb_pixel_total : 270 time to create 1 rle with old method : 0.0005025863647460938 time for calcul the mask position with numpy : 0.006514310836791992 nb_pixel_total : 1506 time to create 1 rle with old method : 0.002646923065185547 time for calcul the mask position with numpy : 0.006421566009521484 nb_pixel_total : 30 time to create 1 rle with old method : 0.00010704994201660156 time for calcul the mask position with numpy : 0.0064661502838134766 nb_pixel_total : 730 time to create 1 rle with old method : 0.0012924671173095703 time for calcul the mask position with numpy : 0.006478548049926758 nb_pixel_total : 398 time to create 1 rle with old method : 0.0007224082946777344 time for calcul the mask position with numpy : 0.0067844390869140625 nb_pixel_total : 156 time to create 1 rle with old method : 0.0003027915954589844 time for calcul the mask position with numpy : 0.006731748580932617 nb_pixel_total : 232 time to create 1 rle with old method : 0.00043392181396484375 time for calcul the mask position with numpy : 0.0064084529876708984 nb_pixel_total : 395 time to create 1 rle with old method : 0.0004794597625732422 time for calcul the mask position with numpy : 0.006118059158325195 nb_pixel_total : 992 time to create 1 rle with old method : 0.0011954307556152344 time for calcul the mask position with numpy : 0.0059814453125 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004260540008544922 time for calcul the mask position with numpy : 0.005948066711425781 nb_pixel_total : 143 time to create 1 rle with old method : 0.00017833709716796875 time for calcul the mask position with numpy : 0.006050825119018555 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004448890686035156 time for calcul the mask position with numpy : 0.0057179927825927734 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003151893615722656 time for calcul the mask position with numpy : 0.006793022155761719 nb_pixel_total : 105788 time to create 1 rle with old method : 0.11747407913208008 time for calcul the mask position with numpy : 0.005948066711425781 nb_pixel_total : 69 time to create 1 rle with old method : 0.00010824203491210938 time for calcul the mask position with numpy : 0.006242990493774414 nb_pixel_total : 199 time to create 1 rle with old method : 0.00025582313537597656 time for calcul the mask position with numpy : 0.006192922592163086 nb_pixel_total : 368 time to create 1 rle with old method : 0.000461578369140625 time for calcul the mask position with numpy : 0.006147861480712891 nb_pixel_total : 337 time to create 1 rle with old method : 0.00040435791015625 time for calcul the mask position with numpy : 0.006386518478393555 nb_pixel_total : 21 time to create 1 rle with old method : 4.553794860839844e-05 time for calcul the mask position with numpy : 0.0062808990478515625 nb_pixel_total : 40 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.0062103271484375 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0014955997467041016 time for calcul the mask position with numpy : 0.0064084529876708984 nb_pixel_total : 42 time to create 1 rle with old method : 8.416175842285156e-05 time for calcul the mask position with numpy : 0.006139993667602539 nb_pixel_total : 1026 time to create 1 rle with old method : 0.0012021064758300781 time for calcul the mask position with numpy : 0.0062487125396728516 nb_pixel_total : 738 time to create 1 rle with old method : 0.0009019374847412109 time for calcul the mask position with numpy : 0.006191730499267578 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005848407745361328 time for calcul the mask position with numpy : 0.006312370300292969 nb_pixel_total : 2390 time to create 1 rle with old method : 0.002920389175415039 time for calcul the mask position with numpy : 0.006653547286987305 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008563995361328125 time for calcul the mask position with numpy : 0.006763935089111328 nb_pixel_total : 904 time to create 1 rle with old method : 0.0011265277862548828 time for calcul the mask position with numpy : 0.006257772445678711 nb_pixel_total : 221 time to create 1 rle with old method : 0.00028324127197265625 time for calcul the mask position with numpy : 0.0062825679779052734 nb_pixel_total : 777 time to create 1 rle with old method : 0.0009026527404785156 time for calcul the mask position with numpy : 0.0060503482818603516 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003597736358642578 time for calcul the mask position with numpy : 0.005983114242553711 nb_pixel_total : 264 time to create 1 rle with old method : 0.000339508056640625 time for calcul the mask position with numpy : 0.006077766418457031 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.006121397018432617 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005173683166503906 time for calcul the mask position with numpy : 0.006005287170410156 nb_pixel_total : 288 time to create 1 rle with old method : 0.00037169456481933594 time for calcul the mask position with numpy : 0.0060350894927978516 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005173683166503906 time for calcul the mask position with numpy : 0.00687861442565918 nb_pixel_total : 15 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.006242990493774414 nb_pixel_total : 102 time to create 1 rle with old method : 0.00014543533325195312 time for calcul the mask position with numpy : 0.006211519241333008 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006220340728759766 time for calcul the mask position with numpy : 0.006194353103637695 nb_pixel_total : 370 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.006211042404174805 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002999305725097656 time for calcul the mask position with numpy : 0.006148099899291992 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005021095275878906 time for calcul the mask position with numpy : 0.006033897399902344 nb_pixel_total : 872 time to create 1 rle with old method : 0.001020193099975586 time for calcul the mask position with numpy : 0.006060600280761719 nb_pixel_total : 19 time to create 1 rle with old method : 5.5789947509765625e-05 time for calcul the mask position with numpy : 0.00608372688293457 nb_pixel_total : 238 time to create 1 rle with old method : 0.00029850006103515625 create new chi : 0.7953126430511475 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0012235641479492188 batch 1 Loaded 84 chid ids of type : 4230 Number RLEs to save : 7249 TO DO : save crop sub photo not yet done ! save time : 0.42792534828186035 map_output_result : {1339355524: (0.0, 'Should be the crop_list due to order', 0.0), 1339355523: (0.0, 'Should be the crop_list due to order', 0.0), 1339355521: (0.0, 'Should be the crop_list due to order', 0.0), 1339355518: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1339355524, 1339355523, 1339355521, 1339355518] Looping around the photos to save general results len do output : 4 /1339355524.Didn't retrieve data . /1339355523.Didn't retrieve data . /1339355521.Didn't retrieve data . /1339355518.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355524', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355523', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355521', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355518', None, None, None, None, None, '2610153') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.0970759391784668 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.627805471420288 time spend to save output : 0.09739446640014648 total time spend for step 4 : 15.725199937820435 step5:crop_condition Mon Feb 24 23:21:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 417 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 173 About to insert : list_path_to_insert length 173 new photo from crops ! About to upload 173 photos upload in portfolio : 4869462 init cache_photo without model_param we have 173 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740435684_2504677 we have uploaded 173 photos in the portfolio 4869462 time of upload the photos Elapsed time : 49.89018535614014 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 4869462 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740435734_2504677 we have uploaded 54 photos in the portfolio 4869462 time of upload the photos Elapsed time : 14.794118881225586 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 4869462 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740435750_2504677 we have uploaded 7 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.608612060546875 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 4869462 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740435753_2504677 we have uploaded 51 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.999389410018921 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1339355524, 1339355523, 1339355521, 1339355518] Looping around the photos to save general results len do output : 285 /1339439589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339439998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339440153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355524', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355523', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355521', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355518', None, None, None, None, None, '2610153') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 859 time used for this insertion : 0.053932905197143555 save_final save missing photos in datou_result : time spend for datou_step_exec : 85.70547461509705 time spend to save output : 0.06433320045471191 total time spend for step 5 : 85.76980781555176 step6:thcl Mon Feb 24 23:22:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.011247634887695312 time to convert the images to numpy array : 0.05511617660522461 time to import caffe and check if the image exist : 0.01967787742614746 time to convert the images to numpy array : 0.0909571647644043 time to import caffe and check if the image exist : 0.02717900276184082 time to convert the images to numpy array : 0.0846550464630127 time to import caffe and check if the image exist : 0.027803897857666016 time to convert the images to numpy array : 0.09671950340270996 time to import caffe and check if the image exist : 0.03952670097351074 time to convert the images to numpy array : 0.08540558815002441 time to import caffe and check if the image exist : 0.033353567123413086 time to convert the images to numpy array : 0.09184384346008301 time to import caffe and check if the image exist : 0.0250852108001709 time to convert the images to numpy array : 0.10204863548278809 time to import caffe and check if the image exist : 0.030048847198486328 time to convert the images to numpy array : 0.10194087028503418 time to import caffe and check if the image exist : 0.0403437614440918 time to convert the images to numpy array : 0.09165024757385254 time to import caffe and check if the image exist : 0.04105257987976074 time to convert the images to numpy array : 0.09087324142456055 total time to convert the images to numpy array : 0.33748793601989746 list photo_ids error: [] list photo_ids correct : [1339440130, 1339440131, 1339440132, 1339440133, 1339440134, 1339440135, 1339440136, 1339440137, 1339440138, 1339440139, 1339440140, 1339440141, 1339440142, 1339440143, 1339440144, 1339440145, 1339440146, 1339440147, 1339440148, 1339440149, 1339440150, 1339440151, 1339440152, 1339440153, 1339439776, 1339439777, 1339439778, 1339439779, 1339439780, 1339439781, 1339439782, 1339439783, 1339439784, 1339439785, 1339439786, 1339439787, 1339439788, 1339439789, 1339439790, 1339439791, 1339439792, 1339439793, 1339439794, 1339439795, 1339439796, 1339439797, 1339439798, 1339439799, 1339439800, 1339439801, 1339439802, 1339439803, 1339439976, 1339439978, 1339439981, 1339439983, 1339439985, 1339439987, 1339439989, 1339439991, 1339439993, 1339439995, 1339439998, 1339440000, 1339440002, 1339440004, 1339440007, 1339440009, 1339440011, 1339440013, 1339440015, 1339440017, 1339440019, 1339440022, 1339440024, 1339440026, 1339440028, 1339440030, 1339440032, 1339440034, 1339440036, 1339440038, 1339439647, 1339439648, 1339439649, 1339439650, 1339439651, 1339439652, 1339439653, 1339439654, 1339439655, 1339439656, 1339439657, 1339439658, 1339439659, 1339439660, 1339439661, 1339439662, 1339439663, 1339439664, 1339439665, 1339439666, 1339439667, 1339439668, 1339439669, 1339439670, 1339439671, 1339439672, 1339439673, 1339439674, 1339439675, 1339439733, 1339439735, 1339439737, 1339439739, 1339439741, 1339439742, 1339439744, 1339439746, 1339439748, 1339439750, 1339439752, 1339439754, 1339439756, 1339439758, 1339439760, 1339439761, 1339439762, 1339439763, 1339439764, 1339439765, 1339439766, 1339439767, 1339439768, 1339439769, 1339439771, 1339439772, 1339439773, 1339439774, 1339439775, 1339440092, 1339440094, 1339440103, 1339440104, 1339440105, 1339440106, 1339440107, 1339440108, 1339440109, 1339440110, 1339440111, 1339440112, 1339440113, 1339440114, 1339440115, 1339440116, 1339440117, 1339440118, 1339440119, 1339440120, 1339440121, 1339440122, 1339440123, 1339440124, 1339440125, 1339440126, 1339440127, 1339440128, 1339440129, 1339439618, 1339439619, 1339439620, 1339439621, 1339439622, 1339439623, 1339439624, 1339439625, 1339439626, 1339439627, 1339439628, 1339439629, 1339439630, 1339439631, 1339439632, 1339439633, 1339439634, 1339439635, 1339439636, 1339439637, 1339439638, 1339439639, 1339439640, 1339439641, 1339439642, 1339439643, 1339439644, 1339439645, 1339439646, 1339439589, 1339439590, 1339439591, 1339439592, 1339439593, 1339439594, 1339439595, 1339439596, 1339439597, 1339439598, 1339439599, 1339439600, 1339439601, 1339439602, 1339439603, 1339439604, 1339439605, 1339439606, 1339439607, 1339439608, 1339439609, 1339439610, 1339439611, 1339439612, 1339439613, 1339439614, 1339439615, 1339439616, 1339439617, 1339439676, 1339439677, 1339439678, 1339439679, 1339439680, 1339439682, 1339439683, 1339439685, 1339439687, 1339439689, 1339439691, 1339439693, 1339439695, 1339439697, 1339439699, 1339439701, 1339439703, 1339439705, 1339439707, 1339439709, 1339439711, 1339439716, 1339439718, 1339439720, 1339439723, 1339439725, 1339439727, 1339439729, 1339439731, 1339440040, 1339440042, 1339440044, 1339440046, 1339440048, 1339440050, 1339440052, 1339440054, 1339440056, 1339440058, 1339440060, 1339440062, 1339440064, 1339440066, 1339440068, 1339440070, 1339440072, 1339440074, 1339440076, 1339440078, 1339440080, 1339440082, 1339440083, 1339440084, 1339440087, 1339440088, 1339440089, 1339440090, 1339440091] number of photos to traite : 285 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6595 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6376 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.356048583984375 time used to do the prediction : 1.765225887298584 save descriptor for thcl : 3237 time to traite the descriptors : 1.6198852062225342 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1339440130 To insert : 1339440131 To insert : 1339440132 To insert : 1339440133 To insert : 1339440134 To insert : 1339440135 To insert : 1339440136 To insert : 1339440137 To insert : 1339440138 To insert : 1339440139 To insert : 1339440140 To insert : 1339440141 To insert : 1339440142 To insert : 1339440143 To insert : 1339440144 To insert : 1339440145 To insert : 1339440146 To insert : 1339440147 To insert : 1339440148 To insert : 1339440149 To insert : 1339440150 To insert : 1339440151 To insert : 1339440152 To insert : 1339440153 To insert : 1339439776 To insert : 1339439777 To insert : 1339439778 To insert : 1339439779 To insert : 1339439780 To insert : 1339439781 To insert : 1339439782 To insert : 1339439783 To insert : 1339439784 To insert : 1339439785 To insert : 1339439786 To insert : 1339439787 To insert : 1339439788 To insert : 1339439789 To insert : 1339439790 To insert : 1339439791 To insert : 1339439792 To insert : 1339439793 To insert : 1339439794 To insert : 1339439795 To insert : 1339439796 To insert : 1339439797 To insert : 1339439798 To insert : 1339439799 To insert : 1339439800 To insert : 1339439801 To insert : 1339439802 To insert : 1339439803 To insert : 1339439976 To insert : 1339439978 To insert : 1339439981 To insert : 1339439983 To insert : 1339439985 To insert : 1339439987 To insert : 1339439989 To insert : 1339439991 To insert : 1339439993 To insert : 1339439995 To insert : 1339439998 To insert : 1339440000 To insert : 1339440002 To insert : 1339440004 To insert : 1339440007 To insert : 1339440009 To insert : 1339440011 To insert : 1339440013 To insert : 1339440015 To insert : 1339440017 To insert : 1339440019 To insert : 1339440022 To insert : 1339440024 To insert : 1339440026 To insert : 1339440028 To insert : 1339440030 To insert : 1339440032 To insert : 1339440034 To insert : 1339440036 To insert : 1339440038 To insert : 1339439647 To insert : 1339439648 To insert : 1339439649 To insert : 1339439650 To insert : 1339439651 To insert : 1339439652 To insert : 1339439653 To insert : 1339439654 To insert : 1339439655 To insert : 1339439656 To insert : 1339439657 To insert : 1339439658 To insert : 1339439659 To insert : 1339439660 To insert : 1339439661 To insert : 1339439662 To insert : 1339439663 To insert : 1339439664 To insert : 1339439665 To insert : 1339439666 To insert : 1339439667 To insert : 1339439668 To insert : 1339439669 To insert : 1339439670 To insert : 1339439671 To insert : 1339439672 To insert : 1339439673 To insert : 1339439674 To insert : 1339439675 To insert : 1339439733 To insert : 1339439735 To insert : 1339439737 To insert : 1339439739 To insert : 1339439741 To insert : 1339439742 To insert : 1339439744 To insert : 1339439746 To insert : 1339439748 To insert : 1339439750 To insert : 1339439752 To insert : 1339439754 To insert : 1339439756 To insert : 1339439758 To insert : 1339439760 To insert : 1339439761 To insert : 1339439762 To insert : 1339439763 To insert : 1339439764 To insert : 1339439765 To insert : 1339439766 To insert : 1339439767 To insert : 1339439768 To insert : 1339439769 To insert : 1339439771 To insert : 1339439772 To insert : 1339439773 To insert : 1339439774 To insert : 1339439775 To insert : 1339440092 To insert : 1339440094 To insert : 1339440103 To insert : 1339440104 To insert : 1339440105 To insert : 1339440106 To insert : 1339440107 To insert : 1339440108 To insert : 1339440109 To insert : 1339440110 To insert : 1339440111 To insert : 1339440112 To insert : 1339440113 To insert : 1339440114 To insert : 1339440115 To insert : 1339440116 To insert : 1339440117 To insert : 1339440118 To insert : 1339440119 To insert : 1339440120 To insert : 1339440121 To insert : 1339440122 To insert : 1339440123 To insert : 1339440124 To insert : 1339440125 To insert : 1339440126 To insert : 1339440127 To insert : 1339440128 To insert : 1339440129 To insert : 1339439618 To insert : 1339439619 To insert : 1339439620 To insert : 1339439621 To insert : 1339439622 To insert : 1339439623 To insert : 1339439624 To insert : 1339439625 To insert : 1339439626 To insert : 1339439627 To insert : 1339439628 To insert : 1339439629 To insert : 1339439630 To insert : 1339439631 To insert : 1339439632 To insert : 1339439633 To insert : 1339439634 To insert : 1339439635 To insert : 1339439636 To insert : 1339439637 To insert : 1339439638 To insert : 1339439639 To insert : 1339439640 To insert : 1339439641 To insert : 1339439642 To insert : 1339439643 To insert : 1339439644 To insert : 1339439645 To insert : 1339439646 To insert : 1339439589 To insert : 1339439590 To insert : 1339439591 To insert : 1339439592 To insert : 1339439593 To insert : 1339439594 To insert : 1339439595 To insert : 1339439596 To insert : 1339439597 To insert : 1339439598 To insert : 1339439599 To insert : 1339439600 To insert : 1339439601 To insert : 1339439602 To insert : 1339439603 To insert : 1339439604 To insert : 1339439605 To insert : 1339439606 To insert : 1339439607 To insert : 1339439608 To insert : 1339439609 To insert : 1339439610 To insert : 1339439611 To insert : 1339439612 To insert : 1339439613 To insert : 1339439614 To insert : 1339439615 To insert : 1339439616 To insert : 1339439617 To insert : 1339439676 To insert : 1339439677 To insert : 1339439678 To insert : 1339439679 To insert : 1339439680 To insert : 1339439682 To insert : 1339439683 To insert : 1339439685 To insert : 1339439687 To insert : 1339439689 To insert : 1339439691 To insert : 1339439693 To insert : 1339439695 To insert : 1339439697 To insert : 1339439699 To insert : 1339439701 To insert : 1339439703 To insert : 1339439705 To insert : 1339439707 To insert : 1339439709 To insert : 1339439711 To insert : 1339439716 To insert : 1339439718 To insert : 1339439720 To insert : 1339439723 To insert : 1339439725 To insert : 1339439727 To insert : 1339439729 To insert : 1339439731 To insert : 1339440040 To insert : 1339440042 To insert : 1339440044 To insert : 1339440046 To insert : 1339440048 To insert : 1339440050 To insert : 1339440052 To insert : 1339440054 To insert : 1339440056 To insert : 1339440058 To insert : 1339440060 To insert : 1339440062 To insert : 1339440064 To insert : 1339440066 To insert : 1339440068 To insert : 1339440070 To insert : 1339440072 To insert : 1339440074 To insert : 1339440076 To insert : 1339440078 To insert : 1339440080 To insert : 1339440082 To insert : 1339440083 To insert : 1339440084 To insert : 1339440087 To insert : 1339440088 To insert : 1339440089 To insert : 1339440090 To insert : 1339440091 time to insert the descriptors : 70.66841340065002 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 457 time used for this insertion : 0.04047203063964844 save missing photos in datou_result : time spend for datou_step_exec : 79.4953122138977 time spend to save output : 0.09292316436767578 total time spend for step 6 : 79.58823537826538 step7:ventilate_hashtags_in_portfolio Mon Feb 24 23:24:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20776132 get user id for portfolio 20776132 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776132 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Tetrapak','carton','mal_croppe','environnement','pet_fonce','PEHD','PET_clair','PET_fonce','Papier','pet_clair','Carton','autre','refus','Film_plastique','flou','metal','papier')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776132 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Tetrapak','carton','mal_croppe','environnement','pet_fonce','PEHD','PET_clair','PET_fonce','Papier','pet_clair','Carton','autre','refus','Film_plastique','flou','metal','papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20783259,20783260,20783271,20783262,20783263,20783267,20783273,20783276,20783268,20783269,20783270,20783272,20783275?tags=film_plastique,autre,carton,metal,flou,pet_fonce,papier,pehd,mal_croppe,tetrapak,refus,environnement,pet_clair&datou_id_consolidate=4235&port_consolidate=20776132 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1339355524, 1339355523, 1339355521, 1339355518] Looping around the photos to save general results len do output : 1 /20776132. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355524', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355523', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355521', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355518', None, None, None, None, None, '2610153') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013644933700561523 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.644878625869751 time spend to save output : 0.013988971710205078 total time spend for step 7 : 1.658867597579956 step8:final Mon Feb 24 23:24:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1339355524: ('0.2365564375650076',), 1339355523: ('0.2365564375650076',), 1339355521: ('0.2365564375650076',), 1339355518: ('0.2365564375650076',)} new output for save of step final : {1339355524: ('0.2365564375650076',), 1339355523: ('0.2365564375650076',), 1339355521: ('0.2365564375650076',), 1339355518: ('0.2365564375650076',)} [1339355524, 1339355523, 1339355521, 1339355518] Looping around the photos to save general results len do output : 4 /1339355524.Didn't retrieve data . /1339355523.Didn't retrieve data . /1339355521.Didn't retrieve data . /1339355518.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355524', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355523', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355521', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355518', None, None, None, None, None, '2610153') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012471914291381836 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12626051902770996 time spend to save output : 0.012775897979736328 total time spend for step 8 : 0.1390364170074463 step9:velours_tree Mon Feb 24 23:24:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20783259,20783260,20783271,20783262,20783263,20783267,20783273,20783276,20783268,20783269,20783270,20783272,20783275 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783259 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783260 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783271 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783262 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783263 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783267 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783273 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783276 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783268 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783269 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783270 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783272 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20783275 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 654 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 5 0 5 0 1 1 3 1 4 4 4 4 3 4 0 4 1 3 0 4 0 4 0 3 4 3 3 1 0 4 1 3 2 4 4 3 2 2 4 2 3 3 4 1 3 5 0 0 0 1 3 1 3 4 4 4 4 4 3 4 1 3 0 0 3 3 4 3 4 2 0 0 4 3 0 4 4 4 3 3 4 3 2 2 2 2 4 2 3 0 4 3 5 0 0 3 0 1 3 1 3 4 4 4 4 0 4 3 4 1 1 4 0 3 3 1 4 1 4 4 4 3 3 4 0 4 4 3 3 0 3 2 2 2 4 3 4 1 5 0 1 3 1 3 4 1 4 4 0 0 4 4 3 0 3 1 4 1 0 0 0 4 4 3 3 1 3 0 0 3 4 2 2 4 3 2 2 0 2 4 3 0 4 0 1 3 1 4 4 0 4 3 1 4 1 0 0 4 3 3 1 3 4 2 3 3 3 2 2 2 2 2 4 2 3 3 4 0 0 3 1 0 0 0 4 0 3 3 0 1 2 3 1 5 1 0 0 0 0 3 3 4 3 4 0 1 2 1 4 3 0 1 0 0 0 3 0 4 4 4 0 0 1 2 2 3 4 3 0 1 1 1 0 0 0 0 4 3 2 3 1 3 0 1 0 0 3 0 2 3 1 4 2 1 4 3 2 1 4 1 1 0 5 0 5 2 1 3 4 2 2 2 3 3 3 3 0 1 1 1 3 3 4 2 3 2 3 3 0 5 3 3 0 5 1 5 2 2 3 2 3 5 1 3 0 0 5 5 2 1 2 3 4 3 5 3 3 5 0 5 2 3 2 2 4 3 5 3 5 0 0 0 1 3 1 3 4 4 4 4 4 3 4 1 3 0 0 3 3 4 3 4 2 0 0 4 3 0 4 4 4 3 3 4 3 2 2 2 4 2 3 3 0 4 3 5 3 5 0 5 0 0 3 1 1 3 1 3 4 4 4 4 0 4 3 4 1 1 4 0 3 3 1 4 1 4 4 4 3 3 4 0 4 4 3 3 0 3 2 2 2 4 3 4 1 5 0 1 3 3 4 4 0 4 3 3 0 1 4 1 0 0 0 4 4 3 3 1 3 0 0 3 4 2 2 4 3 2 2 0 2 2 4 3 0 4 0 1 3 1 4 4 0 4 3 1 4 1 0 0 4 3 3 1 3 4 2 3 3 3 2 2 2 2 2 4 2 3 3 3 4 5 1 0 0 0 0 3 3 4 3 4 0 1 2 1 4 3 1 0 0 0 3 0 4 4 4 0 0 1 2 2 3 4 3 0 1 1 1 0 0 0 3 2 3 1 3 0 1 0 0 3 0 2 3 4 3 2 1 4 1 1 0 1 1 1 3 3 4 2 3 2 3 3 5 3 3 5 1 5 2 2 3 2 3 5 1 3 0 0 5 5 2 1 2 3 4 3 3 5 3 3 5 0 5 5 2 3 2 2 4 3 5] Elapsed time: 0.2273726463317871 graph_id used : 80153 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20783259,20783260,20783271,20783262,20783263,20783267,20783273,20783276,20783268,20783269,20783270,20783272,20783275?tags=film_plastique,autre,carton,metal,flou,pet_fonce,papier,pehd,mal_croppe,tetrapak,refus,environnement,pet_clair&datou_id_consolidate=4235&port_consolidate=20776132&tree_id=80153 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1339355524, 1339355523, 1339355521, 1339355518] Looping around the photos to save general results len do output : 1 /20776132Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355524', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355523', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355521', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355518', None, None, None, None, None, '2610153') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012697935104370117 save_final save missing photos in datou_result : time spend for datou_step_exec : 47.58305215835571 time spend to save output : 0.013079404830932617 total time spend for step 9 : 47.596131563186646 step10:send_mail_cod Mon Feb 24 23:24:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20776132_24-02-2025_23_24_55.pdf 20783241 imagette207832411740435895 20783242 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207832421740435895 20783253 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207832531740435896 20783244 imagette207832441740435898 20783245 imagette207832451740435898 20783249 imagette207832491740435898 20783255 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207832551740435898 20783258 imagette207832581740435899 20783250 imagette207832501740435899 20783251 imagette207832511740435899 20783252 imagette207832521740435899 20783257 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207832571740435899 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20776132 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20783259,20783260,20783271,20783262,20783263,20783267,20783273,20783276,20783268,20783269,20783270,20783272,20783275?tags=film_plastique,autre,carton,metal,flou,pet_fonce,papier,pehd,mal_croppe,tetrapak,refus,environnement,pet_clair&datou_id_consolidate=4235&port_consolidate=20776132&tree_id=80153 your option no_mail is active, we will not send the real mail to your client args[1339355524] : ((1339355524, -7.068925290264646, 492609224), (1339355524, -0.8671862623454536, 501862349), '0.2365564375650076') We are sending mail with results at cod@fotonower.com args[1339355523] : ((1339355523, -7.008183180293233, 492609224), (1339355523, -0.9076003232225104, 501862349), '0.2365564375650076') We are sending mail with results at cod@fotonower.com args[1339355521] : ((1339355521, -6.622860098694158, 492609224), (1339355521, -0.8434225473387642, 501862349), '0.2365564375650076') We are sending mail with results at cod@fotonower.com args[1339355518] : ((1339355518, -6.398674612915458, 492609224), (1339355518, -0.7921289411177873, 501862349), '0.2365564375650076') We are sending mail with results at cod@fotonower.com refus_total : 0.2365564375650076 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20776132 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776132_24-02-2025_23_24_55.pdf results_Qualipapia_P20776132_24-02-2025_23_24_55.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776132_24-02-2025_23_24_55.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20776132','results_Qualipapia_P20776132_24-02-2025_23_24_55.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776132_24-02-2025_23_24_55.pdf','pdf','','0.17','0.2365564375650076') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1339355524, 1339355523, 1339355521, 1339355518] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355524', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355523', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355521', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355518', None, None, None, None, None, '2610153') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.01612687110900879 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.81846022605896 time spend to save output : 0.01626729965209961 total time spend for step 10 : 5.83472752571106 step11:split_time_score Mon Feb 24 23:25:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24022025 20776132 Nombre de photos uploadées : 9 / 23040 (0%) 24022025 20776132 Nombre de photos taguées (types de déchets): 9 / 9 (100%) 24022025 20776132 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005424022674560547 elapsed_time : insert_dashboard_record_day_entry 0.022541046142578125 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.12315286692610344 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20767926_24-02-2025_10_46_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20767926 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20767926 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769927 order by id desc limit 1 Qualite : 0.19192157647294192 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769928_24-02-2025_18_28_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769928 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769928 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769929 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769954 order by id desc limit 1 Qualite : 0.19472272069322913 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769955_24-02-2025_18_49_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769955 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769955 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769956 order by id desc limit 1 Qualite : 0.23355238148952678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769957_24-02-2025_18_55_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769957 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769957 AND mptpi.`type`=4230 To do Qualite : 0.19014267254990505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769958_24-02-2025_18_58_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769958 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769958 AND mptpi.`type`=4230 To do Qualite : 0.1833836220520911 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769983_24-02-2025_11_54_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769983 AND mptpi.`type`=4230 To do Qualite : 0.19665553106350908 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769984_24-02-2025_19_04_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769984 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769984 AND mptpi.`type`=4230 To do Qualite : 0.23731665410579766 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769985_24-02-2025_19_09_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769985 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769985 AND mptpi.`type`=4230 To do Qualite : 0.21937111169676032 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770547_24-02-2025_19_27_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770547 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770547 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770548 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770549 order by id desc limit 1 Qualite : 0.24072833978030664 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770550_24-02-2025_19_29_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770550 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770550 AND mptpi.`type`=4230 To do Qualite : 0.26387344144222896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770551_24-02-2025_19_32_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770551 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770551 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770552 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770553 order by id desc limit 1 Qualite : 0.23761633948862013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770554_24-02-2025_19_51_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770554 AND mptpi.`type`=4230 To do Qualite : 0.24234203905019133 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770555_24-02-2025_19_53_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770555 AND mptpi.`type`=4230 To do Qualite : 0.2550030691725577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770556_24-02-2025_20_15_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770556 AND mptpi.`type`=4230 To do Qualite : 0.2659923557004906 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770557_24-02-2025_20_07_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770557 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770557 AND mptpi.`type`=4230 To do Qualite : 0.2566031289772565 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771583_24-02-2025_20_13_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771583 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771583 AND mptpi.`type`=4230 To do Qualite : 0.2517094312879323 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771584_24-02-2025_20_18_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771584 AND mptpi.`type`=4230 To do Qualite : 0.18206223173915434 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771585_24-02-2025_20_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771585 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771585 AND mptpi.`type`=4230 To do Qualite : 0.23170815627849364 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771586_24-02-2025_20_27_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771586 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771586 AND mptpi.`type`=4230 To do Qualite : 0.25060066983533874 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771587_24-02-2025_20_34_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771587 AND mptpi.`type`=4230 To do Qualite : 0.2234444741551309 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771588_24-02-2025_20_38_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771588 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771588 AND mptpi.`type`=4230 To do Qualite : 0.24085128737355288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771589_24-02-2025_20_42_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771589 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771589 AND mptpi.`type`=4230 To do Qualite : 0.24404525214605174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771590_24-02-2025_20_56_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771590 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771590 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771591 order by id desc limit 1 Qualite : 0.2522572261957997 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771592_24-02-2025_21_06_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771592 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771592 AND mptpi.`type`=4230 To do Qualite : 0.2618522302441174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771593_24-02-2025_21_23_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771593 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771593 AND mptpi.`type`=4230 To do Qualite : 0.1806515155344998 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771594_24-02-2025_21_08_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771594 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771594 AND mptpi.`type`=4230 To do Qualite : 0.223188931033508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771595_24-02-2025_21_14_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771595 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771595 AND mptpi.`type`=4230 To do Qualite : 0.24013689870139143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771596_24-02-2025_12_48_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771596 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771596 AND mptpi.`type`=4230 To do Qualite : 0.21094636630514205 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771597_24-02-2025_12_33_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771597 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771597 AND mptpi.`type`=4230 To do Qualite : 0.24428012235668636 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771917_24-02-2025_21_45_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771917 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771917 AND mptpi.`type`=4230 To do Qualite : 0.2472142555454651 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771918_24-02-2025_15_49_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771918 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771918 AND mptpi.`type`=4230 To do Qualite : 0.2654924659269221 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771919_24-02-2025_14_50_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771919 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771919 AND mptpi.`type`=4230 To do Qualite : 0.24347313754946903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771920_24-02-2025_13_48_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771920 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771920 AND mptpi.`type`=4230 To do Qualite : 0.25477322572762684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771921_24-02-2025_13_42_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771921 AND mptpi.`type`=4230 To do Qualite : 0.2725419720648553 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774301_24-02-2025_21_38_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774301 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774301 AND mptpi.`type`=4230 To do Qualite : 0.2738987733388131 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774302_24-02-2025_21_38_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774302 AND mptpi.`type`=4230 To do Qualite : 0.295029482856265 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774303_24-02-2025_21_43_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774303 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774303 AND mptpi.`type`=4230 To do Qualite : 0.2909567315969779 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774304_24-02-2025_21_48_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774304 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774304 AND mptpi.`type`=4230 To do Qualite : 0.2842256248784778 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774305_24-02-2025_21_52_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774305 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774305 AND mptpi.`type`=4230 To do Qualite : 0.25955467649661085 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774306_24-02-2025_22_11_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774306 AND mptpi.`type`=4230 To do Qualite : 0.2599699209407511 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774307_24-02-2025_22_03_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774307 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774307 AND mptpi.`type`=4230 To do Qualite : 0.2567509423977914 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774308_24-02-2025_22_16_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774308 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774308 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774309 order by id desc limit 1 Qualite : 0.2676575485774257 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774310_24-02-2025_22_18_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774310 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774310 AND mptpi.`type`=4230 To do Qualite : 0.2739560737899723 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774311_24-02-2025_22_46_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774311 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774311 AND mptpi.`type`=4230 To do Qualite : 0.3156235099448955 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774312_24-02-2025_22_27_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774312 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774312 AND mptpi.`type`=4230 To do Qualite : 0.2128553944159406 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774313_24-02-2025_22_33_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774313 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774313 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774314 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774807 order by id desc limit 1 Qualite : 0.23886260387248692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774808_24-02-2025_23_23_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774808 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774808 AND mptpi.`type`=4230 To do Qualite : 0.22512550723363015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774809_24-02-2025_16_32_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774809 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774809 AND mptpi.`type`=4230 To do Qualite : 0.2676980827896467 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774811_24-02-2025_16_17_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774811 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774811 AND mptpi.`type`=4230 To do Qualite : 0.2779446430507002 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776130_24-02-2025_22_52_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776130 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776130 AND mptpi.`type`=4230 To do Qualite : 0.23778536716945162 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776132_24-02-2025_23_24_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776132 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776132 AND mptpi.`type`=4230 To do Qualite : 0.2740202887306019 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776134_24-02-2025_17_34_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776134 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776134 AND mptpi.`type`=4230 To do Qualite : 0.14478572315220764 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776137_24-02-2025_21_47_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776137 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776137 AND mptpi.`type`=4230 To do Qualite : 0.15452677325102562 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776139_24-02-2025_16_50_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776139 AND mptpi.`type`=4230 To do Qualite : 0.26795604366198006 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20778556_24-02-2025_17_47_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20778556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20778556 AND mptpi.`type`=4230 To do Qualite : 0.2344766697681388 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779166 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779166 AND mptpi.`type`=4230 To do Qualite : 0.2406676044211381 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779167_24-02-2025_20_41_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779167 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779167 AND mptpi.`type`=4230 To do Qualite : 0.1845385493439375 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779168_24-02-2025_18_36_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779168 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779168 AND mptpi.`type`=4230 To do Qualite : 0.19892543137470436 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779169 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779169 AND mptpi.`type`=4230 To do Qualite : 0.22153100249252605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779170_24-02-2025_18_17_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779170 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779170 AND mptpi.`type`=4230 To do Qualite : 0.19899965223646818 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779577_24-02-2025_19_32_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779577 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779577 AND mptpi.`type`=4230 To do Qualite : 0.20246425862176948 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779578_24-02-2025_19_53_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779578 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779578 AND mptpi.`type`=4230 To do Qualite : 0.2461702807893893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779579_24-02-2025_18_48_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779579 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779579 AND mptpi.`type`=4230 To do Qualite : 0.19850863879984906 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779993_24-02-2025_19_23_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779993 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24022025': {'nb_upload': 9, 'nb_taggue_class': 9, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1339355524, 1339355523, 1339355521, 1339355518] Looping around the photos to save general results len do output : 1 /20776132Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355524', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355523', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355521', None, None, None, None, None, '2610153') ('4234', None, None, None, None, None, None, None, '2610153') ('4234', None, '1339355518', None, None, None, None, None, '2610153') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.018345117568969727 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.361292600631714 time spend to save output : 0.018585681915283203 total time spend for step 11 : 13.379878282546997 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 53.67user 32.81system 4:50.11elapsed 29%CPU (0avgtext+0avgdata 2518860maxresident)k 7704inputs+23784outputs (31major+2654038minor)pagefaults 0swaps