python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2001492 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2537758'] with mtr_portfolio_ids : ['20143393'] and first list_photo_ids : [] new path : /proc/2001492/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.4500315189361572 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sun Feb 2 01:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-02 01:20:34.370114: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-02 01:20:34.379818: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-02 01:20:34.496646: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2994000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-02 01:20:34.496700: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-02 01:20:34.500477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-02 01:20:34.726682: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2083a040 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-02 01:20:34.726732: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-02 01:20:34.728560: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-02 01:20:34.729259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-02 01:20:34.733517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-02 01:20:34.739380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-02 01:20:34.740071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-02 01:20:34.745357: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-02 01:20:34.748007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-02 01:20:34.764072: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-02 01:20:34.765795: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-02 01:20:34.765868: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-02 01:20:34.766768: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-02 01:20:34.766786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-02 01:20:34.766796: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-02 01:20:34.768664: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-02 01:20:35.130877: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-02 01:20:35.130960: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-02 01:20:35.130980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-02 01:20:35.130998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-02 01:20:35.131015: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-02 01:20:35.131032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-02 01:20:35.131048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-02 01:20:35.131065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-02 01:20:35.132397: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-02 01:20:35.133498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-02 01:20:35.133532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-02 01:20:35.133549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-02 01:20:35.133565: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-02 01:20:35.133581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-02 01:20:35.133597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-02 01:20:35.133613: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-02 01:20:35.133629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-02 01:20:35.134911: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-02 01:20:35.134937: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-02 01:20:35.134946: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-02 01:20:35.134954: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-02 01:20:35.136315: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-02 01:20:43.063903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-02 01:20:43.253964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.21563 max: 150.50625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0008418560028076172 length of segment : 25 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00013399124145507812 length of segment : 22 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0002410411834716797 length of segment : 30 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 838 time to create 1 rle with old method : 0.0015404224395751953 length of segment : 36 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 883 time to create 1 rle with old method : 0.0016443729400634766 length of segment : 40 length of segment : 0 time for calcul the mask position with numpy : 0.0001659393310546875 nb_pixel_total : 3468 time to create 1 rle with old method : 0.00593113899230957 length of segment : 71 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 881 time to create 1 rle with old method : 0.0015697479248046875 length of segment : 37 time for calcul the mask position with numpy : 0.00017142295837402344 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0030493736267089844 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.13750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 956 time to create 1 rle with old method : 0.0012066364288330078 length of segment : 38 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1329 time to create 1 rle with old method : 0.0018534660339355469 length of segment : 49 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 3556 time to create 1 rle with old method : 0.004755258560180664 length of segment : 70 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002162456512451172 length of segment : 12 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 919 time to create 1 rle with old method : 0.0012145042419433594 length of segment : 44 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.0011038780212402344 length of segment : 39 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004487037658691406 length of segment : 14 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 996 time to create 1 rle with old method : 0.0012977123260498047 length of segment : 44 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 979 time to create 1 rle with old method : 0.0013065338134765625 length of segment : 41 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 4177 time to create 1 rle with old method : 0.005121707916259766 length of segment : 64 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.76250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 6372 time to create 1 rle with old method : 0.0072002410888671875 length of segment : 103 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 3650 time to create 1 rle with old method : 0.004328250885009766 length of segment : 112 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00034332275390625 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.57500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 6623 time to create 1 rle with old method : 0.008449792861938477 length of segment : 115 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003662109375 length of segment : 17 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 985 time to create 1 rle with old method : 0.0013132095336914062 length of segment : 56 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1630 time to create 1 rle with old method : 0.0019795894622802734 length of segment : 60 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 2043 time to create 1 rle with old method : 0.002772808074951172 length of segment : 43 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003113746643066406 length of segment : 18 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002701282501220703 length of segment : 13 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.15078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0008518695831298828 length of segment : 19 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002665519714355469 length of segment : 23 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006992816925048828 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001971721649169922 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 210.00000 molded_images shape: (1, 640, 640, 3) min: -89.72734 max: 79.07500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.38359 max: 149.70547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.0012660026550292969 length of segment : 41 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00017452239990234375 length of segment : 21 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 871 time to create 1 rle with old method : 0.00121307373046875 length of segment : 41 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006587505340576172 length of segment : 30 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 1209 time to create 1 rle with old method : 0.0013957023620605469 length of segment : 44 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0010273456573486328 length of segment : 28 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002963542938232422 length of segment : 31 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1133 time to create 1 rle with old method : 0.0013942718505859375 length of segment : 46 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006575584411621094 length of segment : 38 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005137920379638672 length of segment : 22 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003364086151123047 length of segment : 11 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004794597625732422 length of segment : 30 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005419254302978516 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 705 time to create 1 rle with old method : 0.0008299350738525391 length of segment : 31 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 2043 time to create 1 rle with old method : 0.002483367919921875 length of segment : 50 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1090 time to create 1 rle with old method : 0.0013458728790283203 length of segment : 43 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.00035452842712402344 length of segment : 35 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 2382 time to create 1 rle with old method : 0.0026750564575195312 length of segment : 71 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.001374959945678711 length of segment : 46 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0010552406311035156 length of segment : 37 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005025863647460938 length of segment : 18 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002753734588623047 length of segment : 13 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00017881393432617188 length of segment : 11 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0008363723754882812 length of segment : 26 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003788471221923828 length of segment : 17 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 705 time to create 1 rle with old method : 0.0008857250213623047 length of segment : 28 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005362033843994141 length of segment : 21 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009083747863769531 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.01641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 9.822845458984375e-05 nb_pixel_total : 1762 time to create 1 rle with old method : 0.002137422561645508 length of segment : 156 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0007519721984863281 length of segment : 41 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1242 time to create 1 rle with old method : 0.001711130142211914 length of segment : 71 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.001638650894165039 length of segment : 35 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005829334259033203 length of segment : 27 time for calcul the mask position with numpy : 0.0004658699035644531 nb_pixel_total : 28044 time to create 1 rle with old method : 0.031017780303955078 length of segment : 398 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1325 time to create 1 rle with old method : 0.001627206802368164 length of segment : 40 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00028634071350097656 length of segment : 18 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1294 time to create 1 rle with old method : 0.0015981197357177734 length of segment : 41 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1571 time to create 1 rle with old method : 0.002239227294921875 length of segment : 54 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 578 time to create 1 rle with old method : 0.0007498264312744141 length of segment : 77 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 245.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 131.92422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1754 time to create 1 rle with old method : 0.002160310745239258 length of segment : 88 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0009613037109375 length of segment : 47 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.001195669174194336 length of segment : 36 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004730224609375 length of segment : 35 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 1154 time to create 1 rle with old method : 0.0015246868133544922 length of segment : 98 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.000530242919921875 length of segment : 28 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0009872913360595703 length of segment : 45 time for calcul the mask position with numpy : 0.00017786026000976562 nb_pixel_total : 2771 time to create 1 rle with old method : 0.0033011436462402344 length of segment : 178 Processing 1 images image shape: (280, 400, 3) min: 1.00000 max: 182.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 54.10234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0008242130279541016 length of segment : 62 time for calcul the mask position with numpy : 0.0010476112365722656 nb_pixel_total : 105729 time to create 1 rle with old method : 0.12505578994750977 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.79922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1613 time to create 1 rle with old method : 0.0020830631256103516 length of segment : 88 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1947 time to create 1 rle with old method : 0.0025053024291992188 length of segment : 79 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006563663482666016 length of segment : 34 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00024962425231933594 length of segment : 13 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00016689300537109375 length of segment : 9 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00041222572326660156 length of segment : 16 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.001436471939086914 length of segment : 86 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.68984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 45 time for calcul the mask position with numpy : 0.00013589859008789062 nb_pixel_total : 150 time to create 1 rle with old method : 0.0003666877746582031 length of segment : 17 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003192424774169922 length of segment : 17 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003733634948730469 length of segment : 20 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00027871131896972656 length of segment : 16 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1694 time to create 1 rle with old method : 0.0022728443145751953 length of segment : 41 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005362033843994141 length of segment : 23 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.0011849403381347656 length of segment : 42 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0004165172576904297 length of segment : 15 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 743 time to create 1 rle with old method : 0.0010712146759033203 length of segment : 15 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00013589859008789062 length of segment : 9 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004792213439941406 length of segment : 19 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007717609405517578 length of segment : 36 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00014543533325195312 length of segment : 13 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015163421630859375 length of segment : 12 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005929470062255859 length of segment : 24 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00032210350036621094 length of segment : 19 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006670951843261719 length of segment : 22 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0008766651153564453 length of segment : 45 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003495216369628906 length of segment : 17 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.00045561790466308594 length of segment : 29 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0008344650268554688 length of segment : 32 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1177 time to create 1 rle with old method : 0.0016922950744628906 length of segment : 47 time for calcul the mask position with numpy : 0.0001480579376220703 nb_pixel_total : 1729 time to create 1 rle with old method : 0.0023000240325927734 length of segment : 116 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 704 time to create 1 rle with old method : 0.0011138916015625 length of segment : 34 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0017545223236083984 length of segment : 38 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0005576610565185547 length of segment : 24 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002617835998535156 length of segment : 19 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002791881561279297 length of segment : 11 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0007772445678710938 length of segment : 44 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005130767822265625 length of segment : 27 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00011372566223144531 length of segment : 8 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0011603832244873047 length of segment : 34 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0004703998565673828 length of segment : 23 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002315044403076172 length of segment : 20 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0003535747528076172 length of segment : 13 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0005292892456054688 length of segment : 29 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00048422813415527344 length of segment : 17 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0009336471557617188 length of segment : 21 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.00045371055603027344 length of segment : 16 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0006387233734130859 length of segment : 21 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003476142883300781 length of segment : 24 time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 717 time to create 1 rle with old method : 0.002453327178955078 length of segment : 48 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 693 time to create 1 rle with old method : 0.0011680126190185547 length of segment : 26 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 1509 time to create 1 rle with old method : 0.002153158187866211 length of segment : 38 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0018198490142822266 length of segment : 44 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00030040740966796875 length of segment : 43 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0018398761749267578 length of segment : 60 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005202293395996094 length of segment : 39 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1530 time to create 1 rle with old method : 0.0019588470458984375 length of segment : 50 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 725 time to create 1 rle with old method : 0.0010776519775390625 length of segment : 38 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 895 time to create 1 rle with old method : 0.0013234615325927734 length of segment : 23 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00026345252990722656 length of segment : 12 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0003247261047363281 length of segment : 13 time for calcul the mask position with numpy : 0.0005595684051513672 nb_pixel_total : 30926 time to create 1 rle with old method : 0.0368807315826416 length of segment : 301 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 876 time to create 1 rle with old method : 0.0012519359588623047 length of segment : 35 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 131.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 48 time for calcul the mask position with numpy : 0.0004601478576660156 nb_pixel_total : 35161 time to create 1 rle with old method : 0.04420733451843262 length of segment : 220 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.70781 max: 149.76016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0007336139678955078 length of segment : 25 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00015306472778320312 length of segment : 25 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00017571449279785156 length of segment : 31 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 943 time to create 1 rle with old method : 0.0013709068298339844 length of segment : 37 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2070 time to create 1 rle with old method : 0.003082275390625 length of segment : 32 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 830 time to create 1 rle with old method : 0.0011708736419677734 length of segment : 32 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 860 time to create 1 rle with old method : 0.0011751651763916016 length of segment : 35 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 11 time to create 1 rle with old method : 7.510185241699219e-05 length of segment : 3 length of segment : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.43047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1000 time to create 1 rle with old method : 0.0013947486877441406 length of segment : 37 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0011050701141357422 length of segment : 30 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1000 time to create 1 rle with old method : 0.0013821125030517578 length of segment : 41 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 2308 time to create 1 rle with old method : 0.003424406051635742 length of segment : 41 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1487 time to create 1 rle with old method : 0.002179861068725586 length of segment : 44 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0007243156433105469 length of segment : 17 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 2125 time to create 1 rle with old method : 0.0029528141021728516 length of segment : 118 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 1149 time to create 1 rle with old method : 0.0015299320220947266 length of segment : 59 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 1474 time to create 1 rle with old method : 0.0021238327026367188 length of segment : 46 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00026988983154296875 length of segment : 15 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 2491 time to create 1 rle with old method : 0.003264188766479492 length of segment : 53 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 1937 time to create 1 rle with old method : 0.002750873565673828 length of segment : 60 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 2497 time to create 1 rle with old method : 0.0034143924713134766 length of segment : 49 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 2913 time to create 1 rle with old method : 0.0037398338317871094 length of segment : 117 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0014531612396240234 length of segment : 44 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2800 time to create 1 rle with old method : 0.0034685134887695312 length of segment : 54 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0013322830200195312 length of segment : 40 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 3632 time to create 1 rle with old method : 0.004829883575439453 length of segment : 91 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.47344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00011992454528808594 nb_pixel_total : 6369 time to create 1 rle with old method : 0.009107828140258789 length of segment : 113 time for calcul the mask position with numpy : 0.00015282630920410156 nb_pixel_total : 2584 time to create 1 rle with old method : 0.003787517547607422 length of segment : 127 time for calcul the mask position with numpy : 0.00013709068298339844 nb_pixel_total : 2365 time to create 1 rle with old method : 0.0033500194549560547 length of segment : 121 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.68047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00014400482177734375 nb_pixel_total : 6840 time to create 1 rle with old method : 0.008744478225708008 length of segment : 132 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0015418529510498047 length of segment : 58 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003986358642578125 length of segment : 20 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0007050037384033203 length of segment : 22 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00024366378784179688 length of segment : 12 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.77969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0007579326629638672 length of segment : 17 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 14 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 997 time to create 1 rle with old method : 0.0012125968933105469 length of segment : 90 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1325 time to create 1 rle with old method : 0.0017342567443847656 length of segment : 35 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.00024127960205078125 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -94.55156 max: 66.50859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.22344 max: 149.70547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0013756752014160156 length of segment : 48 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 27 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0015180110931396484 length of segment : 43 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 15 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 907 time to create 1 rle with old method : 0.001234292984008789 length of segment : 44 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006575584411621094 length of segment : 29 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 833 time to create 1 rle with old method : 0.0012121200561523438 length of segment : 27 time for calcul the mask position with numpy : 0.0005164146423339844 nb_pixel_total : 29941 time to create 1 rle with old method : 0.0363156795501709 length of segment : 282 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00036215782165527344 length of segment : 30 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 837 time to create 1 rle with old method : 0.0014197826385498047 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.82109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 0.00021147727966308594 nb_pixel_total : 10780 time to create 1 rle with old method : 0.01241159439086914 length of segment : 148 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00042128562927246094 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00019240379333496094 length of segment : 11 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 801 time to create 1 rle with old method : 0.0010983943939208984 length of segment : 52 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 895 time to create 1 rle with old method : 0.0013039112091064453 length of segment : 36 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0006608963012695312 length of segment : 22 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004546642303466797 length of segment : 27 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0007977485656738281 length of segment : 33 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 750 time to create 1 rle with old method : 0.0010387897491455078 length of segment : 37 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 2174 time to create 1 rle with old method : 0.002843618392944336 length of segment : 45 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 2124 time to create 1 rle with old method : 0.0026106834411621094 length of segment : 67 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00022530555725097656 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.75078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 2212 time to create 1 rle with old method : 0.002761363983154297 length of segment : 150 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0008451938629150391 length of segment : 42 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003325939178466797 length of segment : 17 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 18674 time to create 1 rle with old method : 0.021207094192504883 length of segment : 261 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002963542938232422 length of segment : 19 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003364086151123047 length of segment : 31 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010628700256347656 length of segment : 34 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0018973350524902344 length of segment : 39 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0021347999572753906 length of segment : 64 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1307 time to create 1 rle with old method : 0.0017583370208740234 length of segment : 40 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0006036758422851562 length of segment : 33 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 243.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 126.61172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1905 time to create 1 rle with old method : 0.0023756027221679688 length of segment : 88 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005407333374023438 length of segment : 32 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 510 time to create 1 rle with old method : 0.0007252693176269531 length of segment : 48 time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 3418 time to create 1 rle with old method : 0.0046176910400390625 length of segment : 212 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 1836 time to create 1 rle with old method : 0.0024013519287109375 length of segment : 54 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0013267993927001953 length of segment : 49 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.0010066032409667969 length of segment : 47 time for calcul the mask position with numpy : 0.0002734661102294922 nb_pixel_total : 3917 time to create 1 rle with old method : 0.004900455474853516 length of segment : 218 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 700 time to create 1 rle with old method : 0.0008561611175537109 length of segment : 43 Processing 1 images image shape: (280, 400, 3) min: 2.00000 max: 190.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 65.68047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.00092315673828125 length of segment : 53 time for calcul the mask position with numpy : 0.0013217926025390625 nb_pixel_total : 106207 time to create 1 rle with old method : 0.12319469451904297 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00011157989501953125 nb_pixel_total : 1601 time to create 1 rle with old method : 0.002459287643432617 length of segment : 92 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00037026405334472656 length of segment : 16 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00030159950256347656 length of segment : 13 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 1437 time to create 1 rle with old method : 0.002071380615234375 length of segment : 98 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1179 time to create 1 rle with old method : 0.0017745494842529297 length of segment : 35 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0007343292236328125 length of segment : 31 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005564689636230469 length of segment : 31 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.72891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 43 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00023555755615234375 length of segment : 16 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.001047372817993164 length of segment : 46 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0011501312255859375 length of segment : 15 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 22 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002689361572265625 length of segment : 17 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 601 time to create 1 rle with old method : 0.0008940696716308594 length of segment : 45 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1762 time to create 1 rle with old method : 0.0022134780883789062 length of segment : 43 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 15 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00038170814514160156 length of segment : 21 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.00044727325439453125 length of segment : 28 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007047653198242188 length of segment : 37 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003597736358642578 length of segment : 15 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002827644348144531 length of segment : 25 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003192424774169922 length of segment : 15 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 754 time to create 1 rle with old method : 0.0010008811950683594 length of segment : 48 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00015282630920410156 length of segment : 13 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00029754638671875 length of segment : 13 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 597 time to create 1 rle with old method : 0.0009176731109619141 length of segment : 42 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 47 time to create 1 rle with old method : 9.226799011230469e-05 length of segment : 8 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006492137908935547 length of segment : 26 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003440380096435547 length of segment : 20 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00011920928955078125 length of segment : 10 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004563331604003906 length of segment : 20 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0003178119659423828 length of segment : 15 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0008053779602050781 length of segment : 23 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 39 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007212162017822266 length of segment : 35 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005629062652587891 length of segment : 40 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0014722347259521484 length of segment : 42 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00027751922607421875 length of segment : 14 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.000244140625 length of segment : 12 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1304 time to create 1 rle with old method : 0.0018157958984375 length of segment : 38 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002856254577636719 length of segment : 25 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005509853363037109 length of segment : 21 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002601146697998047 length of segment : 41 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009105205535888672 length of segment : 42 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005857944488525391 length of segment : 35 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00019502639770507812 length of segment : 12 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.00047707557678222656 length of segment : 24 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 921 time to create 1 rle with old method : 0.0012094974517822266 length of segment : 34 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1416 time to create 1 rle with old method : 0.0018439292907714844 length of segment : 41 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 945 time to create 1 rle with old method : 0.0012712478637695312 length of segment : 33 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1700 time to create 1 rle with old method : 0.002365589141845703 length of segment : 41 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.18984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 1376 time to create 1 rle with old method : 0.0016891956329345703 length of segment : 69 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006387233734130859 length of segment : 83 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005321502685546875 length of segment : 38 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.00010752677917480469 length of segment : 10 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.0011072158813476562 length of segment : 38 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 949 time to create 1 rle with old method : 0.0012667179107666016 length of segment : 22 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 35 time to create 1 rle with old method : 9.322166442871094e-05 length of segment : 12 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 2011 time to create 1 rle with old method : 0.0025620460510253906 length of segment : 76 time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 14673 time to create 1 rle with old method : 0.016895294189453125 length of segment : 408 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1739 time to create 1 rle with old method : 0.0022699832916259766 length of segment : 63 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 951 time to create 1 rle with old method : 0.001302480697631836 length of segment : 35 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2414 time to create 1 rle with old method : 0.0028581619262695312 length of segment : 81 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00024700164794921875 length of segment : 35 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.32109 max: 149.75234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006275177001953125 length of segment : 29 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00011110305786132812 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00020599365234375 length of segment : 27 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 882 time to create 1 rle with old method : 0.001241922378540039 length of segment : 37 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.0010156631469726562 length of segment : 35 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 884 time to create 1 rle with old method : 0.0012257099151611328 length of segment : 40 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0009534358978271484 length of segment : 39 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 4 time to create 1 rle with old method : 2.6226043701171875e-05 length of segment : 3 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.90703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.0002231597900390625 length of segment : 15 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005064010620117188 length of segment : 18 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 2455 time to create 1 rle with old method : 0.003251314163208008 length of segment : 53 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00022220611572265625 length of segment : 13 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1402 time to create 1 rle with old method : 0.0017461776733398438 length of segment : 39 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 1025 time to create 1 rle with old method : 0.0012924671173095703 length of segment : 47 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010483264923095703 length of segment : 69 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 2436 time to create 1 rle with old method : 0.002930164337158203 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.68047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 6373 time to create 1 rle with old method : 0.007384061813354492 length of segment : 102 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.06719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 5991 time to create 1 rle with old method : 0.007111549377441406 length of segment : 99 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0012984275817871094 length of segment : 56 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003502368927001953 length of segment : 18 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.0001304149627685547 length of segment : 18 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002961158752441406 length of segment : 23 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00027251243591308594 length of segment : 17 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00047016143798828125 length of segment : 19 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2022 time to create 1 rle with old method : 0.002630949020385742 length of segment : 39 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 254.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.59219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006690025329589844 length of segment : 18 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1192 time to create 1 rle with old method : 0.0015213489532470703 length of segment : 80 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1204 time to create 1 rle with old method : 0.0016391277313232422 length of segment : 34 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 609 time to create 1 rle with old method : 0.0008335113525390625 length of segment : 40 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1259 time to create 1 rle with old method : 0.0014655590057373047 length of segment : 115 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 192.00000 molded_images shape: (1, 640, 640, 3) min: -95.89609 max: 55.72187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.13750 max: 149.98281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.0011157989501953125 length of segment : 46 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.0012049674987792969 length of segment : 47 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00034689903259277344 length of segment : 34 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0005383491516113281 length of segment : 17 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002448558807373047 length of segment : 24 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1242 time to create 1 rle with old method : 0.0017728805541992188 length of segment : 44 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.001146078109741211 length of segment : 28 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1312 time to create 1 rle with old method : 0.0017309188842773438 length of segment : 46 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005645751953125 length of segment : 31 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0011591911315917969 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.57500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.00045680999755859375 length of segment : 17 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1907 time to create 1 rle with old method : 0.002534627914428711 length of segment : 44 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003256797790527344 length of segment : 19 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 728 time to create 1 rle with old method : 0.0008730888366699219 length of segment : 47 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001811981201171875 length of segment : 11 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0008504390716552734 length of segment : 24 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007882118225097656 length of segment : 22 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.0009222030639648438 length of segment : 32 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005183219909667969 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.95000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0008649826049804688 length of segment : 44 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1778 time to create 1 rle with old method : 0.0022363662719726562 length of segment : 129 time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 18452 time to create 1 rle with old method : 0.02068495750427246 length of segment : 272 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 850 time to create 1 rle with old method : 0.0010256767272949219 length of segment : 37 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00028705596923828125 length of segment : 18 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1978 time to create 1 rle with old method : 0.0027456283569335938 length of segment : 56 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 34 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 927 time to create 1 rle with old method : 0.0012845993041992188 length of segment : 21 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0017306804656982422 length of segment : 39 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2640 time to create 1 rle with old method : 0.0032978057861328125 length of segment : 58 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005829334259033203 length of segment : 28 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005583763122558594 length of segment : 28 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 125.07656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005650520324707031 length of segment : 34 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1814 time to create 1 rle with old method : 0.0023679733276367188 length of segment : 89 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 694 time to create 1 rle with old method : 0.0009031295776367188 length of segment : 44 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 747 time to create 1 rle with old method : 0.0009045600891113281 length of segment : 48 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.00018072128295898438 length of segment : 16 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.0009338855743408203 length of segment : 50 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1240 time to create 1 rle with old method : 0.0015060901641845703 length of segment : 56 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007061958312988281 length of segment : 43 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0010290145874023438 length of segment : 35 time for calcul the mask position with numpy : 0.00017213821411132812 nb_pixel_total : 4090 time to create 1 rle with old method : 0.005202293395996094 length of segment : 212 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 170.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 46.92656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008709430694580078 length of segment : 65 time for calcul the mask position with numpy : 0.0009980201721191406 nb_pixel_total : 106659 time to create 1 rle with old method : 0.13634634017944336 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1549 time to create 1 rle with old method : 0.0020475387573242188 length of segment : 85 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00023555755615234375 length of segment : 15 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.0009965896606445312 length of segment : 48 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005400180816650391 length of segment : 31 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 16 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1314 time to create 1 rle with old method : 0.0017995834350585938 length of segment : 53 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.41641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 43 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00027370452880859375 length of segment : 17 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00015115737915039062 length of segment : 11 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1676 time to create 1 rle with old method : 0.0022382736206054688 length of segment : 41 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0010771751403808594 length of segment : 15 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.0008437633514404297 length of segment : 40 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005173683166503906 length of segment : 24 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0017020702362060547 length of segment : 47 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.0010166168212890625 length of segment : 41 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0009300708770751953 length of segment : 54 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002505779266357422 length of segment : 14 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00011110305786132812 length of segment : 8 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00013208389282226562 length of segment : 12 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00029277801513671875 length of segment : 16 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003268718719482422 length of segment : 24 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.000324249267578125 length of segment : 25 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00021123886108398438 length of segment : 17 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002281665802001953 length of segment : 15 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1474 time to create 1 rle with old method : 0.0019884109497070312 length of segment : 43 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010724067687988281 length of segment : 47 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.00039649009704589844 length of segment : 17 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003838539123535156 length of segment : 17 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 1520 time to create 1 rle with old method : 0.0018177032470703125 length of segment : 107 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00029921531677246094 length of segment : 14 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 21 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007154941558837891 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004489421844482422 length of segment : 28 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005388259887695312 length of segment : 30 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004496574401855469 length of segment : 29 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00035881996154785156 length of segment : 21 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 764 time to create 1 rle with old method : 0.0010614395141601562 length of segment : 36 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.00036644935607910156 length of segment : 15 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003502368927001953 length of segment : 16 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019311904907226562 length of segment : 12 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00040221214294433594 length of segment : 22 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009608268737792969 length of segment : 39 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.00045418739318847656 length of segment : 17 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006871223449707031 length of segment : 32 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.00044465065002441406 length of segment : 22 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0007262229919433594 length of segment : 34 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 583 time to create 1 rle with old method : 0.0008349418640136719 length of segment : 27 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00016164779663085938 length of segment : 10 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0010128021240234375 length of segment : 38 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.00045228004455566406 length of segment : 27 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 755 time to create 1 rle with old method : 0.0010325908660888672 length of segment : 43 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0007908344268798828 length of segment : 64 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008246898651123047 length of segment : 18 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003895759582519531 length of segment : 22 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002543926239013672 length of segment : 16 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2019 time to create 1 rle with old method : 0.0026035308837890625 length of segment : 72 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00019431114196777344 length of segment : 13 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004096031188964844 length of segment : 24 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 2120 time to create 1 rle with old method : 0.0027313232421875 length of segment : 81 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1948 time to create 1 rle with old method : 0.002287626266479492 length of segment : 78 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.0002040863037109375 length of segment : 34 time for calcul the mask position with numpy : 0.00044155120849609375 nb_pixel_total : 37542 time to create 1 rle with old method : 0.04494976997375488 length of segment : 230 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 56 time to create 1 rle with old method : 0.0001251697540283203 length of segment : 6 Detection mask done ! Trying to reset tf kernel 2001834 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4586 tf kernel not reseted sub process len(results) : 428 len(list_Values) 428 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 428 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 428 chid ids of type : 4228 Number RLEs to save : 19529 save missing photos in datou_result : time spend for datou_step_exec : 27.17578959465027 time spend to save output : 3.2453439235687256 total time spend for step 1 : 30.421133518218994 step2:brightness Sun Feb 2 01:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738455630_2001492_1333744566_8c27f86213052423b10031ba3886cb50.jpg treat image : temp/1738455630_2001492_1333744563_577be0d1c54dd139aaa13994e8e5500d.jpg treat image : temp/1738455630_2001492_1333744561_210c99d80d996a86016c1f05de9fe3f8.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.01723337173461914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.019253253936767578 save missing photos in datou_result : time spend for datou_step_exec : 0.8509485721588135 time spend to save output : 0.04087662696838379 total time spend for step 2 : 0.8918251991271973 step3:blur_detection Sun Feb 2 01:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738455630_2001492_1333744566_8c27f86213052423b10031ba3886cb50.jpg resize: (1080, 1920) 1333744566 -7.948338908702945 treat image : temp/1738455630_2001492_1333744563_577be0d1c54dd139aaa13994e8e5500d.jpg resize: (1080, 1920) 1333744563 -7.969398131711898 treat image : temp/1738455630_2001492_1333744561_210c99d80d996a86016c1f05de9fe3f8.jpg resize: (1080, 1920) 1333744561 -7.903808384800115 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.012492179870605469 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.01897263526916504 save missing photos in datou_result : time spend for datou_step_exec : 3.0530924797058105 time spend to save output : 0.036947011947631836 total time spend for step 3 : 3.0900394916534424 step4:rle_unique_nms_with_priority Sun Feb 2 01:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 428 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 143 nb_hashtags : 7 time to prepare the origin masks : 1.101860523223877 time for calcul the mask position with numpy : 0.06635761260986328 nb_pixel_total : 1774314 time to create 1 rle with new method : 0.09354567527770996 time for calcul the mask position with numpy : 0.008583545684814453 nb_pixel_total : 3650 time to create 1 rle with old method : 0.00406193733215332 time for calcul the mask position with numpy : 0.008458852767944336 nb_pixel_total : 1630 time to create 1 rle with old method : 0.0018017292022705078 time for calcul the mask position with numpy : 0.008435726165771484 nb_pixel_total : 39 time to create 1 rle with old method : 0.00014138221740722656 time for calcul the mask position with numpy : 0.008476972579956055 nb_pixel_total : 81 time to create 1 rle with old method : 0.0001418590545654297 time for calcul the mask position with numpy : 0.008404731750488281 nb_pixel_total : 58 time to create 1 rle with old method : 8.749961853027344e-05 time for calcul the mask position with numpy : 0.008429527282714844 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.008508443832397461 nb_pixel_total : 956 time to create 1 rle with old method : 0.0011279582977294922 time for calcul the mask position with numpy : 0.008512496948242188 nb_pixel_total : 1329 time to create 1 rle with old method : 0.0014948844909667969 time for calcul the mask position with numpy : 0.00850534439086914 nb_pixel_total : 1603 time to create 1 rle with old method : 0.001791238784790039 time for calcul the mask position with numpy : 0.008500099182128906 nb_pixel_total : 838 time to create 1 rle with old method : 0.0009756088256835938 time for calcul the mask position with numpy : 0.008519649505615234 nb_pixel_total : 412 time to create 1 rle with old method : 0.00045800209045410156 time for calcul the mask position with numpy : 0.008596181869506836 nb_pixel_total : 9 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.00850820541381836 nb_pixel_total : 3552 time to create 1 rle with old method : 0.003938913345336914 time for calcul the mask position with numpy : 0.008515357971191406 nb_pixel_total : 615 time to create 1 rle with old method : 0.0007781982421875 time for calcul the mask position with numpy : 0.00852656364440918 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002543926239013672 time for calcul the mask position with numpy : 0.008515357971191406 nb_pixel_total : 3468 time to create 1 rle with old method : 0.0038034915924072266 time for calcul the mask position with numpy : 0.008530855178833008 nb_pixel_total : 896 time to create 1 rle with old method : 0.0010271072387695312 time for calcul the mask position with numpy : 0.00851893424987793 nb_pixel_total : 238 time to create 1 rle with old method : 0.0002663135528564453 time for calcul the mask position with numpy : 0.008542776107788086 nb_pixel_total : 183 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.008483171463012695 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001761913299560547 time for calcul the mask position with numpy : 0.008486032485961914 nb_pixel_total : 919 time to create 1 rle with old method : 0.0010290145874023438 time for calcul the mask position with numpy : 0.00851130485534668 nb_pixel_total : 33 time to create 1 rle with old method : 5.364418029785156e-05 time for calcul the mask position with numpy : 0.008517742156982422 nb_pixel_total : 6372 time to create 1 rle with old method : 0.0069773197174072266 time for calcul the mask position with numpy : 0.008531332015991211 nb_pixel_total : 6623 time to create 1 rle with old method : 0.0072841644287109375 time for calcul the mask position with numpy : 0.008483648300170898 nb_pixel_total : 112 time to create 1 rle with old method : 0.00013637542724609375 time for calcul the mask position with numpy : 0.008488893508911133 nb_pixel_total : 199 time to create 1 rle with old method : 0.00022912025451660156 time for calcul the mask position with numpy : 0.008451223373413086 nb_pixel_total : 2043 time to create 1 rle with old method : 0.0022292137145996094 time for calcul the mask position with numpy : 0.008474349975585938 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001659393310546875 time for calcul the mask position with numpy : 0.008495807647705078 nb_pixel_total : 507 time to create 1 rle with old method : 0.0005667209625244141 time for calcul the mask position with numpy : 0.00848245620727539 nb_pixel_total : 291 time to create 1 rle with old method : 0.00033974647521972656 time for calcul the mask position with numpy : 0.008476734161376953 nb_pixel_total : 1209 time to create 1 rle with old method : 0.001337289810180664 time for calcul the mask position with numpy : 0.008621454238891602 nb_pixel_total : 28042 time to create 1 rle with old method : 0.030478954315185547 time for calcul the mask position with numpy : 0.008505582809448242 nb_pixel_total : 793 time to create 1 rle with old method : 0.0008740425109863281 time for calcul the mask position with numpy : 0.008456230163574219 nb_pixel_total : 1283 time to create 1 rle with old method : 0.0013952255249023438 time for calcul the mask position with numpy : 0.008450031280517578 nb_pixel_total : 722 time to create 1 rle with old method : 0.0008244514465332031 time for calcul the mask position with numpy : 0.008484840393066406 nb_pixel_total : 403 time to create 1 rle with old method : 0.00045371055603027344 time for calcul the mask position with numpy : 0.008479833602905273 nb_pixel_total : 31 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.008452653884887695 nb_pixel_total : 169 time to create 1 rle with old method : 0.00019979476928710938 time for calcul the mask position with numpy : 0.008527755737304688 nb_pixel_total : 374 time to create 1 rle with old method : 0.00045990943908691406 time for calcul the mask position with numpy : 0.008459091186523438 nb_pixel_total : 514 time to create 1 rle with old method : 0.0005698204040527344 time for calcul the mask position with numpy : 0.008464336395263672 nb_pixel_total : 44 time to create 1 rle with old method : 7.796287536621094e-05 time for calcul the mask position with numpy : 0.008465766906738281 nb_pixel_total : 705 time to create 1 rle with old method : 0.0009038448333740234 time for calcul the mask position with numpy : 0.008459091186523438 nb_pixel_total : 578 time to create 1 rle with old method : 0.0006618499755859375 time for calcul the mask position with numpy : 0.008469104766845703 nb_pixel_total : 871 time to create 1 rle with old method : 0.0013108253479003906 time for calcul the mask position with numpy : 0.00849461555480957 nb_pixel_total : 873 time to create 1 rle with old method : 0.0009729862213134766 time for calcul the mask position with numpy : 0.008510589599609375 nb_pixel_total : 503 time to create 1 rle with old method : 0.0005784034729003906 time for calcul the mask position with numpy : 0.008482933044433594 nb_pixel_total : 705 time to create 1 rle with old method : 0.00078582763671875 time for calcul the mask position with numpy : 0.008498668670654297 nb_pixel_total : 12 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.00847315788269043 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0013341903686523438 time for calcul the mask position with numpy : 0.008457183837890625 nb_pixel_total : 408 time to create 1 rle with old method : 0.0004582405090332031 time for calcul the mask position with numpy : 0.008433103561401367 nb_pixel_total : 2771 time to create 1 rle with old method : 0.0030732154846191406 time for calcul the mask position with numpy : 0.008452177047729492 nb_pixel_total : 1762 time to create 1 rle with old method : 0.0019648075103759766 time for calcul the mask position with numpy : 0.008495569229125977 nb_pixel_total : 240 time to create 1 rle with old method : 0.0002765655517578125 time for calcul the mask position with numpy : 0.008482694625854492 nb_pixel_total : 28 time to create 1 rle with old method : 8.058547973632812e-05 time for calcul the mask position with numpy : 0.008455038070678711 nb_pixel_total : 1090 time to create 1 rle with old method : 0.0012848377227783203 time for calcul the mask position with numpy : 0.008465766906738281 nb_pixel_total : 911 time to create 1 rle with old method : 0.0010294914245605469 time for calcul the mask position with numpy : 0.008463382720947266 nb_pixel_total : 427 time to create 1 rle with old method : 0.0004832744598388672 time for calcul the mask position with numpy : 0.008487701416015625 nb_pixel_total : 21 time to create 1 rle with old method : 3.528594970703125e-05 time for calcul the mask position with numpy : 0.008500814437866211 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002613067626953125 time for calcul the mask position with numpy : 0.008486509323120117 nb_pixel_total : 2382 time to create 1 rle with old method : 0.002706289291381836 time for calcul the mask position with numpy : 0.008512496948242188 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001361370086669922 time for calcul the mask position with numpy : 0.008496522903442383 nb_pixel_total : 779 time to create 1 rle with old method : 0.0008966922760009766 time for calcul the mask position with numpy : 0.008484601974487305 nb_pixel_total : 336 time to create 1 rle with old method : 0.0003974437713623047 time for calcul the mask position with numpy : 0.008505821228027344 nb_pixel_total : 32 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.008497476577758789 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004165172576904297 time for calcul the mask position with numpy : 0.008472442626953125 nb_pixel_total : 1242 time to create 1 rle with old method : 0.0014328956604003906 time for calcul the mask position with numpy : 0.008473396301269531 nb_pixel_total : 1754 time to create 1 rle with old method : 0.0019316673278808594 time for calcul the mask position with numpy : 0.008489608764648438 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006136894226074219 time for calcul the mask position with numpy : 0.008489131927490234 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009088516235351562 time for calcul the mask position with numpy : 0.008462190628051758 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.008492708206176758 nb_pixel_total : 252 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.008491992950439453 nb_pixel_total : 2043 time to create 1 rle with old method : 0.0023279190063476562 time for calcul the mask position with numpy : 0.008491039276123047 nb_pixel_total : 1133 time to create 1 rle with old method : 0.0013494491577148438 time for calcul the mask position with numpy : 0.008463621139526367 nb_pixel_total : 1325 time to create 1 rle with old method : 0.0015594959259033203 time for calcul the mask position with numpy : 0.00844264030456543 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004405975341796875 time for calcul the mask position with numpy : 0.00846719741821289 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002238750457763672 time for calcul the mask position with numpy : 0.008474349975585938 nb_pixel_total : 370 time to create 1 rle with old method : 0.00042891502380371094 time for calcul the mask position with numpy : 0.009084463119506836 nb_pixel_total : 105281 time to create 1 rle with old method : 0.11283183097839355 time for calcul the mask position with numpy : 0.00858449935913086 nb_pixel_total : 895 time to create 1 rle with old method : 0.0010182857513427734 time for calcul the mask position with numpy : 0.008481264114379883 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002143383026123047 time for calcul the mask position with numpy : 0.008474349975585938 nb_pixel_total : 367 time to create 1 rle with old method : 0.0004153251647949219 time for calcul the mask position with numpy : 0.008458137512207031 nb_pixel_total : 444 time to create 1 rle with old method : 0.0004992485046386719 time for calcul the mask position with numpy : 0.008460044860839844 nb_pixel_total : 11 time to create 1 rle with old method : 3.7670135498046875e-05 time for calcul the mask position with numpy : 0.008610725402832031 nb_pixel_total : 30871 time to create 1 rle with old method : 0.03371620178222656 time for calcul the mask position with numpy : 0.008791685104370117 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.008725881576538086 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001933574676513672 time for calcul the mask position with numpy : 0.00873112678527832 nb_pixel_total : 1530 time to create 1 rle with old method : 0.001737356185913086 time for calcul the mask position with numpy : 0.008686542510986328 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002148151397705078 time for calcul the mask position with numpy : 0.008612871170043945 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003292560577392578 time for calcul the mask position with numpy : 0.00896453857421875 nb_pixel_total : 35161 time to create 1 rle with old method : 0.03972506523132324 time for calcul the mask position with numpy : 0.00871133804321289 nb_pixel_total : 58 time to create 1 rle with old method : 0.0001270771026611328 time for calcul the mask position with numpy : 0.011191368103027344 nb_pixel_total : 704 time to create 1 rle with old method : 0.0008814334869384766 time for calcul the mask position with numpy : 0.008665800094604492 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002720355987548828 time for calcul the mask position with numpy : 0.009189605712890625 nb_pixel_total : 498 time to create 1 rle with old method : 0.0008969306945800781 time for calcul the mask position with numpy : 0.01015019416809082 nb_pixel_total : 176 time to create 1 rle with old method : 0.0003235340118408203 time for calcul the mask position with numpy : 0.009900093078613281 nb_pixel_total : 150 time to create 1 rle with old method : 0.00026988983154296875 time for calcul the mask position with numpy : 0.010015249252319336 nb_pixel_total : 911 time to create 1 rle with old method : 0.0016140937805175781 time for calcul the mask position with numpy : 0.009992837905883789 nb_pixel_total : 191 time to create 1 rle with old method : 0.00035262107849121094 time for calcul the mask position with numpy : 0.009768486022949219 nb_pixel_total : 552 time to create 1 rle with old method : 0.0009853839874267578 time for calcul the mask position with numpy : 0.009882211685180664 nb_pixel_total : 20 time to create 1 rle with old method : 7.176399230957031e-05 time for calcul the mask position with numpy : 0.009831666946411133 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003113746643066406 time for calcul the mask position with numpy : 0.00884556770324707 nb_pixel_total : 196 time to create 1 rle with old method : 0.00023555755615234375 time for calcul the mask position with numpy : 0.008582592010498047 nb_pixel_total : 1729 time to create 1 rle with old method : 0.0020008087158203125 time for calcul the mask position with numpy : 0.008491277694702148 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005257129669189453 time for calcul the mask position with numpy : 0.008701801300048828 nb_pixel_total : 26 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.008448600769042969 nb_pixel_total : 62 time to create 1 rle with old method : 7.557868957519531e-05 time for calcul the mask position with numpy : 0.008454322814941406 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003495216369628906 time for calcul the mask position with numpy : 0.008860111236572266 nb_pixel_total : 725 time to create 1 rle with old method : 0.000911712646484375 time for calcul the mask position with numpy : 0.009093284606933594 nb_pixel_total : 65 time to create 1 rle with old method : 8.7738037109375e-05 time for calcul the mask position with numpy : 0.009189605712890625 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003268718719482422 time for calcul the mask position with numpy : 0.008939743041992188 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002789497375488281 time for calcul the mask position with numpy : 0.009502172470092773 nb_pixel_total : 402 time to create 1 rle with old method : 0.00047659873962402344 time for calcul the mask position with numpy : 0.009179115295410156 nb_pixel_total : 257 time to create 1 rle with old method : 0.00033402442932128906 time for calcul the mask position with numpy : 0.009077787399291992 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007288455963134766 time for calcul the mask position with numpy : 0.008707523345947266 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002961158752441406 time for calcul the mask position with numpy : 0.008728981018066406 nb_pixel_total : 624 time to create 1 rle with old method : 0.0007214546203613281 time for calcul the mask position with numpy : 0.008586645126342773 nb_pixel_total : 1316 time to create 1 rle with old method : 0.001453399658203125 time for calcul the mask position with numpy : 0.008497238159179688 nb_pixel_total : 1613 time to create 1 rle with old method : 0.0017781257629394531 time for calcul the mask position with numpy : 0.008524656295776367 nb_pixel_total : 717 time to create 1 rle with old method : 0.0008165836334228516 time for calcul the mask position with numpy : 0.008514881134033203 nb_pixel_total : 365 time to create 1 rle with old method : 0.00042438507080078125 time for calcul the mask position with numpy : 0.008538246154785156 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.008542060852050781 nb_pixel_total : 372 time to create 1 rle with old method : 0.00041961669921875 time for calcul the mask position with numpy : 0.008466958999633789 nb_pixel_total : 1694 time to create 1 rle with old method : 0.0018758773803710938 time for calcul the mask position with numpy : 0.008500337600708008 nb_pixel_total : 8 time to create 1 rle with old method : 2.6702880859375e-05 time for calcul the mask position with numpy : 0.008646726608276367 nb_pixel_total : 1947 time to create 1 rle with old method : 0.002514362335205078 time for calcul the mask position with numpy : 0.008654117584228516 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0014605522155761719 time for calcul the mask position with numpy : 0.008548736572265625 nb_pixel_total : 651 time to create 1 rle with old method : 0.0007197856903076172 time for calcul the mask position with numpy : 0.008482694625854492 nb_pixel_total : 692 time to create 1 rle with old method : 0.0007648468017578125 time for calcul the mask position with numpy : 0.008536815643310547 nb_pixel_total : 134 time to create 1 rle with old method : 0.00015306472778320312 time for calcul the mask position with numpy : 0.008533954620361328 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006046295166015625 time for calcul the mask position with numpy : 0.008533000946044922 nb_pixel_total : 1177 time to create 1 rle with old method : 0.0013053417205810547 time for calcul the mask position with numpy : 0.008496284484863281 nb_pixel_total : 86 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.008437156677246094 nb_pixel_total : 191 time to create 1 rle with old method : 0.00024247169494628906 time for calcul the mask position with numpy : 0.008493185043334961 nb_pixel_total : 73 time to create 1 rle with old method : 8.845329284667969e-05 time for calcul the mask position with numpy : 0.008788824081420898 nb_pixel_total : 911 time to create 1 rle with old method : 0.0010612010955810547 time for calcul the mask position with numpy : 0.008495092391967773 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002224445343017578 time for calcul the mask position with numpy : 0.008467912673950195 nb_pixel_total : 42 time to create 1 rle with old method : 7.009506225585938e-05 time for calcul the mask position with numpy : 0.008504867553710938 nb_pixel_total : 151 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.008468866348266602 nb_pixel_total : 121 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.00845789909362793 nb_pixel_total : 165 time to create 1 rle with old method : 0.000194549560546875 time for calcul the mask position with numpy : 0.00849461555480957 nb_pixel_total : 340 time to create 1 rle with old method : 0.0003986358642578125 time for calcul the mask position with numpy : 0.008563041687011719 nb_pixel_total : 743 time to create 1 rle with old method : 0.0008482933044433594 time for calcul the mask position with numpy : 0.009069204330444336 nb_pixel_total : 86 time to create 1 rle with old method : 0.00011992454528808594 create new chi : 1.7452716827392578 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0072956085205078125 batch 1 Loaded 144 chid ids of type : 4230 Number RLEs to save : 13107 TO DO : save crop sub photo not yet done ! save time : 3.7811334133148193 nb_obj : 144 nb_hashtags : 8 time to prepare the origin masks : 2.5006914138793945 time for calcul the mask position with numpy : 0.0813593864440918 nb_pixel_total : 1791616 time to create 1 rle with new method : 0.5469162464141846 time for calcul the mask position with numpy : 0.012574911117553711 nb_pixel_total : 997 time to create 1 rle with old method : 0.0012314319610595703 time for calcul the mask position with numpy : 0.013106107711791992 nb_pixel_total : 33 time to create 1 rle with old method : 0.00010895729064941406 time for calcul the mask position with numpy : 0.013120412826538086 nb_pixel_total : 26 time to create 1 rle with old method : 9.751319885253906e-05 time for calcul the mask position with numpy : 0.007930994033813477 nb_pixel_total : 84 time to create 1 rle with old method : 0.00014019012451171875 time for calcul the mask position with numpy : 0.007993221282958984 nb_pixel_total : 2070 time to create 1 rle with old method : 0.0023651123046875 time for calcul the mask position with numpy : 0.007749795913696289 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001621246337890625 time for calcul the mask position with numpy : 0.007860422134399414 nb_pixel_total : 1000 time to create 1 rle with old method : 0.0011382102966308594 time for calcul the mask position with numpy : 0.008592367172241211 nb_pixel_total : 943 time to create 1 rle with old method : 0.0010828971862792969 time for calcul the mask position with numpy : 0.008255481719970703 nb_pixel_total : 20 time to create 1 rle with old method : 9.751319885253906e-05 time for calcul the mask position with numpy : 0.007892370223999023 nb_pixel_total : 416 time to create 1 rle with old method : 0.0004918575286865234 time for calcul the mask position with numpy : 0.011048078536987305 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004220008850097656 time for calcul the mask position with numpy : 0.009569406509399414 nb_pixel_total : 69 time to create 1 rle with old method : 0.0001652240753173828 time for calcul the mask position with numpy : 0.009688138961791992 nb_pixel_total : 2491 time to create 1 rle with old method : 0.002788543701171875 time for calcul the mask position with numpy : 0.011926651000976562 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0016417503356933594 time for calcul the mask position with numpy : 0.011427879333496094 nb_pixel_total : 10 time to create 1 rle with old method : 4.5299530029296875e-05 time for calcul the mask position with numpy : 0.012159585952758789 nb_pixel_total : 1149 time to create 1 rle with old method : 0.0013208389282226562 time for calcul the mask position with numpy : 0.012156486511230469 nb_pixel_total : 1063 time to create 1 rle with old method : 0.001203298568725586 time for calcul the mask position with numpy : 0.011399984359741211 nb_pixel_total : 1487 time to create 1 rle with old method : 0.001813650131225586 time for calcul the mask position with numpy : 0.011826753616333008 nb_pixel_total : 102 time to create 1 rle with old method : 0.00015997886657714844 time for calcul the mask position with numpy : 0.011639118194580078 nb_pixel_total : 163 time to create 1 rle with old method : 0.00021028518676757812 time for calcul the mask position with numpy : 0.011287689208984375 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0011887550354003906 time for calcul the mask position with numpy : 0.011761665344238281 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002231597900390625 time for calcul the mask position with numpy : 0.012040853500366211 nb_pixel_total : 2125 time to create 1 rle with old method : 0.002384662628173828 time for calcul the mask position with numpy : 0.012215852737426758 nb_pixel_total : 663 time to create 1 rle with old method : 0.0007832050323486328 time for calcul the mask position with numpy : 0.01222085952758789 nb_pixel_total : 69 time to create 1 rle with old method : 0.00019311904907226562 time for calcul the mask position with numpy : 0.012225866317749023 nb_pixel_total : 2584 time to create 1 rle with old method : 0.0029859542846679688 time for calcul the mask position with numpy : 0.01233053207397461 nb_pixel_total : 2913 time to create 1 rle with old method : 0.003274202346801758 time for calcul the mask position with numpy : 0.01236104965209961 nb_pixel_total : 933 time to create 1 rle with old method : 0.0011494159698486328 time for calcul the mask position with numpy : 0.012499332427978516 nb_pixel_total : 6369 time to create 1 rle with old method : 0.006993532180786133 time for calcul the mask position with numpy : 0.012349367141723633 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004913806915283203 time for calcul the mask position with numpy : 0.012357711791992188 nb_pixel_total : 6840 time to create 1 rle with old method : 0.007746696472167969 time for calcul the mask position with numpy : 0.01235651969909668 nb_pixel_total : 132 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.011168241500854492 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001990795135498047 time for calcul the mask position with numpy : 0.007635354995727539 nb_pixel_total : 1325 time to create 1 rle with old method : 0.0014681816101074219 time for calcul the mask position with numpy : 0.007548809051513672 nb_pixel_total : 2308 time to create 1 rle with old method : 0.00257110595703125 time for calcul the mask position with numpy : 0.007610321044921875 nb_pixel_total : 13 time to create 1 rle with old method : 9.942054748535156e-05 time for calcul the mask position with numpy : 0.008803606033325195 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005626678466796875 time for calcul the mask position with numpy : 0.008765459060668945 nb_pixel_total : 478 time to create 1 rle with old method : 0.0006051063537597656 time for calcul the mask position with numpy : 0.007941722869873047 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0013396739959716797 time for calcul the mask position with numpy : 0.00782632827758789 nb_pixel_total : 895 time to create 1 rle with old method : 0.0010273456573486328 time for calcul the mask position with numpy : 0.007733821868896484 nb_pixel_total : 18674 time to create 1 rle with old method : 0.020394086837768555 time for calcul the mask position with numpy : 0.008121967315673828 nb_pixel_total : 112 time to create 1 rle with old method : 0.00016427040100097656 time for calcul the mask position with numpy : 0.008322477340698242 nb_pixel_total : 771 time to create 1 rle with old method : 0.0008676052093505859 time for calcul the mask position with numpy : 0.008408784866333008 nb_pixel_total : 28820 time to create 1 rle with old method : 0.03470611572265625 time for calcul the mask position with numpy : 0.006720066070556641 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0020678043365478516 time for calcul the mask position with numpy : 0.006678342819213867 nb_pixel_total : 742 time to create 1 rle with old method : 0.0012462139129638672 time for calcul the mask position with numpy : 0.00727391242980957 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005857944488525391 time for calcul the mask position with numpy : 0.00785684585571289 nb_pixel_total : 7 time to create 1 rle with old method : 6.079673767089844e-05 time for calcul the mask position with numpy : 0.007668018341064453 nb_pixel_total : 10780 time to create 1 rle with old method : 0.014916658401489258 time for calcul the mask position with numpy : 0.006501197814941406 nb_pixel_total : 387 time to create 1 rle with old method : 0.00044083595275878906 time for calcul the mask position with numpy : 0.006283998489379883 nb_pixel_total : 891 time to create 1 rle with old method : 0.0012164115905761719 time for calcul the mask position with numpy : 0.0076062679290771484 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003972053527832031 time for calcul the mask position with numpy : 0.007926702499389648 nb_pixel_total : 1041 time to create 1 rle with old method : 0.001506805419921875 time for calcul the mask position with numpy : 0.007807016372680664 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003371238708496094 time for calcul the mask position with numpy : 0.00784754753112793 nb_pixel_total : 773 time to create 1 rle with old method : 0.0011873245239257812 time for calcul the mask position with numpy : 0.00764012336730957 nb_pixel_total : 3418 time to create 1 rle with old method : 0.0047228336334228516 time for calcul the mask position with numpy : 0.0076067447662353516 nb_pixel_total : 2212 time to create 1 rle with old method : 0.003122568130493164 time for calcul the mask position with numpy : 0.007568359375 nb_pixel_total : 801 time to create 1 rle with old method : 0.0012009143829345703 time for calcul the mask position with numpy : 0.007961511611938477 nb_pixel_total : 70 time to create 1 rle with old method : 0.00013303756713867188 time for calcul the mask position with numpy : 0.007842540740966797 nb_pixel_total : 1836 time to create 1 rle with old method : 0.0025691986083984375 time for calcul the mask position with numpy : 0.007764101028442383 nb_pixel_total : 750 time to create 1 rle with old method : 0.001087188720703125 time for calcul the mask position with numpy : 0.007820367813110352 nb_pixel_total : 510 time to create 1 rle with old method : 0.0007097721099853516 time for calcul the mask position with numpy : 0.007712602615356445 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005991458892822266 time for calcul the mask position with numpy : 0.007454872131347656 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0020394325256347656 time for calcul the mask position with numpy : 0.007670402526855469 nb_pixel_total : 1905 time to create 1 rle with old method : 0.0025658607482910156 time for calcul the mask position with numpy : 0.007548809051513672 nb_pixel_total : 344 time to create 1 rle with old method : 0.0005755424499511719 time for calcul the mask position with numpy : 0.0079345703125 nb_pixel_total : 680 time to create 1 rle with old method : 0.0010838508605957031 time for calcul the mask position with numpy : 0.007708311080932617 nb_pixel_total : 833 time to create 1 rle with old method : 0.0010557174682617188 time for calcul the mask position with numpy : 0.0075871944427490234 nb_pixel_total : 17 time to create 1 rle with old method : 6.771087646484375e-05 time for calcul the mask position with numpy : 0.008189916610717773 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002894401550292969 time for calcul the mask position with numpy : 0.008131742477416992 nb_pixel_total : 125 time to create 1 rle with old method : 0.00024628639221191406 time for calcul the mask position with numpy : 0.008373022079467773 nb_pixel_total : 270 time to create 1 rle with old method : 0.00036835670471191406 time for calcul the mask position with numpy : 0.007734775543212891 nb_pixel_total : 1867 time to create 1 rle with old method : 0.0024688243865966797 time for calcul the mask position with numpy : 0.008137226104736328 nb_pixel_total : 307 time to create 1 rle with old method : 0.00047087669372558594 time for calcul the mask position with numpy : 0.008263111114501953 nb_pixel_total : 907 time to create 1 rle with old method : 0.001314401626586914 time for calcul the mask position with numpy : 0.008297920227050781 nb_pixel_total : 376 time to create 1 rle with old method : 0.0006315708160400391 time for calcul the mask position with numpy : 0.00790262222290039 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0019137859344482422 time for calcul the mask position with numpy : 0.00760650634765625 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003020763397216797 time for calcul the mask position with numpy : 0.0078122615814208984 nb_pixel_total : 459 time to create 1 rle with old method : 0.00067138671875 time for calcul the mask position with numpy : 0.007680654525756836 nb_pixel_total : 419 time to create 1 rle with old method : 0.0006053447723388672 time for calcul the mask position with numpy : 0.009024381637573242 nb_pixel_total : 105779 time to create 1 rle with old method : 0.1475846767425537 time for calcul the mask position with numpy : 0.007806062698364258 nb_pixel_total : 949 time to create 1 rle with old method : 0.0014147758483886719 time for calcul the mask position with numpy : 0.00796961784362793 nb_pixel_total : 1179 time to create 1 rle with old method : 0.0017240047454833984 time for calcul the mask position with numpy : 0.008066892623901367 nb_pixel_total : 120 time to create 1 rle with old method : 0.00022649765014648438 time for calcul the mask position with numpy : 0.007826089859008789 nb_pixel_total : 408 time to create 1 rle with old method : 0.0006728172302246094 time for calcul the mask position with numpy : 0.008104085922241211 nb_pixel_total : 2011 time to create 1 rle with old method : 0.002803325653076172 time for calcul the mask position with numpy : 0.007540464401245117 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004444122314453125 time for calcul the mask position with numpy : 0.007837533950805664 nb_pixel_total : 467 time to create 1 rle with old method : 0.0007181167602539062 time for calcul the mask position with numpy : 0.00782155990600586 nb_pixel_total : 190 time to create 1 rle with old method : 0.00028824806213378906 time for calcul the mask position with numpy : 0.007957935333251953 nb_pixel_total : 28 time to create 1 rle with old method : 9.465217590332031e-05 time for calcul the mask position with numpy : 0.007698774337768555 nb_pixel_total : 143 time to create 1 rle with old method : 0.00021648406982421875 time for calcul the mask position with numpy : 0.008085012435913086 nb_pixel_total : 14623 time to create 1 rle with old method : 0.01965641975402832 time for calcul the mask position with numpy : 0.0076177120208740234 nb_pixel_total : 1416 time to create 1 rle with old method : 0.0019729137420654297 time for calcul the mask position with numpy : 0.0076999664306640625 nb_pixel_total : 171 time to create 1 rle with old method : 0.00028777122497558594 time for calcul the mask position with numpy : 0.008194446563720703 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003848075866699219 time for calcul the mask position with numpy : 0.008254528045654297 nb_pixel_total : 43 time to create 1 rle with old method : 0.00010824203491210938 time for calcul the mask position with numpy : 0.008074760437011719 nb_pixel_total : 921 time to create 1 rle with old method : 0.0010471343994140625 time for calcul the mask position with numpy : 0.00675201416015625 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002474784851074219 time for calcul the mask position with numpy : 0.0066568851470947266 nb_pixel_total : 177 time to create 1 rle with old method : 0.00022721290588378906 time for calcul the mask position with numpy : 0.006633758544921875 nb_pixel_total : 135 time to create 1 rle with old method : 0.00017714500427246094 time for calcul the mask position with numpy : 0.006519317626953125 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005059242248535156 time for calcul the mask position with numpy : 0.006257057189941406 nb_pixel_total : 1176 time to create 1 rle with old method : 0.0013403892517089844 time for calcul the mask position with numpy : 0.007209300994873047 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005741119384765625 time for calcul the mask position with numpy : 0.007082700729370117 nb_pixel_total : 234 time to create 1 rle with old method : 0.00028014183044433594 time for calcul the mask position with numpy : 0.006944894790649414 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002353191375732422 time for calcul the mask position with numpy : 0.006841897964477539 nb_pixel_total : 151 time to create 1 rle with old method : 0.0001881122589111328 time for calcul the mask position with numpy : 0.006104707717895508 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005433559417724609 time for calcul the mask position with numpy : 0.006451606750488281 nb_pixel_total : 341 time to create 1 rle with old method : 0.0003952980041503906 time for calcul the mask position with numpy : 0.0065381526947021484 nb_pixel_total : 802 time to create 1 rle with old method : 0.0008463859558105469 time for calcul the mask position with numpy : 0.005850076675415039 nb_pixel_total : 47 time to create 1 rle with old method : 7.486343383789062e-05 time for calcul the mask position with numpy : 0.006011962890625 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002818107604980469 time for calcul the mask position with numpy : 0.006130695343017578 nb_pixel_total : 237 time to create 1 rle with old method : 0.000286102294921875 time for calcul the mask position with numpy : 0.005774021148681641 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005233287811279297 time for calcul the mask position with numpy : 0.0060307979583740234 nb_pixel_total : 365 time to create 1 rle with old method : 0.00039505958557128906 time for calcul the mask position with numpy : 0.005959987640380859 nb_pixel_total : 601 time to create 1 rle with old method : 0.000705718994140625 time for calcul the mask position with numpy : 0.005930423736572266 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002608299255371094 time for calcul the mask position with numpy : 0.0061147212982177734 nb_pixel_total : 203 time to create 1 rle with old method : 0.000232696533203125 time for calcul the mask position with numpy : 0.006443023681640625 nb_pixel_total : 754 time to create 1 rle with old method : 0.0008535385131835938 time for calcul the mask position with numpy : 0.00619816780090332 nb_pixel_total : 279 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.006512880325317383 nb_pixel_total : 1601 time to create 1 rle with old method : 0.0017876625061035156 time for calcul the mask position with numpy : 0.006370067596435547 nb_pixel_total : 1112 time to create 1 rle with old method : 0.0013134479522705078 time for calcul the mask position with numpy : 0.00656437873840332 nb_pixel_total : 18 time to create 1 rle with old method : 5.888938903808594e-05 time for calcul the mask position with numpy : 0.006558656692504883 nb_pixel_total : 769 time to create 1 rle with old method : 0.0008971691131591797 time for calcul the mask position with numpy : 0.006430149078369141 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004379749298095703 time for calcul the mask position with numpy : 0.006204366683959961 nb_pixel_total : 4 time to create 1 rle with old method : 4.4345855712890625e-05 time for calcul the mask position with numpy : 0.006119966506958008 nb_pixel_total : 308 time to create 1 rle with old method : 0.00036334991455078125 time for calcul the mask position with numpy : 0.006265878677368164 nb_pixel_total : 345 time to create 1 rle with old method : 0.0003952980041503906 time for calcul the mask position with numpy : 0.006470918655395508 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004703998565673828 time for calcul the mask position with numpy : 0.006261110305786133 nb_pixel_total : 1762 time to create 1 rle with old method : 0.001967906951904297 time for calcul the mask position with numpy : 0.006121635437011719 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0016455650329589844 time for calcul the mask position with numpy : 0.006032228469848633 nb_pixel_total : 1376 time to create 1 rle with old method : 0.0015420913696289062 time for calcul the mask position with numpy : 0.006061553955078125 nb_pixel_total : 33 time to create 1 rle with old method : 8.893013000488281e-05 time for calcul the mask position with numpy : 0.006005525588989258 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003695487976074219 time for calcul the mask position with numpy : 0.0062253475189208984 nb_pixel_total : 564 time to create 1 rle with old method : 0.0006461143493652344 time for calcul the mask position with numpy : 0.00622105598449707 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006144046783447266 time for calcul the mask position with numpy : 0.006157398223876953 nb_pixel_total : 74 time to create 1 rle with old method : 0.00010085105895996094 time for calcul the mask position with numpy : 0.006142854690551758 nb_pixel_total : 1 time to create 1 rle with old method : 2.47955322265625e-05 time for calcul the mask position with numpy : 0.006414890289306641 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001289844512939453 time for calcul the mask position with numpy : 0.0063364505767822266 nb_pixel_total : 576 time to create 1 rle with old method : 0.0006952285766601562 time for calcul the mask position with numpy : 0.006152153015136719 nb_pixel_total : 108 time to create 1 rle with old method : 0.00014352798461914062 time for calcul the mask position with numpy : 0.006224155426025391 nb_pixel_total : 198 time to create 1 rle with old method : 0.00024127960205078125 time for calcul the mask position with numpy : 0.006421804428100586 nb_pixel_total : 167 time to create 1 rle with old method : 0.00021791458129882812 time for calcul the mask position with numpy : 0.008486032485961914 nb_pixel_total : 712 time to create 1 rle with old method : 0.0007979869842529297 time for calcul the mask position with numpy : 0.008452177047729492 nb_pixel_total : 157 time to create 1 rle with old method : 0.000179290771484375 create new chi : 2.179649591445923 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0017414093017578125 batch 1 Loaded 145 chid ids of type : 4230 Number RLEs to save : 13974 TO DO : save crop sub photo not yet done ! save time : 2.2140586376190186 nb_obj : 135 nb_hashtags : 7 time to prepare the origin masks : 1.2933986186981201 time for calcul the mask position with numpy : 0.023662328720092773 nb_pixel_total : 1825056 time to create 1 rle with new method : 0.035753488540649414 time for calcul the mask position with numpy : 0.0065195560455322266 nb_pixel_total : 1192 time to create 1 rle with old method : 0.001374959945678711 time for calcul the mask position with numpy : 0.006304740905761719 nb_pixel_total : 1402 time to create 1 rle with old method : 0.0016200542449951172 time for calcul the mask position with numpy : 0.0064334869384765625 nb_pixel_total : 52 time to create 1 rle with old method : 0.00012421607971191406 time for calcul the mask position with numpy : 0.006375789642333984 nb_pixel_total : 486 time to create 1 rle with old method : 0.0005648136138916016 time for calcul the mask position with numpy : 0.0063152313232421875 nb_pixel_total : 59 time to create 1 rle with old method : 9.417533874511719e-05 time for calcul the mask position with numpy : 0.006173610687255859 nb_pixel_total : 145 time to create 1 rle with old method : 0.00018453598022460938 time for calcul the mask position with numpy : 0.006420135498046875 nb_pixel_total : 882 time to create 1 rle with old method : 0.001016378402709961 time for calcul the mask position with numpy : 0.0062448978424072266 nb_pixel_total : 660 time to create 1 rle with old method : 0.0007789134979248047 time for calcul the mask position with numpy : 0.006190061569213867 nb_pixel_total : 69 time to create 1 rle with old method : 0.00012159347534179688 time for calcul the mask position with numpy : 0.006156444549560547 nb_pixel_total : 3 time to create 1 rle with old method : 2.6226043701171875e-05 time for calcul the mask position with numpy : 0.006208896636962891 nb_pixel_total : 39 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.006220340728759766 nb_pixel_total : 2455 time to create 1 rle with old method : 0.0027968883514404297 time for calcul the mask position with numpy : 0.006085395812988281 nb_pixel_total : 20 time to create 1 rle with old method : 6.604194641113281e-05 time for calcul the mask position with numpy : 0.006349325180053711 nb_pixel_total : 1259 time to create 1 rle with old method : 0.0014455318450927734 time for calcul the mask position with numpy : 0.006391286849975586 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0012199878692626953 time for calcul the mask position with numpy : 0.006407737731933594 nb_pixel_total : 771 time to create 1 rle with old method : 0.0008804798126220703 time for calcul the mask position with numpy : 0.006369829177856445 nb_pixel_total : 222 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.006269693374633789 nb_pixel_total : 80 time to create 1 rle with old method : 0.00010967254638671875 time for calcul the mask position with numpy : 0.006172895431518555 nb_pixel_total : 1025 time to create 1 rle with old method : 0.001142740249633789 time for calcul the mask position with numpy : 0.006148338317871094 nb_pixel_total : 171 time to create 1 rle with old method : 0.00020885467529296875 time for calcul the mask position with numpy : 0.006181240081787109 nb_pixel_total : 74 time to create 1 rle with old method : 0.00012636184692382812 time for calcul the mask position with numpy : 0.006209373474121094 nb_pixel_total : 6373 time to create 1 rle with old method : 0.0069768428802490234 time for calcul the mask position with numpy : 0.006182670593261719 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003428459167480469 time for calcul the mask position with numpy : 0.0061953067779541016 nb_pixel_total : 5991 time to create 1 rle with old method : 0.006630897521972656 time for calcul the mask position with numpy : 0.006708621978759766 nb_pixel_total : 1204 time to create 1 rle with old method : 0.0014247894287109375 time for calcul the mask position with numpy : 0.006621837615966797 nb_pixel_total : 609 time to create 1 rle with old method : 0.0007002353668212891 time for calcul the mask position with numpy : 0.006425619125366211 nb_pixel_total : 2022 time to create 1 rle with old method : 0.0022552013397216797 time for calcul the mask position with numpy : 0.006614208221435547 nb_pixel_total : 145 time to create 1 rle with old method : 0.00019288063049316406 time for calcul the mask position with numpy : 0.00655674934387207 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004220008850097656 time for calcul the mask position with numpy : 0.006652355194091797 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005700588226318359 time for calcul the mask position with numpy : 0.007541656494140625 nb_pixel_total : 76 time to create 1 rle with old method : 0.0001366138458251953 time for calcul the mask position with numpy : 0.010254621505737305 nb_pixel_total : 1242 time to create 1 rle with old method : 0.001383066177368164 time for calcul the mask position with numpy : 0.010340452194213867 nb_pixel_total : 18452 time to create 1 rle with old method : 0.020061969757080078 time for calcul the mask position with numpy : 0.010288238525390625 nb_pixel_total : 751 time to create 1 rle with old method : 0.0008645057678222656 time for calcul the mask position with numpy : 0.01019906997680664 nb_pixel_total : 835 time to create 1 rle with old method : 0.0009343624114990234 time for calcul the mask position with numpy : 0.0102386474609375 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0014302730560302734 time for calcul the mask position with numpy : 0.010363578796386719 nb_pixel_total : 399 time to create 1 rle with old method : 0.00047016143798828125 time for calcul the mask position with numpy : 0.010283708572387695 nb_pixel_total : 747 time to create 1 rle with old method : 0.0008699893951416016 time for calcul the mask position with numpy : 0.010221481323242188 nb_pixel_total : 28 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.010215044021606445 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004210472106933594 time for calcul the mask position with numpy : 0.010169744491577148 nb_pixel_total : 28 time to create 1 rle with old method : 7.152557373046875e-05 time for calcul the mask position with numpy : 0.01005864143371582 nb_pixel_total : 393 time to create 1 rle with old method : 0.0004515647888183594 time for calcul the mask position with numpy : 0.006014108657836914 nb_pixel_total : 875 time to create 1 rle with old method : 0.001020669937133789 time for calcul the mask position with numpy : 0.006184101104736328 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001308917999267578 time for calcul the mask position with numpy : 0.006235837936401367 nb_pixel_total : 114 time to create 1 rle with old method : 0.00018143653869628906 time for calcul the mask position with numpy : 0.006247282028198242 nb_pixel_total : 694 time to create 1 rle with old method : 0.0007965564727783203 time for calcul the mask position with numpy : 0.006277322769165039 nb_pixel_total : 509 time to create 1 rle with old method : 0.0005784034729003906 time for calcul the mask position with numpy : 0.006191253662109375 nb_pixel_total : 4089 time to create 1 rle with old method : 0.0044782161712646484 time for calcul the mask position with numpy : 0.006183624267578125 nb_pixel_total : 1778 time to create 1 rle with old method : 0.001962423324584961 time for calcul the mask position with numpy : 0.00622248649597168 nb_pixel_total : 728 time to create 1 rle with old method : 0.0008523464202880859 time for calcul the mask position with numpy : 0.0062046051025390625 nb_pixel_total : 22 time to create 1 rle with old method : 4.482269287109375e-05 time for calcul the mask position with numpy : 0.006205558776855469 nb_pixel_total : 1240 time to create 1 rle with old method : 0.0013666152954101562 time for calcul the mask position with numpy : 0.006209135055541992 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002129077911376953 time for calcul the mask position with numpy : 0.00626373291015625 nb_pixel_total : 680 time to create 1 rle with old method : 0.0007715225219726562 time for calcul the mask position with numpy : 0.006177663803100586 nb_pixel_total : 405 time to create 1 rle with old method : 0.00046634674072265625 time for calcul the mask position with numpy : 0.006211996078491211 nb_pixel_total : 927 time to create 1 rle with old method : 0.0010731220245361328 time for calcul the mask position with numpy : 0.006229400634765625 nb_pixel_total : 1814 time to create 1 rle with old method : 0.0020716190338134766 time for calcul the mask position with numpy : 0.006200313568115234 nb_pixel_total : 338 time to create 1 rle with old method : 0.00040221214294433594 time for calcul the mask position with numpy : 0.0061566829681396484 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007333755493164062 time for calcul the mask position with numpy : 0.006190061569213867 nb_pixel_total : 816 time to create 1 rle with old method : 0.0009181499481201172 time for calcul the mask position with numpy : 0.00620269775390625 nb_pixel_total : 43 time to create 1 rle with old method : 9.465217590332031e-05 time for calcul the mask position with numpy : 0.006162881851196289 nb_pixel_total : 116 time to create 1 rle with old method : 0.00015282630920410156 time for calcul the mask position with numpy : 0.006181955337524414 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003609657287597656 time for calcul the mask position with numpy : 0.0061800479888916016 nb_pixel_total : 1907 time to create 1 rle with old method : 0.0021228790283203125 time for calcul the mask position with numpy : 0.0062220096588134766 nb_pixel_total : 911 time to create 1 rle with old method : 0.0010662078857421875 time for calcul the mask position with numpy : 0.006615877151489258 nb_pixel_total : 679 time to create 1 rle with old method : 0.0008542537689208984 time for calcul the mask position with numpy : 0.006615877151489258 nb_pixel_total : 1978 time to create 1 rle with old method : 0.0022830963134765625 time for calcul the mask position with numpy : 0.00624847412109375 nb_pixel_total : 212 time to create 1 rle with old method : 0.00026869773864746094 time for calcul the mask position with numpy : 0.00616908073425293 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006518363952636719 time for calcul the mask position with numpy : 0.006322145462036133 nb_pixel_total : 68 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.006318569183349609 nb_pixel_total : 208 time to create 1 rle with old method : 0.000263214111328125 time for calcul the mask position with numpy : 0.0070343017578125 nb_pixel_total : 106151 time to create 1 rle with old method : 0.1149594783782959 time for calcul the mask position with numpy : 0.006320953369140625 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007522106170654297 time for calcul the mask position with numpy : 0.006170511245727539 nb_pixel_total : 132 time to create 1 rle with old method : 0.00019812583923339844 time for calcul the mask position with numpy : 0.006132841110229492 nb_pixel_total : 115 time to create 1 rle with old method : 0.00015592575073242188 time for calcul the mask position with numpy : 0.006161928176879883 nb_pixel_total : 56 time to create 1 rle with old method : 8.96453857421875e-05 time for calcul the mask position with numpy : 0.006178855895996094 nb_pixel_total : 2019 time to create 1 rle with old method : 0.0023086071014404297 time for calcul the mask position with numpy : 0.006148338317871094 nb_pixel_total : 124 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.006426095962524414 nb_pixel_total : 211 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.006007671356201172 nb_pixel_total : 121 time to create 1 rle with old method : 0.00015616416931152344 time for calcul the mask position with numpy : 0.005991697311401367 nb_pixel_total : 145 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.006277322769165039 nb_pixel_total : 37542 time to create 1 rle with old method : 0.0408782958984375 time for calcul the mask position with numpy : 0.006356716156005859 nb_pixel_total : 23 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.00617671012878418 nb_pixel_total : 32 time to create 1 rle with old method : 7.843971252441406e-05 time for calcul the mask position with numpy : 0.00617527961730957 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003218650817871094 time for calcul the mask position with numpy : 0.006207704544067383 nb_pixel_total : 583 time to create 1 rle with old method : 0.0007312297821044922 time for calcul the mask position with numpy : 0.0062139034271240234 nb_pixel_total : 241 time to create 1 rle with old method : 0.00031280517578125 time for calcul the mask position with numpy : 0.006208658218383789 nb_pixel_total : 1314 time to create 1 rle with old method : 0.0016105175018310547 time for calcul the mask position with numpy : 0.006226301193237305 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005779266357421875 time for calcul the mask position with numpy : 0.0061838626861572266 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002276897430419922 time for calcul the mask position with numpy : 0.006174564361572266 nb_pixel_total : 157 time to create 1 rle with old method : 0.00020170211791992188 time for calcul the mask position with numpy : 0.0061986446380615234 nb_pixel_total : 803 time to create 1 rle with old method : 0.000904083251953125 time for calcul the mask position with numpy : 0.00621342658996582 nb_pixel_total : 810 time to create 1 rle with old method : 0.0009119510650634766 time for calcul the mask position with numpy : 0.00617218017578125 nb_pixel_total : 289 time to create 1 rle with old method : 0.00033283233642578125 time for calcul the mask position with numpy : 0.0061991214752197266 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.006246089935302734 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002009868621826172 time for calcul the mask position with numpy : 0.006396055221557617 nb_pixel_total : 1520 time to create 1 rle with old method : 0.0017518997192382812 time for calcul the mask position with numpy : 0.006294727325439453 nb_pixel_total : 424 time to create 1 rle with old method : 0.0004913806915283203 time for calcul the mask position with numpy : 0.00635981559753418 nb_pixel_total : 316 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.0063762664794921875 nb_pixel_total : 21 time to create 1 rle with old method : 4.839897155761719e-05 time for calcul the mask position with numpy : 0.0064239501953125 nb_pixel_total : 755 time to create 1 rle with old method : 0.0008831024169921875 time for calcul the mask position with numpy : 0.006215333938598633 nb_pixel_total : 58 time to create 1 rle with old method : 8.893013000488281e-05 time for calcul the mask position with numpy : 0.006295442581176758 nb_pixel_total : 234 time to create 1 rle with old method : 0.00028586387634277344 time for calcul the mask position with numpy : 0.006269931793212891 nb_pixel_total : 412 time to create 1 rle with old method : 0.0004897117614746094 time for calcul the mask position with numpy : 0.006309032440185547 nb_pixel_total : 248 time to create 1 rle with old method : 0.00030875205993652344 time for calcul the mask position with numpy : 0.006238222122192383 nb_pixel_total : 600 time to create 1 rle with old method : 0.0007109642028808594 time for calcul the mask position with numpy : 0.0067098140716552734 nb_pixel_total : 230 time to create 1 rle with old method : 0.0005371570587158203 time for calcul the mask position with numpy : 0.006901264190673828 nb_pixel_total : 771 time to create 1 rle with old method : 0.0009205341339111328 time for calcul the mask position with numpy : 0.0069348812103271484 nb_pixel_total : 153 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.006346225738525391 nb_pixel_total : 274 time to create 1 rle with old method : 0.00032639503479003906 time for calcul the mask position with numpy : 0.0064122676849365234 nb_pixel_total : 1474 time to create 1 rle with old method : 0.0016791820526123047 time for calcul the mask position with numpy : 0.006616830825805664 nb_pixel_total : 1549 time to create 1 rle with old method : 0.0017254352569580078 time for calcul the mask position with numpy : 0.006552457809448242 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007190704345703125 time for calcul the mask position with numpy : 0.006498575210571289 nb_pixel_total : 34 time to create 1 rle with old method : 6.890296936035156e-05 time for calcul the mask position with numpy : 0.006462574005126953 nb_pixel_total : 283 time to create 1 rle with old method : 0.000331878662109375 time for calcul the mask position with numpy : 0.006587982177734375 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.006577491760253906 nb_pixel_total : 253 time to create 1 rle with old method : 0.00031256675720214844 time for calcul the mask position with numpy : 0.006713151931762695 nb_pixel_total : 318 time to create 1 rle with old method : 0.00037479400634765625 time for calcul the mask position with numpy : 0.006594181060791016 nb_pixel_total : 1676 time to create 1 rle with old method : 0.0018992424011230469 time for calcul the mask position with numpy : 0.006646633148193359 nb_pixel_total : 529 time to create 1 rle with old method : 0.0006349086761474609 time for calcul the mask position with numpy : 0.0066721439361572266 nb_pixel_total : 629 time to create 1 rle with old method : 0.000728607177734375 time for calcul the mask position with numpy : 0.006627082824707031 nb_pixel_total : 145 time to create 1 rle with old method : 0.00018668174743652344 time for calcul the mask position with numpy : 0.00655674934387207 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008127689361572266 time for calcul the mask position with numpy : 0.006613492965698242 nb_pixel_total : 33 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.006365537643432617 nb_pixel_total : 43 time to create 1 rle with old method : 8.893013000488281e-05 time for calcul the mask position with numpy : 0.0064928531646728516 nb_pixel_total : 493 time to create 1 rle with old method : 0.0005638599395751953 time for calcul the mask position with numpy : 0.006299495697021484 nb_pixel_total : 77 time to create 1 rle with old method : 0.00017070770263671875 time for calcul the mask position with numpy : 0.006444454193115234 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0014638900756835938 time for calcul the mask position with numpy : 0.006277561187744141 nb_pixel_total : 84 time to create 1 rle with old method : 0.00012111663818359375 time for calcul the mask position with numpy : 0.00632786750793457 nb_pixel_total : 263 time to create 1 rle with old method : 0.00031876564025878906 time for calcul the mask position with numpy : 0.00629878044128418 nb_pixel_total : 95 time to create 1 rle with old method : 0.00013136863708496094 time for calcul the mask position with numpy : 0.006262779235839844 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004286766052246094 time for calcul the mask position with numpy : 0.006368160247802734 nb_pixel_total : 178 time to create 1 rle with old method : 0.00022482872009277344 time for calcul the mask position with numpy : 0.006325483322143555 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007398128509521484 time for calcul the mask position with numpy : 0.0063550472259521484 nb_pixel_total : 723 time to create 1 rle with old method : 0.0008029937744140625 create new chi : 1.2429602146148682 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001558542251586914 batch 1 Loaded 136 chid ids of type : 4230 Number RLEs to save : 11319 TO DO : save crop sub photo not yet done ! save time : 1.889327049255371 map_output_result : {1333744566: (0.0, 'Should be the crop_list due to order', 0.0), 1333744563: (0.0, 'Should be the crop_list due to order', 0.0), 1333744561: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333744566, 1333744563, 1333744561] Looping around the photos to save general results len do output : 3 /1333744566.Didn't retrieve data . /1333744563.Didn't retrieve data . /1333744561.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744566', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744563', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744561', None, None, None, None, None, '2537758') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013771772384643555 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.705688953399658 time spend to save output : 0.014066457748413086 total time spend for step 4 : 18.71975541114807 step5:crop_condition Sun Feb 2 01:21:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 425 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 164 About to insert : list_path_to_insert length 164 new photo from crops ! About to upload 164 photos upload in portfolio : 4869462 init cache_photo without model_param we have 164 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738455688_2001492 we have uploaded 164 photos in the portfolio 4869462 time of upload the photos Elapsed time : 35.897583961486816 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 4869462 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738455725_2001492 we have uploaded 54 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.949148893356323 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738455738_2001492 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8974082469940186 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738455739_2001492 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.2204489707946777 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 61 About to insert : list_path_to_insert length 61 new photo from crops ! About to upload 61 photos upload in portfolio : 4869462 init cache_photo without model_param we have 61 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738455742_2001492 we have uploaded 61 photos in the portfolio 4869462 time of upload the photos Elapsed time : 13.98197889328003 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4869462 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738455756_2001492 we have uploaded 6 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.020979166030884 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333744566, 1333744563, 1333744561] Looping around the photos to save general results len do output : 298 /1333803686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333803988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744566', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744563', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744561', None, None, None, None, None, '2537758') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 897 time used for this insertion : 0.27451539039611816 save_final save missing photos in datou_result : time spend for datou_step_exec : 75.16282033920288 time spend to save output : 0.2822275161743164 total time spend for step 5 : 75.4450478553772 step6:thcl Sun Feb 2 01:22:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.014556169509887695 time to convert the images to numpy array : 0.06591033935546875 time to import caffe and check if the image exist : 0.017941713333129883 time to convert the images to numpy array : 0.06326627731323242 time to import caffe and check if the image exist : 0.015806913375854492 time to convert the images to numpy array : 0.06888413429260254 time to import caffe and check if the image exist : 0.019994258880615234 time to convert the images to numpy array : 0.06794214248657227 time to import caffe and check if the image exist : 0.022406339645385742 time to convert the images to numpy array : 0.06751227378845215 time to import caffe and check if the image exist : 0.014441728591918945 time to convert the images to numpy array : 0.07722997665405273 time to import caffe and check if the image exist : 0.03160738945007324 time to convert the images to numpy array : 0.06180405616760254 time to import caffe and check if the image exist : 0.026136398315429688 time to convert the images to numpy array : 0.06875205039978027 time to import caffe and check if the image exist : 0.020069122314453125 time to convert the images to numpy array : 0.07420992851257324 time to import caffe and check if the image exist : 0.022721290588378906 time to convert the images to numpy array : 0.07458353042602539 total time to convert the images to numpy array : 0.30719828605651855 list photo_ids error: [] list photo_ids correct : [1333803746, 1333803747, 1333803748, 1333803749, 1333803750, 1333803751, 1333803752, 1333803753, 1333803754, 1333803755, 1333803756, 1333803757, 1333803758, 1333803759, 1333803760, 1333803761, 1333803762, 1333803763, 1333803764, 1333803765, 1333803766, 1333803767, 1333803768, 1333803769, 1333803770, 1333803771, 1333803772, 1333803773, 1333803774, 1333803775, 1333803806, 1333803807, 1333803808, 1333803809, 1333803810, 1333803811, 1333803812, 1333803813, 1333803814, 1333803815, 1333803816, 1333803817, 1333803818, 1333803819, 1333803820, 1333803821, 1333803822, 1333803823, 1333803824, 1333803825, 1333803826, 1333803827, 1333803828, 1333803829, 1333803830, 1333803831, 1333803832, 1333803833, 1333803834, 1333803835, 1333803686, 1333803687, 1333803688, 1333803689, 1333803690, 1333803691, 1333803692, 1333803693, 1333803694, 1333803695, 1333803696, 1333803697, 1333803698, 1333803699, 1333803700, 1333803701, 1333803702, 1333803703, 1333803704, 1333803705, 1333803706, 1333803707, 1333803708, 1333803709, 1333803710, 1333803711, 1333803712, 1333803713, 1333803714, 1333803715, 1333803929, 1333803930, 1333803931, 1333803932, 1333803933, 1333803934, 1333803935, 1333803936, 1333803937, 1333803938, 1333803939, 1333803940, 1333803941, 1333803942, 1333803943, 1333803944, 1333803945, 1333803946, 1333803947, 1333803949, 1333803950, 1333803951, 1333803952, 1333803953, 1333803954, 1333803955, 1333803956, 1333803957, 1333803958, 1333803959, 1333803776, 1333803777, 1333803778, 1333803779, 1333803780, 1333803781, 1333803782, 1333803783, 1333803784, 1333803785, 1333803786, 1333803787, 1333803788, 1333803789, 1333803790, 1333803791, 1333803792, 1333803793, 1333803794, 1333803795, 1333803796, 1333803797, 1333803798, 1333803799, 1333803800, 1333803801, 1333803802, 1333803803, 1333803804, 1333803805, 1333803866, 1333803867, 1333803868, 1333803869, 1333803870, 1333803871, 1333803872, 1333803873, 1333803874, 1333803875, 1333803876, 1333803877, 1333803878, 1333803879, 1333803880, 1333803881, 1333803882, 1333803883, 1333803884, 1333803885, 1333803886, 1333803887, 1333803888, 1333803889, 1333803890, 1333803891, 1333803892, 1333803893, 1333803894, 1333803895, 1333803960, 1333803961, 1333803962, 1333803963, 1333803964, 1333803965, 1333803966, 1333803967, 1333803968, 1333803969, 1333803970, 1333803971, 1333803972, 1333803973, 1333803974, 1333803975, 1333803976, 1333803977, 1333803978, 1333803979, 1333803980, 1333803981, 1333803983, 1333803984, 1333803985, 1333803986, 1333803987, 1333803988, 1333803836, 1333803837, 1333803838, 1333803839, 1333803840, 1333803841, 1333803842, 1333803843, 1333803844, 1333803845, 1333803846, 1333803847, 1333803848, 1333803849, 1333803850, 1333803851, 1333803852, 1333803853, 1333803854, 1333803855, 1333803856, 1333803857, 1333803858, 1333803859, 1333803860, 1333803861, 1333803862, 1333803863, 1333803864, 1333803865, 1333803896, 1333803897, 1333803898, 1333803899, 1333803900, 1333803901, 1333803902, 1333803903, 1333803904, 1333803905, 1333803906, 1333803907, 1333803908, 1333803909, 1333803910, 1333803911, 1333803912, 1333803913, 1333803914, 1333803915, 1333803916, 1333803920, 1333803921, 1333803922, 1333803923, 1333803924, 1333803925, 1333803926, 1333803927, 1333803928, 1333803716, 1333803717, 1333803718, 1333803719, 1333803720, 1333803721, 1333803722, 1333803723, 1333803724, 1333803725, 1333803726, 1333803727, 1333803728, 1333803729, 1333803730, 1333803731, 1333803732, 1333803733, 1333803734, 1333803735, 1333803736, 1333803737, 1333803738, 1333803739, 1333803740, 1333803741, 1333803742, 1333803743, 1333803744, 1333803745] number of photos to traite : 298 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10334 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.3004636764526367 time used to do the prediction : 1.0352749824523926 save descriptor for thcl : 3237 time to traite the descriptors : 1.705808162689209 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333803746 To insert : 1333803747 To insert : 1333803748 To insert : 1333803749 To insert : 1333803750 To insert : 1333803751 To insert : 1333803752 To insert : 1333803753 To insert : 1333803754 To insert : 1333803755 To insert : 1333803756 To insert : 1333803757 To insert : 1333803758 To insert : 1333803759 To insert : 1333803760 To insert : 1333803761 To insert : 1333803762 To insert : 1333803763 To insert : 1333803764 To insert : 1333803765 To insert : 1333803766 To insert : 1333803767 To insert : 1333803768 To insert : 1333803769 To insert : 1333803770 To insert : 1333803771 To insert : 1333803772 To insert : 1333803773 To insert : 1333803774 To insert : 1333803775 To insert : 1333803806 To insert : 1333803807 To insert : 1333803808 To insert : 1333803809 To insert : 1333803810 To insert : 1333803811 To insert : 1333803812 To insert : 1333803813 To insert : 1333803814 To insert : 1333803815 To insert : 1333803816 To insert : 1333803817 To insert : 1333803818 To insert : 1333803819 To insert : 1333803820 To insert : 1333803821 To insert : 1333803822 To insert : 1333803823 To insert : 1333803824 To insert : 1333803825 To insert : 1333803826 To insert : 1333803827 To insert : 1333803828 To insert : 1333803829 To insert : 1333803830 To insert : 1333803831 To insert : 1333803832 To insert : 1333803833 To insert : 1333803834 To insert : 1333803835 To insert : 1333803686 To insert : 1333803687 To insert : 1333803688 To insert : 1333803689 To insert : 1333803690 To insert : 1333803691 To insert : 1333803692 To insert : 1333803693 To insert : 1333803694 To insert : 1333803695 To insert : 1333803696 To insert : 1333803697 To insert : 1333803698 To insert : 1333803699 To insert : 1333803700 To insert : 1333803701 To insert : 1333803702 To insert : 1333803703 To insert : 1333803704 To insert : 1333803705 To insert : 1333803706 To insert : 1333803707 To insert : 1333803708 To insert : 1333803709 To insert : 1333803710 To insert : 1333803711 To insert : 1333803712 To insert : 1333803713 To insert : 1333803714 To insert : 1333803715 To insert : 1333803929 To insert : 1333803930 To insert : 1333803931 To insert : 1333803932 To insert : 1333803933 To insert : 1333803934 To insert : 1333803935 To insert : 1333803936 To insert : 1333803937 To insert : 1333803938 To insert : 1333803939 To insert : 1333803940 To insert : 1333803941 To insert : 1333803942 To insert : 1333803943 To insert : 1333803944 To insert : 1333803945 To insert : 1333803946 To insert : 1333803947 To insert : 1333803949 To insert : 1333803950 To insert : 1333803951 To insert : 1333803952 To insert : 1333803953 To insert : 1333803954 To insert : 1333803955 To insert : 1333803956 To insert : 1333803957 To insert : 1333803958 To insert : 1333803959 To insert : 1333803776 To insert : 1333803777 To insert : 1333803778 To insert : 1333803779 To insert : 1333803780 To insert : 1333803781 To insert : 1333803782 To insert : 1333803783 To insert : 1333803784 To insert : 1333803785 To insert : 1333803786 To insert : 1333803787 To insert : 1333803788 To insert : 1333803789 To insert : 1333803790 To insert : 1333803791 To insert : 1333803792 To insert : 1333803793 To insert : 1333803794 To insert : 1333803795 To insert : 1333803796 To insert : 1333803797 To insert : 1333803798 To insert : 1333803799 To insert : 1333803800 To insert : 1333803801 To insert : 1333803802 To insert : 1333803803 To insert : 1333803804 To insert : 1333803805 To insert : 1333803866 To insert : 1333803867 To insert : 1333803868 To insert : 1333803869 To insert : 1333803870 To insert : 1333803871 To insert : 1333803872 To insert : 1333803873 To insert : 1333803874 To insert : 1333803875 To insert : 1333803876 To insert : 1333803877 To insert : 1333803878 To insert : 1333803879 To insert : 1333803880 To insert : 1333803881 To insert : 1333803882 To insert : 1333803883 To insert : 1333803884 To insert : 1333803885 To insert : 1333803886 To insert : 1333803887 To insert : 1333803888 To insert : 1333803889 To insert : 1333803890 To insert : 1333803891 To insert : 1333803892 To insert : 1333803893 To insert : 1333803894 To insert : 1333803895 To insert : 1333803960 To insert : 1333803961 To insert : 1333803962 To insert : 1333803963 To insert : 1333803964 To insert : 1333803965 To insert : 1333803966 To insert : 1333803967 To insert : 1333803968 To insert : 1333803969 To insert : 1333803970 To insert : 1333803971 To insert : 1333803972 To insert : 1333803973 To insert : 1333803974 To insert : 1333803975 To insert : 1333803976 To insert : 1333803977 To insert : 1333803978 To insert : 1333803979 To insert : 1333803980 To insert : 1333803981 To insert : 1333803983 To insert : 1333803984 To insert : 1333803985 To insert : 1333803986 To insert : 1333803987 To insert : 1333803988 To insert : 1333803836 To insert : 1333803837 To insert : 1333803838 To insert : 1333803839 To insert : 1333803840 To insert : 1333803841 To insert : 1333803842 To insert : 1333803843 To insert : 1333803844 To insert : 1333803845 To insert : 1333803846 To insert : 1333803847 To insert : 1333803848 To insert : 1333803849 To insert : 1333803850 To insert : 1333803851 To insert : 1333803852 To insert : 1333803853 To insert : 1333803854 To insert : 1333803855 To insert : 1333803856 To insert : 1333803857 To insert : 1333803858 To insert : 1333803859 To insert : 1333803860 To insert : 1333803861 To insert : 1333803862 To insert : 1333803863 To insert : 1333803864 To insert : 1333803865 To insert : 1333803896 To insert : 1333803897 To insert : 1333803898 To insert : 1333803899 To insert : 1333803900 To insert : 1333803901 To insert : 1333803902 To insert : 1333803903 To insert : 1333803904 To insert : 1333803905 To insert : 1333803906 To insert : 1333803907 To insert : 1333803908 To insert : 1333803909 To insert : 1333803910 To insert : 1333803911 To insert : 1333803912 To insert : 1333803913 To insert : 1333803914 To insert : 1333803915 To insert : 1333803916 To insert : 1333803920 To insert : 1333803921 To insert : 1333803922 To insert : 1333803923 To insert : 1333803924 To insert : 1333803925 To insert : 1333803926 To insert : 1333803927 To insert : 1333803928 To insert : 1333803716 To insert : 1333803717 To insert : 1333803718 To insert : 1333803719 To insert : 1333803720 To insert : 1333803721 To insert : 1333803722 To insert : 1333803723 To insert : 1333803724 To insert : 1333803725 To insert : 1333803726 To insert : 1333803727 To insert : 1333803728 To insert : 1333803729 To insert : 1333803730 To insert : 1333803731 To insert : 1333803732 To insert : 1333803733 To insert : 1333803734 To insert : 1333803735 To insert : 1333803736 To insert : 1333803737 To insert : 1333803738 To insert : 1333803739 To insert : 1333803740 To insert : 1333803741 To insert : 1333803742 To insert : 1333803743 To insert : 1333803744 To insert : 1333803745 time to insert the descriptors : 50.79602313041687 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 467 time used for this insertion : 3.536437749862671 save missing photos in datou_result : time spend for datou_step_exec : 58.99794888496399 time spend to save output : 3.588253974914551 total time spend for step 6 : 62.58620285987854 step7:ventilate_hashtags_in_portfolio Sun Feb 2 01:23:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20143393 get user id for portfolio 20143393 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143393 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','PEHD','pehd','pet_fonce','mal_croppe','Film_plastique','Carton','PET_clair','autre','pet_clair','flou','Papier','Tetrapak','refus','carton','metal','environnement','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143393 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','PEHD','pehd','pet_fonce','mal_croppe','Film_plastique','Carton','PET_clair','autre','pet_clair','flou','Papier','Tetrapak','refus','carton','metal','environnement','PET_fonce')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143393 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','PEHD','pehd','pet_fonce','mal_croppe','Film_plastique','Carton','PET_clair','autre','pet_clair','flou','Papier','Tetrapak','refus','carton','metal','environnement','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143393 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','PEHD','pehd','pet_fonce','mal_croppe','Film_plastique','Carton','PET_clair','autre','pet_clair','flou','Papier','Tetrapak','refus','carton','metal','environnement','PET_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20147698,20147689,20147704,20147691,20147692,20147701,20147696,20147695,20147697,20147699,20147700,20147702,20147703?tags=papier,pehd,pet_fonce,mal_croppe,film_plastique,carton,pet_clair,autre,flou,tetrapak,refus,metal,environnement&datou_id_consolidate=4235&port_consolidate=20143393 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333744566, 1333744563, 1333744561] Looping around the photos to save general results len do output : 1 /20143393. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744566', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744563', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744561', None, None, None, None, None, '2537758') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013634920120239258 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.114286184310913 time spend to save output : 0.013885736465454102 total time spend for step 7 : 3.128171920776367 step8:final Sun Feb 2 01:23:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333744566: ('0.21754588602381794',), 1333744563: ('0.21754588602381794',), 1333744561: ('0.21754588602381794',)} new output for save of step final : {1333744566: ('0.21754588602381794',), 1333744563: ('0.21754588602381794',), 1333744561: ('0.21754588602381794',)} [1333744566, 1333744563, 1333744561] Looping around the photos to save general results len do output : 3 /1333744566.Didn't retrieve data . /1333744563.Didn't retrieve data . /1333744561.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744566', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744563', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744561', None, None, None, None, None, '2537758') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012607812881469727 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13813543319702148 time spend to save output : 0.012871265411376953 total time spend for step 8 : 0.15100669860839844 step9:velours_tree Sun Feb 2 01:23:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20147698,20147689,20147704,20147691,20147692,20147701,20147696,20147695,20147697,20147699,20147700,20147702,20147703 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147698 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147689 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147704 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147691 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147692 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147701 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147696 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147695 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147697 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147699 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147700 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147702 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20147703 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 298 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 4 4 3 5 4 1 2 1 1 1 1 1 4 2 4 2 1 1 4 0 2 2 1 2 0 1 2 0 2 2 2 1 2 2 0 2 1 2 2 5 0 0 0 0 4 4 1 1 2 1 0 3 0 4 4 4 4 1 4 2 1 1 1 1 4 0 2 2 1 2 2 2 2 1 1 2 1 1 0 2 3 1 1 1 2 2 2 0 2 2 1 2 0 5 0 0 0 4 4 4 1 1 1 1 4 4 2 1 0 0 4 4 5 2 2 1 2 1 2 1 4 4 4 2 2 1 1 2 4 2 2 1 3 2 2 1 2 2 1 1 3 1 2 0 2 2 1 2 0 5 0 0 0 0 1 4 3 1 4 4 2 1 1 1 2 1 3 2 0 1 4 1 4 3 5 5 3 3 3 0 5 1 2 2 1 4 1 3 2 4 1 2 3 5 5 0 3 3 4 1 3 2 1 2 3 2 1 1 4 1 2 5 5 3 1 3 4 2 4 4 1 1 1 3 4 0 0 2 0 0 1 3 3 0 3 2 2 1 1 2 1 2 0 4 1 1 1 1 1 1 1 1 1 0 3 0 0 1 3 1 1 1 1 4 1 2 1 1 0 1 1 1 1 0 3 0 0 1 1 1 2 0 1 1 1 1 1 1 1 1 1 2 0 4 2 0 0] Elapsed time: 0.057885169982910156 graph_id used : 75174 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20147698,20147689,20147704,20147691,20147692,20147701,20147696,20147695,20147697,20147699,20147700,20147702,20147703?tags=papier,pehd,pet_fonce,mal_croppe,film_plastique,carton,pet_clair,autre,flou,tetrapak,refus,metal,environnement&datou_id_consolidate=4235&port_consolidate=20143393&tree_id=75174 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1333744566, 1333744563, 1333744561] Looping around the photos to save general results len do output : 1 /20143393Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744566', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744563', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744561', None, None, None, None, None, '2537758') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012341737747192383 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.083911895751953 time spend to save output : 0.012677669525146484 total time spend for step 9 : 23.0965895652771 step10:send_mail_cod Sun Feb 2 01:24:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20143393_02-02-2025_01_24_08.pdf 20147680 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201476801738455848 20147671 imagette201476711738455849 20147686 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201476861738455849 20147673 imagette201476731738455850 20147674 imagette201476741738455850 20147683 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201476831738455850 20147678 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201476781738455851 20147677 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201476771738455851 20147679 imagette201476791738455852 20147681 imagette201476811738455852 20147682 imagette201476821738455852 20147684 change filename to text .change filename to text .change filename to text .imagette201476841738455852 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20143393 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20147698,20147689,20147704,20147691,20147692,20147701,20147696,20147695,20147697,20147699,20147700,20147702,20147703?tags=papier,pehd,pet_fonce,mal_croppe,film_plastique,carton,pet_clair,autre,flou,tetrapak,refus,metal,environnement&datou_id_consolidate=4235&port_consolidate=20143393&tree_id=75174 your option no_mail is active, we will not send the real mail to your client args[1333744566] : ((1333744566, -7.948338908702945, 492609224), (1333744566, -0.5657240116965587, 501862349), '0.21754588602381794') We are sending mail with results at cod@fotonower.com args[1333744563] : ((1333744563, -7.969398131711898, 492609224), (1333744563, -0.5846237276791372, 501862349), '0.21754588602381794') We are sending mail with results at cod@fotonower.com args[1333744561] : ((1333744561, -7.903808384800115, 492609224), (1333744561, -0.6370656934646651, 501862349), '0.21754588602381794') We are sending mail with results at cod@fotonower.com refus_total : 0.21754588602381794 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20143393 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143393_02-02-2025_01_24_08.pdf results_Qualipapia_P20143393_02-02-2025_01_24_08.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143393_02-02-2025_01_24_08.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20143393','results_Qualipapia_P20143393_02-02-2025_01_24_08.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143393_02-02-2025_01_24_08.pdf','pdf','','0.16','0.21754588602381794') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333744566, 1333744563, 1333744561] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744566', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744563', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744561', None, None, None, None, None, '2537758') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012079715728759766 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.214864730834961 time spend to save output : 0.012288808822631836 total time spend for step 10 : 5.227153539657593 step11:split_time_score Sun Feb 2 01:24:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01022025 20143393 Nombre de photos uploadées : 3 / 23040 (0%) 01022025 20143393 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 01022025 20143393 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0013580322265625e-05 ??? elapsed_time : fill_and_build_computed_from_old_data 0.0002949237823486328 elapsed_time : insert_dashboard_record_day_entry 0.02268671989440918 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140596 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140597 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140598 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140599 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140600 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140601 order by id desc limit 1 Qualite : 0.2309767904458083 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140602_01-02-2025_13_40_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140602 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140602 AND mptpi.`type`=4230 To do Qualite : 0.22262298814595152 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140603_01-02-2025_13_36_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140603 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140603 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140832 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140833 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140834 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140835 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140836 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140837 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140838 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140839 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140840 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140841 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140842 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140843 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140844 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140845 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140846 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140847 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140848 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140849 order by id desc limit 1 Qualite : 0.20057559398632832 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140850_01-02-2025_14_10_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140850 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140850 AND mptpi.`type`=4230 To do Qualite : 0.18431451539642255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140851_01-02-2025_13_35_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140851 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140851 AND mptpi.`type`=4230 To do Qualite : 0.19593863158258523 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140852_01-02-2025_13_53_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140852 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140852 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141296 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141297 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141298 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141299 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141300 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141301 order by id desc limit 1 Qualite : 0.20015635039197005 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20141302_01-02-2025_14_32_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20141302 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141657 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141658 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141659 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141660 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141661 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141662 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141663 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141664 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141665 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141666 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141667 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141668 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141669 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141670 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141671 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141672 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141673 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141674 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141675 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141676 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141677 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141678 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141679 order by id desc limit 1 Qualite : 0.20827029105652828 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20141680_01-02-2025_15_08_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20141680 AND mptpi.`type`=4230 To do Qualite : 0.1946503779440649 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20141681_01-02-2025_14_44_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141681 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20141681 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142049 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142050 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142051 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142052 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142053 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142054 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142055 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142056 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142057 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142059 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142060 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142061 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142062 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142063 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142064 order by id desc limit 1 Qualite : 0.12794507052083104 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142065_01-02-2025_15_33_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142065 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142065 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142066 order by id desc limit 1 Qualite : 0.19287199063881355 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142067_01-02-2025_15_18_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142067 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142067 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142451 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142452 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142453 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142454 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142456 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142459 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142460 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142461 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142463 order by id desc limit 1 Qualite : 0.18838141105926856 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142464_01-02-2025_16_02_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142464 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142465 order by id desc limit 1 Qualite : 0.22140410901851382 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142466_01-02-2025_15_47_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142466 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142466 AND mptpi.`type`=4230 To do Qualite : 0.24002910245386597 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142467_01-02-2025_15_40_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142467 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142784 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142785 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142786 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142787 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142788 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142789 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142790 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142791 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142792 order by id desc limit 1 Qualite : 0.3079498429232401 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142793_01-02-2025_16_32_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142793 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142793 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142794 order by id desc limit 1 Qualite : 0.19429584143844753 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142795_01-02-2025_16_12_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142795 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142795 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143051 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143052 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143053 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143054 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143055 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143056 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143057 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143059 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143060 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143061 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143062 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143063 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143064 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143065 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143066 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143067 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143068 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143069 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143070 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143071 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143072 order by id desc limit 1 Qualite : 0.2019070967415384 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143073_01-02-2025_17_06_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143073 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143073 AND mptpi.`type`=4230 To do Qualite : 0.22595934725209532 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143074_01-02-2025_16_46_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143074 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143074 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143392 order by id desc limit 1 Qualite : 0.21754588602381794 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143393_02-02-2025_01_24_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143393 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143393 AND mptpi.`type`=4230 To do Qualite : 0.21234640013372694 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143394_02-02-2025_01_19_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143394 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143394 AND mptpi.`type`=4230 To do Qualite : 0.2241883759369228 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143395_02-02-2025_01_13_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143395 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143395 AND mptpi.`type`=4230 To do Qualite : 0.18911166152937461 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143396_02-02-2025_01_18_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143396 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143396 AND mptpi.`type`=4230 To do Qualite : 0.22908369260792946 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143397_02-02-2025_01_10_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143397 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143397 AND mptpi.`type`=4230 To do Qualite : 0.24748735072220263 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143398_02-02-2025_00_48_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143398 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143398 AND mptpi.`type`=4230 To do Qualite : 0.22493603228981354 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143399_02-02-2025_00_51_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143399 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143399 AND mptpi.`type`=4230 To do Qualite : 0.2123594297463442 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143400_02-02-2025_00_26_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143400 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143400 AND mptpi.`type`=4230 To do Qualite : 0.23773003210460292 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143401_02-02-2025_00_36_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143401 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143401 AND mptpi.`type`=4230 To do Qualite : 0.19589407559342725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143402_02-02-2025_00_43_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143402 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143402 AND mptpi.`type`=4230 To do Qualite : 0.23912616429849357 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143403_01-02-2025_17_33_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143403 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143403 AND mptpi.`type`=4230 To do Qualite : 0.1577519910625768 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143404_02-02-2025_00_22_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143404 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143404 AND mptpi.`type`=4230 To do Qualite : 0.2207605871752271 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143405_01-02-2025_17_10_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143405 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143405 AND mptpi.`type`=4230 To do Qualite : 0.24201156311766062 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143406_02-02-2025_00_20_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143406 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143406 AND mptpi.`type`=4230 To do Qualite : 0.2229691740437331 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143407_01-02-2025_17_18_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143407 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143407 AND mptpi.`type`=4230 To do Qualite : 0.17650354446203959 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143697_02-02-2025_00_02_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143697 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143697 AND mptpi.`type`=4230 To do Qualite : 0.21763101160618378 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143698_02-02-2025_00_18_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143698 AND mptpi.`type`=4230 To do Qualite : 0.19052941299814394 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143699_02-02-2025_00_52_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143699 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143699 AND mptpi.`type`=4230 To do Qualite : 0.15882925471293888 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143700_01-02-2025_23_32_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143700 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143700 AND mptpi.`type`=4230 To do Qualite : 0.18823025090519305 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143701_01-02-2025_23_23_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143701 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143701 AND mptpi.`type`=4230 To do Qualite : 0.17047876068216075 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143702_01-02-2025_23_03_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143702 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143702 AND mptpi.`type`=4230 To do Qualite : 0.18245111557588073 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143703_01-02-2025_23_18_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143703 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143703 AND mptpi.`type`=4230 To do Qualite : 0.18774053907858673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143704_01-02-2025_22_50_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143704 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143704 AND mptpi.`type`=4230 To do Qualite : 0.15493693639357684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143705_01-02-2025_22_32_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143705 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143705 AND mptpi.`type`=4230 To do Qualite : 0.17164032830018458 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143706_01-02-2025_22_23_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143706 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143706 AND mptpi.`type`=4230 To do Qualite : 0.21933634728906984 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143707_01-02-2025_22_02_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143707 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143707 AND mptpi.`type`=4230 To do Qualite : 0.20870299665535397 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143708_01-02-2025_22_18_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143708 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143708 AND mptpi.`type`=4230 To do Qualite : 0.25487635338573167 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143709_01-02-2025_21_33_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143709 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143709 AND mptpi.`type`=4230 To do Qualite : 0.17867897210450695 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143710_01-02-2025_21_24_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143710 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143710 AND mptpi.`type`=4230 To do Qualite : 0.2182336426240116 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143711_01-02-2025_21_17_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143711 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143711 AND mptpi.`type`=4230 To do Qualite : 0.19745974180902578 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143712_01-02-2025_17_47_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143712 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143712 AND mptpi.`type`=4230 To do Qualite : 0.20609688696404269 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143713_01-02-2025_18_07_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143713 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143713 AND mptpi.`type`=4230 To do Qualite : 0.19161308851166237 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143823_01-02-2025_18_35_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143823 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143823 AND mptpi.`type`=4230 To do Qualite : 0.2021491591470001 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143824_01-02-2025_18_22_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143824 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143824 AND mptpi.`type`=4230 To do Qualite : 0.18827936840275175 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143825_01-02-2025_18_16_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143825 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143825 AND mptpi.`type`=4230 To do Qualite : 0.18073680563575475 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143827_01-02-2025_18_11_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143827 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143827 AND mptpi.`type`=4230 To do Qualite : 0.21566884413230683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143998_01-02-2025_21_11_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143998 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143998 AND mptpi.`type`=4230 To do Qualite : 0.25073997956960914 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143999_01-02-2025_21_02_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143999 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143999 AND mptpi.`type`=4230 To do Qualite : 0.17868500217225253 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144000_01-02-2025_20_49_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144000 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144000 AND mptpi.`type`=4230 To do Qualite : 0.27197285969087953 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144001_01-02-2025_19_04_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144001 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144001 AND mptpi.`type`=4230 To do Qualite : 0.234989921319678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144002_01-02-2025_18_34_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144002 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144002 AND mptpi.`type`=4230 To do Qualite : 0.24472504887661223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144003_01-02-2025_18_48_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144003 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144003 AND mptpi.`type`=4230 To do Qualite : 0.28064692200837627 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144248_01-02-2025_20_32_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144248 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144248 AND mptpi.`type`=4230 To do Qualite : 0.2637815041517808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144249_01-02-2025_20_23_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144249 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144249 AND mptpi.`type`=4230 To do Qualite : 0.24990893233711398 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144250_01-02-2025_20_17_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144250 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144250 AND mptpi.`type`=4230 To do Qualite : 0.23174536092969744 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144251_01-02-2025_20_09_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144251 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144251 AND mptpi.`type`=4230 To do Qualite : 0.24151962499125448 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144252_01-02-2025_19_34_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144252 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144252 AND mptpi.`type`=4230 To do Qualite : 0.26733816956912815 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144253_01-02-2025_19_47_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144253 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144253 AND mptpi.`type`=4230 To do Qualite : 0.24786170423316092 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144254_01-02-2025_21_48_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144254 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144254 AND mptpi.`type`=4230 To do Qualite : 0.2766817181650381 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144255_01-02-2025_19_17_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144255 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144255 AND mptpi.`type`=4230 To do Qualite : 0.2669048612297551 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144256_01-02-2025_19_11_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144256 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144256 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01022025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333744566, 1333744563, 1333744561] Looping around the photos to save general results len do output : 1 /20143393Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744566', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744563', None, None, None, None, None, '2537758') ('4234', None, None, None, None, None, None, None, '2537758') ('4234', '20143393', '1333744561', None, None, None, None, None, '2537758') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013146638870239258 save_final save missing photos in datou_result : time spend for datou_step_exec : 99.24917984008789 time spend to save output : 0.013374567031860352 total time spend for step 11 : 99.26255440711975 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 45.88user 30.22system 5:27.47elapsed 23%CPU (0avgtext+0avgdata 2835104maxresident)k 1063680inputs+19968outputs (3366major+2708545minor)pagefaults 0swaps