python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2902661 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2609734'] with mtr_portfolio_ids : ['20771591'] and first list_photo_ids : [] new path : /proc/2902661/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.3972017765045166 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Feb 25 01:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-25 01:20:32.791981: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-25 01:20:32.819326: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-25 01:20:32.820922: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3748000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-25 01:20:32.820942: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-25 01:20:32.823928: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-25 01:20:33.000664: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x37fe1f30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-25 01:20:33.000724: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-25 01:20:33.001982: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-25 01:20:33.002437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-25 01:20:33.005641: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-25 01:20:33.024826: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-25 01:20:33.025277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-25 01:20:33.038170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-25 01:20:33.043785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-25 01:20:33.076335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-25 01:20:33.078740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-25 01:20:33.079193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-25 01:20:33.080182: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-25 01:20:33.080203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-25 01:20:33.080215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-25 01:20:33.082371: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-25 01:20:33.429359: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-25 01:20:33.429510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-25 01:20:33.429531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-25 01:20:33.429547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-25 01:20:33.429563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-25 01:20:33.429578: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-25 01:20:33.429596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-25 01:20:33.429615: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-25 01:20:33.430994: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-25 01:20:33.432411: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-25 01:20:33.432465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-25 01:20:33.432481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-25 01:20:33.432495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-25 01:20:33.432509: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-25 01:20:33.432526: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-25 01:20:33.432545: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-25 01:20:33.432562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-25 01:20:33.433910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-25 01:20:33.433952: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-25 01:20:33.433961: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-25 01:20:33.433969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-25 01:20:33.435411: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-25 01:20:44.385363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-25 01:20:44.631137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.05938 max: 149.93984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00012731552124023438 nb_pixel_total : 1035 time to create 1 rle with old method : 0.005984067916870117 length of segment : 43 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.000270843505859375 length of segment : 29 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 97 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 30 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 12 time to create 1 rle with old method : 0.0001010894775390625 length of segment : 1 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.0002551078796386719 length of segment : 8 time for calcul the mask position with numpy : 0.00014472007751464844 nb_pixel_total : 923 time to create 1 rle with old method : 0.0014972686767578125 length of segment : 67 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.12578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.000476837158203125 length of segment : 43 time for calcul the mask position with numpy : 0.00014925003051757812 nb_pixel_total : 1498 time to create 1 rle with old method : 0.0030274391174316406 length of segment : 62 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 822 time to create 1 rle with old method : 0.0011851787567138672 length of segment : 37 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00021767616271972656 length of segment : 13 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1256 time to create 1 rle with old method : 0.001695871353149414 length of segment : 85 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 4660 time to create 1 rle with old method : 0.006291389465332031 length of segment : 87 time for calcul the mask position with numpy : 0.00012755393981933594 nb_pixel_total : 3806 time to create 1 rle with old method : 0.005052328109741211 length of segment : 102 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 17 time to create 1 rle with old method : 7.033348083496094e-05 length of segment : 4 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1254 time to create 1 rle with old method : 0.0016760826110839844 length of segment : 85 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.27031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 5767 time to create 1 rle with old method : 0.007207632064819336 length of segment : 140 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007393360137939453 length of segment : 38 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 2358 time to create 1 rle with old method : 0.003290414810180664 length of segment : 41 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0007276535034179688 length of segment : 38 time for calcul the mask position with numpy : 0.00010919570922851562 nb_pixel_total : 3103 time to create 1 rle with old method : 0.00400853157043457 length of segment : 80 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.33281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.0001499652862548828 nb_pixel_total : 7118 time to create 1 rle with old method : 0.008568286895751953 length of segment : 144 time for calcul the mask position with numpy : 0.0001418590545654297 nb_pixel_total : 1049 time to create 1 rle with old method : 0.0013437271118164062 length of segment : 58 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00017905235290527344 length of segment : 15 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00030517578125 length of segment : 18 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 19 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00014734268188476562 length of segment : 15 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 2413 time to create 1 rle with old method : 0.0032236576080322266 length of segment : 62 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 247.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.76406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00027108192443847656 length of segment : 15 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.0007407665252685547 length of segment : 20 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0007479190826416016 length of segment : 20 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 958 time to create 1 rle with old method : 0.0013232231140136719 length of segment : 38 time for calcul the mask position with numpy : 0.0005905628204345703 nb_pixel_total : 52054 time to create 1 rle with old method : 0.0710141658782959 length of segment : 278 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -95.82109 max: 65.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.27422 max: 149.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00033164024353027344 length of segment : 22 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00018024444580078125 length of segment : 10 time for calcul the mask position with numpy : 0.0001926422119140625 nb_pixel_total : 5709 time to create 1 rle with old method : 0.007390260696411133 length of segment : 203 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0007038116455078125 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.43438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 301 time to create 1 rle with old method : 0.0006780624389648438 length of segment : 21 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0005850791931152344 length of segment : 21 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0005006790161132812 length of segment : 19 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003485679626464844 length of segment : 16 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0009410381317138672 length of segment : 35 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002830028533935547 length of segment : 12 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001888275146484375 length of segment : 13 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005567073822021484 length of segment : 24 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00021004676818847656 length of segment : 11 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003752708435058594 length of segment : 21 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 971 time to create 1 rle with old method : 0.0014162063598632812 length of segment : 28 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0014755725860595703 length of segment : 34 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003414154052734375 length of segment : 21 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005037784576416016 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0004279613494873047 length of segment : 14 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002334117889404297 length of segment : 16 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 812 time to create 1 rle with old method : 0.0010654926300048828 length of segment : 37 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.001055002212524414 length of segment : 21 time for calcul the mask position with numpy : 0.0001742839813232422 nb_pixel_total : 5621 time to create 1 rle with old method : 0.007256984710693359 length of segment : 151 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0016715526580810547 length of segment : 43 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00029087066650390625 length of segment : 15 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1816 time to create 1 rle with old method : 0.002344846725463867 length of segment : 88 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 1751 time to create 1 rle with old method : 0.002391338348388672 length of segment : 165 time for calcul the mask position with numpy : 0.00010585784912109375 nb_pixel_total : 2908 time to create 1 rle with old method : 0.0038268566131591797 length of segment : 168 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.0012586116790771484 length of segment : 36 time for calcul the mask position with numpy : 0.00022935867309570312 nb_pixel_total : 3444 time to create 1 rle with old method : 0.0044023990631103516 length of segment : 192 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006861686706542969 length of segment : 21 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 196.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 64.19766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0011625289916992188 nb_pixel_total : 106185 time to create 1 rle with old method : 0.12864375114440918 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 2298 time to create 1 rle with old method : 0.0029757022857666016 length of segment : 66 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005788803100585938 length of segment : 26 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00044846534729003906 length of segment : 19 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001480579376220703 length of segment : 14 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.00038909912109375 length of segment : 26 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0006098747253417969 length of segment : 27 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0015873908996582031 length of segment : 43 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005576610565185547 length of segment : 29 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0008480548858642578 length of segment : 25 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0002105236053466797 length of segment : 12 time for calcul the mask position with numpy : 0.0007336139678955078 nb_pixel_total : 49082 time to create 1 rle with old method : 0.0598447322845459 length of segment : 249 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00019097328186035156 length of segment : 20 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005371570587158203 length of segment : 30 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003819465637207031 length of segment : 35 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0014357566833496094 length of segment : 46 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00019812583923339844 length of segment : 7 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 2294 time to create 1 rle with old method : 0.002892017364501953 length of segment : 83 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004410743713378906 length of segment : 23 time for calcul the mask position with numpy : 0.000762939453125 nb_pixel_total : 49748 time to create 1 rle with old method : 0.056059837341308594 length of segment : 252 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.66641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 25 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00036072731018066406 length of segment : 24 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002894401550292969 length of segment : 15 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005674362182617188 length of segment : 25 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019216537475585938 length of segment : 21 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001785755157470703 length of segment : 15 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00038695335388183594 length of segment : 18 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010907649993896484 length of segment : 81 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005950927734375 length of segment : 46 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002722740173339844 length of segment : 14 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003962516784667969 length of segment : 14 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00035071372985839844 length of segment : 17 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2462 time to create 1 rle with old method : 0.0032753944396972656 length of segment : 79 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 782 time to create 1 rle with old method : 0.0010716915130615234 length of segment : 45 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0004379749298095703 length of segment : 30 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00030541419982910156 length of segment : 18 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004184246063232422 length of segment : 25 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.00042176246643066406 length of segment : 26 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 984 time to create 1 rle with old method : 0.0012814998626708984 length of segment : 54 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00037550926208496094 length of segment : 16 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003077983856201172 length of segment : 15 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.0012538433074951172 length of segment : 42 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0004715919494628906 length of segment : 16 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.00040984153747558594 length of segment : 24 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00025463104248046875 length of segment : 9 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0007798671722412109 length of segment : 34 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005004405975341797 length of segment : 28 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00046706199645996094 length of segment : 18 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1466 time to create 1 rle with old method : 0.0020225048065185547 length of segment : 42 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003368854522705078 length of segment : 15 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0009961128234863281 length of segment : 26 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 957 time to create 1 rle with old method : 0.0016551017761230469 length of segment : 40 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0008275508880615234 length of segment : 20 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 965 time to create 1 rle with old method : 0.0013737678527832031 length of segment : 37 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 2478 time to create 1 rle with old method : 0.003192901611328125 length of segment : 61 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002601146697998047 length of segment : 15 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00036525726318359375 length of segment : 19 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004954338073730469 length of segment : 30 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00016498565673828125 length of segment : 12 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1477 time to create 1 rle with old method : 0.0020301342010498047 length of segment : 46 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0005559921264648438 length of segment : 17 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.67266 max: 150.25234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0011882781982421875 length of segment : 42 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00012993812561035156 length of segment : 31 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 849 time to create 1 rle with old method : 0.00135040283203125 length of segment : 36 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.00013208389282226562 length of segment : 31 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 845 time to create 1 rle with old method : 0.0012326240539550781 length of segment : 48 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 11 time to create 1 rle with old method : 5.221366882324219e-05 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.12578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0008134841918945312 length of segment : 46 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.001241922378540039 length of segment : 33 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0011436939239501953 length of segment : 39 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 2229 time to create 1 rle with old method : 0.0030274391174316406 length of segment : 51 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00022172927856445312 length of segment : 14 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.0014836788177490234 length of segment : 37 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0025005340576171875 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.21172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00012755393981933594 nb_pixel_total : 5996 time to create 1 rle with old method : 0.0072231292724609375 length of segment : 118 time for calcul the mask position with numpy : 0.00023031234741210938 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0016412734985351562 length of segment : 85 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 2265 time to create 1 rle with old method : 0.0029609203338623047 length of segment : 62 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0007164478302001953 length of segment : 37 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006861686706542969 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1093 time to create 1 rle with old method : 0.0014045238494873047 length of segment : 59 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 7942 time to create 1 rle with old method : 0.010446548461914062 length of segment : 148 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00019669532775878906 length of segment : 15 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 2451 time to create 1 rle with old method : 0.0033042430877685547 length of segment : 31 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003120899200439453 length of segment : 17 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 243.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 125.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00027632713317871094 length of segment : 15 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1122 time to create 1 rle with old method : 0.00156402587890625 length of segment : 32 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007770061492919922 length of segment : 20 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0007450580596923828 length of segment : 21 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003731250762939453 length of segment : 17 time for calcul the mask position with numpy : 0.0007069110870361328 nb_pixel_total : 59448 time to create 1 rle with old method : 0.07164430618286133 length of segment : 331 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -102.18438 max: 64.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.08672 max: 149.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00020647048950195312 length of segment : 11 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.00018739700317382812 length of segment : 23 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.00041365623474121094 length of segment : 21 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005710124969482422 length of segment : 66 time for calcul the mask position with numpy : 0.00036454200744628906 nb_pixel_total : 17085 time to create 1 rle with old method : 0.0208740234375 length of segment : 333 time for calcul the mask position with numpy : 0.0004954338073730469 nb_pixel_total : 12021 time to create 1 rle with old method : 0.015395641326904297 length of segment : 171 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 29 time for calcul the mask position with numpy : 0.0002677440643310547 nb_pixel_total : 12220 time to create 1 rle with old method : 0.015067815780639648 length of segment : 149 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004534721374511719 length of segment : 20 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00031876564025878906 length of segment : 19 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.00026726722717285156 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00020551681518554688 length of segment : 11 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00024700164794921875 length of segment : 10 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.00034618377685546875 length of segment : 15 length of segment : 0 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 580 time to create 1 rle with old method : 0.0007662773132324219 length of segment : 28 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 1196 time to create 1 rle with old method : 0.0016663074493408203 length of segment : 114 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005631446838378906 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004260540008544922 length of segment : 14 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002472400665283203 length of segment : 16 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 835 time to create 1 rle with old method : 0.0011074542999267578 length of segment : 37 time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 7092 time to create 1 rle with old method : 0.00914311408996582 length of segment : 222 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 1286 time to create 1 rle with old method : 0.001886129379272461 length of segment : 45 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 6607 time to create 1 rle with old method : 0.008316993713378906 length of segment : 188 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00028777122497558594 length of segment : 16 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 2312 time to create 1 rle with old method : 0.0031325817108154297 length of segment : 149 time for calcul the mask position with numpy : 8.749961853027344e-05 nb_pixel_total : 1893 time to create 1 rle with old method : 0.0023894309997558594 length of segment : 91 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0013897418975830078 length of segment : 43 time for calcul the mask position with numpy : 0.0001385211944580078 nb_pixel_total : 1715 time to create 1 rle with old method : 0.0023670196533203125 length of segment : 116 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1188 time to create 1 rle with old method : 0.001608133316040039 length of segment : 46 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0007283687591552734 length of segment : 20 Processing 1 images image shape: (280, 400, 3) min: 7.00000 max: 182.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 62.79531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009570121765136719 nb_pixel_total : 106602 time to create 1 rle with old method : 0.11876320838928223 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.56484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 2550 time to create 1 rle with old method : 0.003438711166381836 length of segment : 62 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005614757537841797 length of segment : 27 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0004143714904785156 length of segment : 20 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 2469 time to create 1 rle with old method : 0.0031905174255371094 length of segment : 57 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015878677368164062 length of segment : 14 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1398 time to create 1 rle with old method : 0.0017986297607421875 length of segment : 48 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00018095970153808594 length of segment : 12 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003952980041503906 length of segment : 18 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00025177001953125 length of segment : 27 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005326271057128906 length of segment : 29 time for calcul the mask position with numpy : 0.0007486343383789062 nb_pixel_total : 49041 time to create 1 rle with old method : 0.05681777000427246 length of segment : 239 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1477 time to create 1 rle with old method : 0.001783609390258789 length of segment : 50 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005207061767578125 length of segment : 29 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1003 time to create 1 rle with old method : 0.0012278556823730469 length of segment : 59 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.00039505958557128906 length of segment : 25 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00018739700317382812 length of segment : 12 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00020742416381835938 length of segment : 13 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003311634063720703 length of segment : 28 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00027251243591308594 length of segment : 14 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0008249282836914062 length of segment : 27 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00024628639221191406 length of segment : 14 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003113746643066406 length of segment : 19 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.00042724609375 length of segment : 24 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00017833709716796875 length of segment : 15 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006561279296875 length of segment : 61 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0005338191986083984 length of segment : 16 time for calcul the mask position with numpy : 9.870529174804688e-05 nb_pixel_total : 863 time to create 1 rle with old method : 0.0016679763793945312 length of segment : 81 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001857280731201172 length of segment : 22 time for calcul the mask position with numpy : 0.00010132789611816406 nb_pixel_total : 2363 time to create 1 rle with old method : 0.0030257701873779297 length of segment : 74 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00040411949157714844 length of segment : 16 time for calcul the mask position with numpy : 0.00012111663818359375 nb_pixel_total : 320 time to create 1 rle with old method : 0.000457763671875 length of segment : 25 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0006396770477294922 length of segment : 15 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00016546249389648438 length of segment : 9 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 993 time to create 1 rle with old method : 0.0012860298156738281 length of segment : 52 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 1822 time to create 1 rle with old method : 0.002332448959350586 length of segment : 73 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.00030875205993652344 length of segment : 15 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006787776947021484 length of segment : 41 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003211498260498047 length of segment : 21 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003514289855957031 length of segment : 21 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001544952392578125 length of segment : 9 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.00074005126953125 length of segment : 22 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003714561462402344 length of segment : 29 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 609 time to create 1 rle with old method : 0.0008168220520019531 length of segment : 35 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.58437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005712509155273438 length of segment : 29 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.0013282299041748047 length of segment : 37 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 15 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 639 time to create 1 rle with old method : 0.0009028911590576172 length of segment : 24 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1454 time to create 1 rle with old method : 0.001960277557373047 length of segment : 44 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0004169940948486328 length of segment : 21 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.000637054443359375 length of segment : 20 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006539821624755859 length of segment : 19 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.0002856254577636719 length of segment : 14 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.0013518333435058594 length of segment : 39 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00037980079650878906 length of segment : 16 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.000621795654296875 length of segment : 30 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00043082237243652344 length of segment : 29 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1493 time to create 1 rle with old method : 0.002003908157348633 length of segment : 45 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0003039836883544922 length of segment : 39 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00036454200744628906 length of segment : 16 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 16 time to create 1 rle with old method : 5.3882598876953125e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.84844 max: 150.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 940 time to create 1 rle with old method : 0.0012814998626708984 length of segment : 42 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00015616416931152344 length of segment : 31 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00015306472778320312 length of segment : 28 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.0001938343048095703 length of segment : 17 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 8 time to create 1 rle with old method : 3.170967102050781e-05 length of segment : 6 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 833 time to create 1 rle with old method : 0.0011777877807617188 length of segment : 41 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1507 time to create 1 rle with old method : 0.0020606517791748047 length of segment : 66 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.14531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0012476444244384766 length of segment : 41 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0011157989501953125 length of segment : 46 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0015425682067871094 length of segment : 39 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 885 time to create 1 rle with old method : 0.0012660026550292969 length of segment : 39 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.0012886524200439453 length of segment : 41 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00021648406982421875 length of segment : 13 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.0011241436004638672 length of segment : 59 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 705 time to create 1 rle with old method : 0.0009613037109375 length of segment : 48 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00012111663818359375 length of segment : 8 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 2696 time to create 1 rle with old method : 0.003515481948852539 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.99297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 5695 time to create 1 rle with old method : 0.006815433502197266 length of segment : 121 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 3030 time to create 1 rle with old method : 0.003981828689575195 length of segment : 82 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 2771 time to create 1 rle with old method : 0.007012128829956055 length of segment : 48 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007014274597167969 length of segment : 37 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006124973297119141 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.19219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 8842 time to create 1 rle with old method : 0.013243436813354492 length of segment : 121 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.000171661376953125 length of segment : 15 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 975 time to create 1 rle with old method : 0.0012712478637695312 length of segment : 68 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001480579376220703 length of segment : 16 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 17 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 119.64687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0007026195526123047 length of segment : 19 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0009884834289550781 length of segment : 17 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002593994140625 length of segment : 14 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1177 time to create 1 rle with old method : 0.0015871524810791016 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -101.15313 max: 65.91641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.62188 max: 148.77969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0002396106719970703 length of segment : 15 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0008001327514648438 length of segment : 66 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00019502639770507812 length of segment : 10 time for calcul the mask position with numpy : 0.00036597251892089844 nb_pixel_total : 20559 time to create 1 rle with old method : 0.025551557540893555 length of segment : 198 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00018978118896484375 length of segment : 23 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0004096031188964844 length of segment : 23 time for calcul the mask position with numpy : 0.00022745132446289062 nb_pixel_total : 10222 time to create 1 rle with old method : 0.012160301208496094 length of segment : 234 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.91484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0004048347473144531 length of segment : 20 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.000263214111328125 length of segment : 20 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003669261932373047 length of segment : 16 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003819465637207031 length of segment : 21 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00020003318786621094 length of segment : 10 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003650188446044922 length of segment : 19 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005965232849121094 length of segment : 23 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0010423660278320312 length of segment : 34 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 2514 time to create 1 rle with old method : 0.003440380096435547 length of segment : 87 length of segment : 0 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0009233951568603516 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.68828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0004024505615234375 length of segment : 14 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.00039577484130859375 length of segment : 19 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 812 time to create 1 rle with old method : 0.001077890396118164 length of segment : 37 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 850 time to create 1 rle with old method : 0.0012466907501220703 length of segment : 27 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004773139953613281 length of segment : 44 time for calcul the mask position with numpy : 0.0002033710479736328 nb_pixel_total : 6925 time to create 1 rle with old method : 0.008745193481445312 length of segment : 207 time for calcul the mask position with numpy : 0.0002849102020263672 nb_pixel_total : 7162 time to create 1 rle with old method : 0.008761405944824219 length of segment : 254 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0011990070343017578 length of segment : 26 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00029158592224121094 length of segment : 15 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 1842 time to create 1 rle with old method : 0.0030007362365722656 length of segment : 166 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 1815 time to create 1 rle with old method : 0.0025484561920166016 length of segment : 164 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 1779 time to create 1 rle with old method : 0.002293825149536133 length of segment : 87 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1049 time to create 1 rle with old method : 0.0016040802001953125 length of segment : 45 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0007722377777099609 length of segment : 21 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1143 time to create 1 rle with old method : 0.001558065414428711 length of segment : 46 time for calcul the mask position with numpy : 0.0002636909484863281 nb_pixel_total : 3061 time to create 1 rle with old method : 0.0043182373046875 length of segment : 192 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 64.43203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010416507720947266 nb_pixel_total : 105777 time to create 1 rle with old method : 0.12050271034240723 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.75625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 0.00011897087097167969 nb_pixel_total : 437 time to create 1 rle with old method : 0.0008478164672851562 length of segment : 27 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004410743713378906 length of segment : 21 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00030350685119628906 length of segment : 21 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0006117820739746094 length of segment : 30 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 658 time to create 1 rle with old method : 0.0011126995086669922 length of segment : 32 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 2818 time to create 1 rle with old method : 0.004235267639160156 length of segment : 49 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005862712860107422 length of segment : 41 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0007038116455078125 length of segment : 25 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00016736984252929688 length of segment : 14 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003209114074707031 length of segment : 15 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004363059997558594 length of segment : 35 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 2758 time to create 1 rle with old method : 0.0035140514373779297 length of segment : 101 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0007050037384033203 length of segment : 51 time for calcul the mask position with numpy : 0.0005898475646972656 nb_pixel_total : 49028 time to create 1 rle with old method : 0.0557553768157959 length of segment : 236 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00012540817260742188 length of segment : 11 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 907 time to create 1 rle with old method : 0.001726388931274414 length of segment : 27 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0006372928619384766 length of segment : 23 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00036263465881347656 length of segment : 28 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.00047779083251953125 length of segment : 24 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.56484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 25 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 27 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002994537353515625 length of segment : 14 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 15 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.000202178955078125 length of segment : 21 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1054 time to create 1 rle with old method : 0.001371145248413086 length of segment : 53 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 919 time to create 1 rle with old method : 0.0011687278747558594 length of segment : 88 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00026535987854003906 length of segment : 17 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2464 time to create 1 rle with old method : 0.003194093704223633 length of segment : 76 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001537799835205078 length of segment : 9 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.000446319580078125 length of segment : 25 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 17 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00015544891357421875 length of segment : 10 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00045871734619140625 length of segment : 16 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00024056434631347656 length of segment : 16 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0006694793701171875 length of segment : 65 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0004067420959472656 length of segment : 14 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0005421638488769531 length of segment : 20 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.001058816909790039 length of segment : 36 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.00042176246643066406 length of segment : 15 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 987 time to create 1 rle with old method : 0.001241445541381836 length of segment : 63 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0005590915679931641 length of segment : 25 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0007107257843017578 length of segment : 50 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003039836883544922 length of segment : 17 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004286766052246094 length of segment : 22 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003783702850341797 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004985332489013672 length of segment : 29 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1027 time to create 1 rle with old method : 0.0013554096221923828 length of segment : 41 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 683 time to create 1 rle with old method : 0.0009644031524658203 length of segment : 24 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004711151123046875 length of segment : 19 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00032329559326171875 length of segment : 15 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1496 time to create 1 rle with old method : 0.0019540786743164062 length of segment : 45 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0006165504455566406 length of segment : 19 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0009012222290039062 length of segment : 21 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.00046563148498535156 length of segment : 28 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005922317504882812 length of segment : 32 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 2388 time to create 1 rle with old method : 0.00304412841796875 length of segment : 64 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003452301025390625 length of segment : 21 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001666545867919922 length of segment : 16 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1500 time to create 1 rle with old method : 0.0020008087158203125 length of segment : 45 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 253.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.00044083595275878906 length of segment : 18 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0004315376281738281 length of segment : 54 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 15 time to create 1 rle with old method : 4.792213439941406e-05 length of segment : 3 Detection mask done ! Trying to reset tf kernel 2903284 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4284 tf kernel not reseted sub process len(results) : 371 len(list_Values) 371 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 371 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9573 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 371 chid ids of type : 4228 Number RLEs to save : 17319 save missing photos in datou_result : time spend for datou_step_exec : 32.88865876197815 time spend to save output : 1.7991788387298584 total time spend for step 1 : 34.68783760070801 step2:brightness Tue Feb 25 01:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740442828_2902661_1339336850_2f48f61732a303411758b7eb184d6bdf.jpg treat image : temp/1740442828_2902661_1339336847_fd5f4fad3c4d8483adfe5efe3b860006.jpg treat image : temp/1740442828_2902661_1339336844_185268c676b5c092f1b1b89692fee81b.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.01237940788269043 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.013200521469116211 save missing photos in datou_result : time spend for datou_step_exec : 1.269643783569336 time spend to save output : 0.030434131622314453 total time spend for step 2 : 1.3000779151916504 step3:blur_detection Tue Feb 25 01:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740442828_2902661_1339336850_2f48f61732a303411758b7eb184d6bdf.jpg resize: (1080, 1920) 1339336850 -7.744532023709289 treat image : temp/1740442828_2902661_1339336847_fd5f4fad3c4d8483adfe5efe3b860006.jpg resize: (1080, 1920) 1339336847 -7.749477207235637 treat image : temp/1740442828_2902661_1339336844_185268c676b5c092f1b1b89692fee81b.jpg resize: (1080, 1920) 1339336844 -7.741563513429847 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.012118339538574219 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.011171817779541016 save missing photos in datou_result : time spend for datou_step_exec : 3.2033262252807617 time spend to save output : 0.0279998779296875 total time spend for step 3 : 3.231326103210449 step4:rle_unique_nms_with_priority Tue Feb 25 01:21:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 371 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 121 nb_hashtags : 6 time to prepare the origin masks : 1.1929848194122314 time for calcul the mask position with numpy : 0.08903765678405762 nb_pixel_total : 1777954 time to create 1 rle with new method : 0.14097118377685547 time for calcul the mask position with numpy : 0.008808612823486328 nb_pixel_total : 2164 time to create 1 rle with old method : 0.002716064453125 time for calcul the mask position with numpy : 0.008734941482543945 nb_pixel_total : 126 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.010195493698120117 nb_pixel_total : 483 time to create 1 rle with old method : 0.0007498264312744141 time for calcul the mask position with numpy : 0.009203433990478516 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006477832794189453 time for calcul the mask position with numpy : 0.008629083633422852 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0012145042419433594 time for calcul the mask position with numpy : 0.008680582046508789 nb_pixel_total : 15 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.009245872497558594 nb_pixel_total : 108 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.011067390441894531 nb_pixel_total : 82 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.008959531784057617 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004985332489013672 time for calcul the mask position with numpy : 0.009298086166381836 nb_pixel_total : 1498 time to create 1 rle with old method : 0.001817464828491211 time for calcul the mask position with numpy : 0.009009122848510742 nb_pixel_total : 12 time to create 1 rle with old method : 3.9577484130859375e-05 time for calcul the mask position with numpy : 0.008739948272705078 nb_pixel_total : 17 time to create 1 rle with old method : 5.1021575927734375e-05 time for calcul the mask position with numpy : 0.00905466079711914 nb_pixel_total : 52054 time to create 1 rle with old method : 0.06191849708557129 time for calcul the mask position with numpy : 0.008434534072875977 nb_pixel_total : 4660 time to create 1 rle with old method : 0.005606412887573242 time for calcul the mask position with numpy : 0.008384466171264648 nb_pixel_total : 1256 time to create 1 rle with old method : 0.001436471939086914 time for calcul the mask position with numpy : 0.008363485336303711 nb_pixel_total : 1049 time to create 1 rle with old method : 0.0011906623840332031 time for calcul the mask position with numpy : 0.008379936218261719 nb_pixel_total : 56 time to create 1 rle with old method : 0.00010418891906738281 time for calcul the mask position with numpy : 0.008374452590942383 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002346038818359375 time for calcul the mask position with numpy : 0.008361577987670898 nb_pixel_total : 923 time to create 1 rle with old method : 0.0010638236999511719 time for calcul the mask position with numpy : 0.008413553237915039 nb_pixel_total : 48 time to create 1 rle with old method : 6.389617919921875e-05 time for calcul the mask position with numpy : 0.008411169052124023 nb_pixel_total : 2358 time to create 1 rle with old method : 0.002777576446533203 time for calcul the mask position with numpy : 0.00840139389038086 nb_pixel_total : 822 time to create 1 rle with old method : 0.0009450912475585938 time for calcul the mask position with numpy : 0.008414268493652344 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002295970916748047 time for calcul the mask position with numpy : 0.008397817611694336 nb_pixel_total : 5767 time to create 1 rle with old method : 0.006583690643310547 time for calcul the mask position with numpy : 0.008483409881591797 nb_pixel_total : 7118 time to create 1 rle with old method : 0.008198976516723633 time for calcul the mask position with numpy : 0.00843501091003418 nb_pixel_total : 175 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.008435964584350586 nb_pixel_total : 958 time to create 1 rle with old method : 0.001107931137084961 time for calcul the mask position with numpy : 0.008711814880371094 nb_pixel_total : 2413 time to create 1 rle with old method : 0.0029494762420654297 time for calcul the mask position with numpy : 0.008702278137207031 nb_pixel_total : 517 time to create 1 rle with old method : 0.0006506443023681641 time for calcul the mask position with numpy : 0.008918046951293945 nb_pixel_total : 18 time to create 1 rle with old method : 6.985664367675781e-05 time for calcul the mask position with numpy : 0.008914470672607422 nb_pixel_total : 38 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.008663415908813477 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.00878286361694336 nb_pixel_total : 5621 time to create 1 rle with old method : 0.006539583206176758 time for calcul the mask position with numpy : 0.008910655975341797 nb_pixel_total : 812 time to create 1 rle with old method : 0.0009500980377197266 time for calcul the mask position with numpy : 0.008624792098999023 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.008542537689208984 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0014755725860595703 time for calcul the mask position with numpy : 0.010383844375610352 nb_pixel_total : 5709 time to create 1 rle with old method : 0.00678706169128418 time for calcul the mask position with numpy : 0.009746313095092773 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002608299255371094 time for calcul the mask position with numpy : 0.009966850280761719 nb_pixel_total : 119 time to create 1 rle with old method : 0.0002224445343017578 time for calcul the mask position with numpy : 0.009863615036010742 nb_pixel_total : 515 time to create 1 rle with old method : 0.0009129047393798828 time for calcul the mask position with numpy : 0.009727716445922852 nb_pixel_total : 1425 time to create 1 rle with old method : 0.002515554428100586 time for calcul the mask position with numpy : 0.009970426559448242 nb_pixel_total : 1751 time to create 1 rle with old method : 0.003020048141479492 time for calcul the mask position with numpy : 0.010111331939697266 nb_pixel_total : 3436 time to create 1 rle with old method : 0.005737781524658203 time for calcul the mask position with numpy : 0.009897470474243164 nb_pixel_total : 833 time to create 1 rle with old method : 0.0014390945434570312 time for calcul the mask position with numpy : 0.010004520416259766 nb_pixel_total : 180 time to create 1 rle with old method : 0.0003771781921386719 time for calcul the mask position with numpy : 0.009817123413085938 nb_pixel_total : 4 time to create 1 rle with old method : 3.528594970703125e-05 time for calcul the mask position with numpy : 0.009763002395629883 nb_pixel_total : 402 time to create 1 rle with old method : 0.0006849765777587891 time for calcul the mask position with numpy : 0.00974273681640625 nb_pixel_total : 527 time to create 1 rle with old method : 0.0009374618530273438 time for calcul the mask position with numpy : 0.008701086044311523 nb_pixel_total : 488 time to create 1 rle with old method : 0.0005903244018554688 time for calcul the mask position with numpy : 0.008398771286010742 nb_pixel_total : 243 time to create 1 rle with old method : 0.0002880096435546875 time for calcul the mask position with numpy : 0.008383512496948242 nb_pixel_total : 8 time to create 1 rle with old method : 1.811981201171875e-05 time for calcul the mask position with numpy : 0.00841212272644043 nb_pixel_total : 686 time to create 1 rle with old method : 0.0007915496826171875 time for calcul the mask position with numpy : 0.008388996124267578 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002090930938720703 time for calcul the mask position with numpy : 0.008453369140625 nb_pixel_total : 122 time to create 1 rle with old method : 0.00016307830810546875 time for calcul the mask position with numpy : 0.008414268493652344 nb_pixel_total : 277 time to create 1 rle with old method : 0.000335693359375 time for calcul the mask position with numpy : 0.008498668670654297 nb_pixel_total : 1816 time to create 1 rle with old method : 0.002058267593383789 time for calcul the mask position with numpy : 0.008470535278320312 nb_pixel_total : 113 time to create 1 rle with old method : 0.00013971328735351562 time for calcul the mask position with numpy : 0.008384943008422852 nb_pixel_total : 103 time to create 1 rle with old method : 0.000125885009765625 time for calcul the mask position with numpy : 0.008360862731933594 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002052783966064453 time for calcul the mask position with numpy : 0.008353471755981445 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.008362770080566406 nb_pixel_total : 225 time to create 1 rle with old method : 0.00026798248291015625 time for calcul the mask position with numpy : 0.008357763290405273 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003044605255126953 time for calcul the mask position with numpy : 0.008362531661987305 nb_pixel_total : 722 time to create 1 rle with old method : 0.0008656978607177734 time for calcul the mask position with numpy : 0.00882863998413086 nb_pixel_total : 106185 time to create 1 rle with old method : 0.12279248237609863 time for calcul the mask position with numpy : 0.008629322052001953 nb_pixel_total : 45 time to create 1 rle with old method : 8.511543273925781e-05 time for calcul the mask position with numpy : 0.008597612380981445 nb_pixel_total : 239 time to create 1 rle with old method : 0.00031757354736328125 time for calcul the mask position with numpy : 0.00876617431640625 nb_pixel_total : 152 time to create 1 rle with old method : 0.00021791458129882812 time for calcul the mask position with numpy : 0.008555173873901367 nb_pixel_total : 567 time to create 1 rle with old method : 0.0006933212280273438 time for calcul the mask position with numpy : 0.008332490921020508 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0017600059509277344 time for calcul the mask position with numpy : 0.0085601806640625 nb_pixel_total : 46553 time to create 1 rle with old method : 0.05249977111816406 time for calcul the mask position with numpy : 0.008440017700195312 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002319812774658203 time for calcul the mask position with numpy : 0.008395910263061523 nb_pixel_total : 283 time to create 1 rle with old method : 0.00034880638122558594 time for calcul the mask position with numpy : 0.008381843566894531 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003178119659423828 time for calcul the mask position with numpy : 0.008373737335205078 nb_pixel_total : 121 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.008358001708984375 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.008386611938476562 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002391338348388672 time for calcul the mask position with numpy : 0.008357763290405273 nb_pixel_total : 409 time to create 1 rle with old method : 0.0004737377166748047 time for calcul the mask position with numpy : 0.008403301239013672 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003402233123779297 time for calcul the mask position with numpy : 0.008833646774291992 nb_pixel_total : 2298 time to create 1 rle with old method : 0.0026695728302001953 time for calcul the mask position with numpy : 0.008420705795288086 nb_pixel_total : 593 time to create 1 rle with old method : 0.0006759166717529297 time for calcul the mask position with numpy : 0.008494377136230469 nb_pixel_total : 102 time to create 1 rle with old method : 0.00013399124145507812 time for calcul the mask position with numpy : 0.008385181427001953 nb_pixel_total : 782 time to create 1 rle with old method : 0.0008969306945800781 time for calcul the mask position with numpy : 0.008478164672851562 nb_pixel_total : 869 time to create 1 rle with old method : 0.0009865760803222656 time for calcul the mask position with numpy : 0.008394002914428711 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004069805145263672 time for calcul the mask position with numpy : 0.008404016494750977 nb_pixel_total : 492 time to create 1 rle with old method : 0.0005705356597900391 time for calcul the mask position with numpy : 0.008486270904541016 nb_pixel_total : 78 time to create 1 rle with old method : 0.00010323524475097656 time for calcul the mask position with numpy : 0.008535385131835938 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003192424774169922 time for calcul the mask position with numpy : 0.008704423904418945 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002646446228027344 time for calcul the mask position with numpy : 0.008746623992919922 nb_pixel_total : 957 time to create 1 rle with old method : 0.001127481460571289 time for calcul the mask position with numpy : 0.008585691452026367 nb_pixel_total : 506 time to create 1 rle with old method : 0.0006470680236816406 time for calcul the mask position with numpy : 0.008568763732910156 nb_pixel_total : 41 time to create 1 rle with old method : 0.00010085105895996094 time for calcul the mask position with numpy : 0.008540630340576172 nb_pixel_total : 954 time to create 1 rle with old method : 0.0011262893676757812 time for calcul the mask position with numpy : 0.008565425872802734 nb_pixel_total : 198 time to create 1 rle with old method : 0.00024008750915527344 time for calcul the mask position with numpy : 0.008400201797485352 nb_pixel_total : 259 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.008351325988769531 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003504753112792969 time for calcul the mask position with numpy : 0.008364200592041016 nb_pixel_total : 350 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.008381128311157227 nb_pixel_total : 384 time to create 1 rle with old method : 0.0007331371307373047 time for calcul the mask position with numpy : 0.010013818740844727 nb_pixel_total : 243 time to create 1 rle with old method : 0.0004050731658935547 time for calcul the mask position with numpy : 0.010044097900390625 nb_pixel_total : 180 time to create 1 rle with old method : 0.0003247261047363281 time for calcul the mask position with numpy : 0.010050535202026367 nb_pixel_total : 105 time to create 1 rle with old method : 0.00013494491577148438 time for calcul the mask position with numpy : 0.008400678634643555 nb_pixel_total : 401 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.008385181427001953 nb_pixel_total : 2462 time to create 1 rle with old method : 0.0027992725372314453 time for calcul the mask position with numpy : 0.008392810821533203 nb_pixel_total : 685 time to create 1 rle with old method : 0.0007948875427246094 time for calcul the mask position with numpy : 0.008387565612792969 nb_pixel_total : 399 time to create 1 rle with old method : 0.000461578369140625 time for calcul the mask position with numpy : 0.008457660675048828 nb_pixel_total : 146 time to create 1 rle with old method : 0.00018143653869628906 time for calcul the mask position with numpy : 0.00840139389038086 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003542900085449219 time for calcul the mask position with numpy : 0.008430957794189453 nb_pixel_total : 30 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.008430004119873047 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005099773406982422 time for calcul the mask position with numpy : 0.008445978164672852 nb_pixel_total : 2478 time to create 1 rle with old method : 0.002843618392944336 time for calcul the mask position with numpy : 0.008454322814941406 nb_pixel_total : 48 time to create 1 rle with old method : 8.130073547363281e-05 time for calcul the mask position with numpy : 0.008446693420410156 nb_pixel_total : 1466 time to create 1 rle with old method : 0.0017042160034179688 time for calcul the mask position with numpy : 0.008411645889282227 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0013124942779541016 time for calcul the mask position with numpy : 0.008400917053222656 nb_pixel_total : 984 time to create 1 rle with old method : 0.0011410713195800781 time for calcul the mask position with numpy : 0.008432865142822266 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001614093780517578 time for calcul the mask position with numpy : 0.00849008560180664 nb_pixel_total : 89 time to create 1 rle with old method : 0.00011515617370605469 time for calcul the mask position with numpy : 0.008472919464111328 nb_pixel_total : 303 time to create 1 rle with old method : 0.00035500526428222656 time for calcul the mask position with numpy : 0.008487701416015625 nb_pixel_total : 13 time to create 1 rle with old method : 3.0279159545898438e-05 time for calcul the mask position with numpy : 0.008443117141723633 nb_pixel_total : 244 time to create 1 rle with old method : 0.0002942085266113281 time for calcul the mask position with numpy : 0.008434295654296875 nb_pixel_total : 70 time to create 1 rle with old method : 0.00011587142944335938 time for calcul the mask position with numpy : 0.008438348770141602 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003571510314941406 time for calcul the mask position with numpy : 0.008463382720947266 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003008842468261719 create new chi : 1.6531801223754883 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.01188516616821289 batch 1 Loaded 122 chid ids of type : 4230 Number RLEs to save : 10992 TO DO : save crop sub photo not yet done ! save time : 0.7741239070892334 nb_obj : 118 nb_hashtags : 7 time to prepare the origin masks : 2.910954475402832 time for calcul the mask position with numpy : 0.04832315444946289 nb_pixel_total : 1758557 time to create 1 rle with new method : 0.14224624633789062 time for calcul the mask position with numpy : 0.008930683135986328 nb_pixel_total : 2265 time to create 1 rle with old method : 0.003369569778442383 time for calcul the mask position with numpy : 0.009469985961914062 nb_pixel_total : 131 time to create 1 rle with old method : 0.00022220611572265625 time for calcul the mask position with numpy : 0.009131669998168945 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0016295909881591797 time for calcul the mask position with numpy : 0.008938789367675781 nb_pixel_total : 426 time to create 1 rle with old method : 0.0005414485931396484 time for calcul the mask position with numpy : 0.009197473526000977 nb_pixel_total : 1379 time to create 1 rle with old method : 0.002142190933227539 time for calcul the mask position with numpy : 0.009155750274658203 nb_pixel_total : 14 time to create 1 rle with old method : 7.176399230957031e-05 time for calcul the mask position with numpy : 0.008949756622314453 nb_pixel_total : 59448 time to create 1 rle with old method : 0.07118678092956543 time for calcul the mask position with numpy : 0.007601261138916016 nb_pixel_total : 73 time to create 1 rle with old method : 0.00010371208190917969 time for calcul the mask position with numpy : 0.007634401321411133 nb_pixel_total : 11 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.0069293975830078125 nb_pixel_total : 42 time to create 1 rle with old method : 0.00010013580322265625 time for calcul the mask position with numpy : 0.008100748062133789 nb_pixel_total : 865 time to create 1 rle with old method : 0.0010075569152832031 time for calcul the mask position with numpy : 0.0075969696044921875 nb_pixel_total : 21 time to create 1 rle with old method : 5.626678466796875e-05 time for calcul the mask position with numpy : 0.007828950881958008 nb_pixel_total : 60 time to create 1 rle with old method : 0.000225067138671875 time for calcul the mask position with numpy : 0.00726628303527832 nb_pixel_total : 57 time to create 1 rle with old method : 0.000118255615234375 time for calcul the mask position with numpy : 0.007049083709716797 nb_pixel_total : 898 time to create 1 rle with old method : 0.0010447502136230469 time for calcul the mask position with numpy : 0.00841069221496582 nb_pixel_total : 606 time to create 1 rle with old method : 0.0009343624114990234 time for calcul the mask position with numpy : 0.009988069534301758 nb_pixel_total : 2090 time to create 1 rle with old method : 0.003552675247192383 time for calcul the mask position with numpy : 0.009988546371459961 nb_pixel_total : 1093 time to create 1 rle with old method : 0.0016376972198486328 time for calcul the mask position with numpy : 0.01806354522705078 nb_pixel_total : 873 time to create 1 rle with old method : 0.0012938976287841797 time for calcul the mask position with numpy : 0.015603303909301758 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003299713134765625 time for calcul the mask position with numpy : 0.011062383651733398 nb_pixel_total : 5996 time to create 1 rle with old method : 0.009915828704833984 time for calcul the mask position with numpy : 0.010786056518554688 nb_pixel_total : 7942 time to create 1 rle with old method : 0.012991905212402344 time for calcul the mask position with numpy : 0.01256251335144043 nb_pixel_total : 143 time to create 1 rle with old method : 0.00020885467529296875 time for calcul the mask position with numpy : 0.008951902389526367 nb_pixel_total : 1122 time to create 1 rle with old method : 0.0013077259063720703 time for calcul the mask position with numpy : 0.00908803939819336 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005276203155517578 time for calcul the mask position with numpy : 0.010570049285888672 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003757476806640625 time for calcul the mask position with numpy : 0.007850408554077148 nb_pixel_total : 29 time to create 1 rle with old method : 9.441375732421875e-05 time for calcul the mask position with numpy : 0.009768009185791016 nb_pixel_total : 507 time to create 1 rle with old method : 0.0009331703186035156 time for calcul the mask position with numpy : 0.011419057846069336 nb_pixel_total : 113 time to create 1 rle with old method : 0.00016021728515625 time for calcul the mask position with numpy : 0.00855112075805664 nb_pixel_total : 7092 time to create 1 rle with old method : 0.01019430160522461 time for calcul the mask position with numpy : 0.007934331893920898 nb_pixel_total : 1196 time to create 1 rle with old method : 0.0014200210571289062 time for calcul the mask position with numpy : 0.008107662200927734 nb_pixel_total : 590 time to create 1 rle with old method : 0.0010089874267578125 time for calcul the mask position with numpy : 0.007258892059326172 nb_pixel_total : 11611 time to create 1 rle with old method : 0.013318300247192383 time for calcul the mask position with numpy : 0.007678031921386719 nb_pixel_total : 835 time to create 1 rle with old method : 0.0009748935699462891 time for calcul the mask position with numpy : 0.011609077453613281 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005106925964355469 time for calcul the mask position with numpy : 0.01368570327758789 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004756450653076172 time for calcul the mask position with numpy : 0.011924505233764648 nb_pixel_total : 844 time to create 1 rle with old method : 0.0011296272277832031 time for calcul the mask position with numpy : 0.016427278518676758 nb_pixel_total : 153 time to create 1 rle with old method : 0.00020575523376464844 time for calcul the mask position with numpy : 0.011327505111694336 nb_pixel_total : 17085 time to create 1 rle with old method : 0.019472122192382812 time for calcul the mask position with numpy : 0.011770963668823242 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002071857452392578 time for calcul the mask position with numpy : 0.012001752853393555 nb_pixel_total : 963 time to create 1 rle with old method : 0.0011754035949707031 time for calcul the mask position with numpy : 0.011790037155151367 nb_pixel_total : 101 time to create 1 rle with old method : 0.00017642974853515625 time for calcul the mask position with numpy : 0.01124429702758789 nb_pixel_total : 2312 time to create 1 rle with old method : 0.002699136734008789 time for calcul the mask position with numpy : 0.014475584030151367 nb_pixel_total : 108 time to create 1 rle with old method : 0.0002148151397705078 time for calcul the mask position with numpy : 0.010809659957885742 nb_pixel_total : 390 time to create 1 rle with old method : 0.00046944618225097656 time for calcul the mask position with numpy : 0.011083602905273438 nb_pixel_total : 1286 time to create 1 rle with old method : 0.0015344619750976562 time for calcul the mask position with numpy : 0.01165318489074707 nb_pixel_total : 500 time to create 1 rle with old method : 0.0005996227264404297 time for calcul the mask position with numpy : 0.011543512344360352 nb_pixel_total : 37 time to create 1 rle with old method : 8.368492126464844e-05 time for calcul the mask position with numpy : 0.010556221008300781 nb_pixel_total : 172 time to create 1 rle with old method : 0.00027251243591308594 time for calcul the mask position with numpy : 0.01297760009765625 nb_pixel_total : 580 time to create 1 rle with old method : 0.0006644725799560547 time for calcul the mask position with numpy : 0.011171817779541016 nb_pixel_total : 171 time to create 1 rle with old method : 0.00023221969604492188 time for calcul the mask position with numpy : 0.012947797775268555 nb_pixel_total : 278 time to create 1 rle with old method : 0.00039315223693847656 time for calcul the mask position with numpy : 0.0133209228515625 nb_pixel_total : 122 time to create 1 rle with old method : 0.00020503997802734375 time for calcul the mask position with numpy : 0.014245748519897461 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004875659942626953 time for calcul the mask position with numpy : 0.013542413711547852 nb_pixel_total : 1893 time to create 1 rle with old method : 0.002154827117919922 time for calcul the mask position with numpy : 0.010803699493408203 nb_pixel_total : 111 time to create 1 rle with old method : 0.00015234947204589844 time for calcul the mask position with numpy : 0.014243602752685547 nb_pixel_total : 137 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.010449409484863281 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002579689025878906 time for calcul the mask position with numpy : 0.011070728302001953 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002856254577636719 time for calcul the mask position with numpy : 0.011730432510375977 nb_pixel_total : 116 time to create 1 rle with old method : 0.00016450881958007812 time for calcul the mask position with numpy : 0.01121664047241211 nb_pixel_total : 106602 time to create 1 rle with old method : 0.12267303466796875 time for calcul the mask position with numpy : 0.011512279510498047 nb_pixel_total : 80 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.014754533767700195 nb_pixel_total : 116 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.01210331916809082 nb_pixel_total : 101 time to create 1 rle with old method : 0.00017976760864257812 time for calcul the mask position with numpy : 0.012913227081298828 nb_pixel_total : 143 time to create 1 rle with old method : 0.00022840499877929688 time for calcul the mask position with numpy : 0.012088537216186523 nb_pixel_total : 43702 time to create 1 rle with old method : 0.051483869552612305 time for calcul the mask position with numpy : 0.013297796249389648 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.01357889175415039 nb_pixel_total : 258 time to create 1 rle with old method : 0.00036907196044921875 time for calcul the mask position with numpy : 0.014276266098022461 nb_pixel_total : 2319 time to create 1 rle with old method : 0.0030684471130371094 time for calcul the mask position with numpy : 0.015392541885375977 nb_pixel_total : 262 time to create 1 rle with old method : 0.0004458427429199219 time for calcul the mask position with numpy : 0.015242338180541992 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004024505615234375 time for calcul the mask position with numpy : 0.015172481536865234 nb_pixel_total : 117 time to create 1 rle with old method : 0.00031185150146484375 time for calcul the mask position with numpy : 0.014744997024536133 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003371238708496094 time for calcul the mask position with numpy : 0.012874841690063477 nb_pixel_total : 150 time to create 1 rle with old method : 0.00022840499877929688 time for calcul the mask position with numpy : 0.01331949234008789 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006678104400634766 time for calcul the mask position with numpy : 0.012855291366577148 nb_pixel_total : 255 time to create 1 rle with old method : 0.00034427642822265625 time for calcul the mask position with numpy : 0.013196229934692383 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003998279571533203 time for calcul the mask position with numpy : 0.01253366470336914 nb_pixel_total : 2550 time to create 1 rle with old method : 0.0029909610748291016 time for calcul the mask position with numpy : 0.013858795166015625 nb_pixel_total : 609 time to create 1 rle with old method : 0.0007486343383789062 time for calcul the mask position with numpy : 0.01279592514038086 nb_pixel_total : 245 time to create 1 rle with old method : 0.0010836124420166016 time for calcul the mask position with numpy : 0.013349294662475586 nb_pixel_total : 863 time to create 1 rle with old method : 0.001047372817993164 time for calcul the mask position with numpy : 0.012768983840942383 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004553794860839844 time for calcul the mask position with numpy : 0.019009828567504883 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005650520324707031 time for calcul the mask position with numpy : 0.01304006576538086 nb_pixel_total : 244 time to create 1 rle with old method : 0.000339508056640625 time for calcul the mask position with numpy : 0.012382745742797852 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003001689910888672 time for calcul the mask position with numpy : 0.012681007385253906 nb_pixel_total : 31 time to create 1 rle with old method : 0.00020575523376464844 time for calcul the mask position with numpy : 0.013350963592529297 nb_pixel_total : 992 time to create 1 rle with old method : 0.0012161731719970703 time for calcul the mask position with numpy : 0.012563943862915039 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003075599670410156 time for calcul the mask position with numpy : 0.012618780136108398 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003952980041503906 time for calcul the mask position with numpy : 0.012340545654296875 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006506443023681641 time for calcul the mask position with numpy : 0.013037443161010742 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005235671997070312 time for calcul the mask position with numpy : 0.012549638748168945 nb_pixel_total : 275 time to create 1 rle with old method : 0.00040268898010253906 time for calcul the mask position with numpy : 0.012645244598388672 nb_pixel_total : 1822 time to create 1 rle with old method : 0.0024368762969970703 time for calcul the mask position with numpy : 0.012739181518554688 nb_pixel_total : 103 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.015649080276489258 nb_pixel_total : 16 time to create 1 rle with old method : 8.225440979003906e-05 time for calcul the mask position with numpy : 0.015740394592285156 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005512237548828125 time for calcul the mask position with numpy : 0.014766931533813477 nb_pixel_total : 639 time to create 1 rle with old method : 0.0009469985961914062 time for calcul the mask position with numpy : 0.012984514236450195 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005714893341064453 time for calcul the mask position with numpy : 0.010707855224609375 nb_pixel_total : 390 time to create 1 rle with old method : 0.00046062469482421875 time for calcul the mask position with numpy : 0.010205507278442383 nb_pixel_total : 21 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.010229110717773438 nb_pixel_total : 124 time to create 1 rle with old method : 0.00016832351684570312 time for calcul the mask position with numpy : 0.010729312896728516 nb_pixel_total : 2363 time to create 1 rle with old method : 0.002717256546020508 time for calcul the mask position with numpy : 0.009914875030517578 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005941390991210938 time for calcul the mask position with numpy : 0.009424924850463867 nb_pixel_total : 406 time to create 1 rle with old method : 0.0007097721099853516 time for calcul the mask position with numpy : 0.00962066650390625 nb_pixel_total : 1454 time to create 1 rle with old method : 0.0016772747039794922 time for calcul the mask position with numpy : 0.00965261459350586 nb_pixel_total : 48 time to create 1 rle with old method : 0.00011134147644042969 time for calcul the mask position with numpy : 0.009432792663574219 nb_pixel_total : 1398 time to create 1 rle with old method : 0.0016355514526367188 time for calcul the mask position with numpy : 0.012204647064208984 nb_pixel_total : 993 time to create 1 rle with old method : 0.0012977123260498047 time for calcul the mask position with numpy : 0.012653350830078125 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002446174621582031 time for calcul the mask position with numpy : 0.01177978515625 nb_pixel_total : 90 time to create 1 rle with old method : 0.00019025802612304688 time for calcul the mask position with numpy : 0.012604951858520508 nb_pixel_total : 289 time to create 1 rle with old method : 0.00036454200744628906 time for calcul the mask position with numpy : 0.015003442764282227 nb_pixel_total : 96 time to create 1 rle with old method : 0.00013399124145507812 time for calcul the mask position with numpy : 0.010701417922973633 nb_pixel_total : 11 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.011249065399169922 nb_pixel_total : 256 time to create 1 rle with old method : 0.00032067298889160156 time for calcul the mask position with numpy : 0.010754585266113281 nb_pixel_total : 117 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.010643243789672852 nb_pixel_total : 231 time to create 1 rle with old method : 0.00028824806213378906 time for calcul the mask position with numpy : 0.010934591293334961 nb_pixel_total : 245 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.010568380355834961 nb_pixel_total : 271 time to create 1 rle with old method : 0.00034618377685546875 create new chi : 1.966219425201416 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0025703907012939453 batch 1 Loaded 119 chid ids of type : 4230 Number RLEs to save : 11010 TO DO : save crop sub photo not yet done ! save time : 1.269521951675415 nb_obj : 124 nb_hashtags : 6 time to prepare the origin masks : 1.9312224388122559 time for calcul the mask position with numpy : 0.07928037643432617 nb_pixel_total : 1804670 time to create 1 rle with new method : 0.1154944896697998 time for calcul the mask position with numpy : 0.009487390518188477 nb_pixel_total : 60 time to create 1 rle with old method : 0.00011038780212402344 time for calcul the mask position with numpy : 0.011436700820922852 nb_pixel_total : 3030 time to create 1 rle with old method : 0.004173755645751953 time for calcul the mask position with numpy : 0.012852907180786133 nb_pixel_total : 128 time to create 1 rle with old method : 0.00022339820861816406 time for calcul the mask position with numpy : 0.011694908142089844 nb_pixel_total : 2696 time to create 1 rle with old method : 0.0034873485565185547 time for calcul the mask position with numpy : 0.01050257682800293 nb_pixel_total : 77 time to create 1 rle with old method : 0.00014162063598632812 time for calcul the mask position with numpy : 0.010560750961303711 nb_pixel_total : 83 time to create 1 rle with old method : 0.00012922286987304688 time for calcul the mask position with numpy : 0.011301755905151367 nb_pixel_total : 99 time to create 1 rle with old method : 0.0001468658447265625 time for calcul the mask position with numpy : 0.012905359268188477 nb_pixel_total : 88 time to create 1 rle with old method : 0.00018548965454101562 time for calcul the mask position with numpy : 0.010669469833374023 nb_pixel_total : 1507 time to create 1 rle with old method : 0.001828908920288086 time for calcul the mask position with numpy : 0.011255741119384766 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0014388561248779297 time for calcul the mask position with numpy : 0.012011528015136719 nb_pixel_total : 940 time to create 1 rle with old method : 0.0011234283447265625 time for calcul the mask position with numpy : 0.011305570602416992 nb_pixel_total : 27 time to create 1 rle with old method : 8.392333984375e-05 time for calcul the mask position with numpy : 0.011201143264770508 nb_pixel_total : 915 time to create 1 rle with old method : 0.0011162757873535156 time for calcul the mask position with numpy : 0.011667251586914062 nb_pixel_total : 8 time to create 1 rle with old method : 3.886222839355469e-05 time for calcul the mask position with numpy : 0.011121273040771484 nb_pixel_total : 52 time to create 1 rle with old method : 0.00011014938354492188 time for calcul the mask position with numpy : 0.010632038116455078 nb_pixel_total : 21 time to create 1 rle with old method : 8.988380432128906e-05 time for calcul the mask position with numpy : 0.010857105255126953 nb_pixel_total : 724 time to create 1 rle with old method : 0.0009000301361083984 time for calcul the mask position with numpy : 0.010982990264892578 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010080337524414062 time for calcul the mask position with numpy : 0.010841846466064453 nb_pixel_total : 975 time to create 1 rle with old method : 0.0012607574462890625 time for calcul the mask position with numpy : 0.011779308319091797 nb_pixel_total : 705 time to create 1 rle with old method : 0.0012123584747314453 time for calcul the mask position with numpy : 0.011089086532592773 nb_pixel_total : 2771 time to create 1 rle with old method : 0.0031690597534179688 time for calcul the mask position with numpy : 0.011602640151977539 nb_pixel_total : 885 time to create 1 rle with old method : 0.0011806488037109375 time for calcul the mask position with numpy : 0.011955976486206055 nb_pixel_total : 185 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.011091232299804688 nb_pixel_total : 5695 time to create 1 rle with old method : 0.0063953399658203125 time for calcul the mask position with numpy : 0.010627508163452148 nb_pixel_total : 8842 time to create 1 rle with old method : 0.01000213623046875 time for calcul the mask position with numpy : 0.018296003341674805 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002713203430175781 time for calcul the mask position with numpy : 0.013364553451538086 nb_pixel_total : 1177 time to create 1 rle with old method : 0.001615762710571289 time for calcul the mask position with numpy : 0.013305902481079102 nb_pixel_total : 10 time to create 1 rle with old method : 5.984306335449219e-05 time for calcul the mask position with numpy : 0.011577844619750977 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006387233734130859 time for calcul the mask position with numpy : 0.013336658477783203 nb_pixel_total : 38 time to create 1 rle with old method : 0.00010228157043457031 time for calcul the mask position with numpy : 0.013242244720458984 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001552104949951172 time for calcul the mask position with numpy : 0.01266336441040039 nb_pixel_total : 2514 time to create 1 rle with old method : 0.003590106964111328 time for calcul the mask position with numpy : 0.011526346206665039 nb_pixel_total : 1096 time to create 1 rle with old method : 0.0014226436614990234 time for calcul the mask position with numpy : 0.012095928192138672 nb_pixel_total : 6925 time to create 1 rle with old method : 0.007926225662231445 time for calcul the mask position with numpy : 0.012776374816894531 nb_pixel_total : 781 time to create 1 rle with old method : 0.0009684562683105469 time for calcul the mask position with numpy : 0.010870695114135742 nb_pixel_total : 812 time to create 1 rle with old method : 0.0009365081787109375 time for calcul the mask position with numpy : 0.010440587997436523 nb_pixel_total : 9860 time to create 1 rle with old method : 0.01119685173034668 time for calcul the mask position with numpy : 0.01185154914855957 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005166530609130859 time for calcul the mask position with numpy : 0.010725021362304688 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003325939178466797 time for calcul the mask position with numpy : 0.011021137237548828 nb_pixel_total : 20559 time to create 1 rle with old method : 0.023085832595825195 time for calcul the mask position with numpy : 0.011181116104125977 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003254413604736328 time for calcul the mask position with numpy : 0.01160740852355957 nb_pixel_total : 359 time to create 1 rle with old method : 0.00043654441833496094 time for calcul the mask position with numpy : 0.010866403579711914 nb_pixel_total : 86 time to create 1 rle with old method : 0.00011444091796875 time for calcul the mask position with numpy : 0.010473489761352539 nb_pixel_total : 953 time to create 1 rle with old method : 0.0011196136474609375 time for calcul the mask position with numpy : 0.010524272918701172 nb_pixel_total : 90 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.010563373565673828 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005795955657958984 time for calcul the mask position with numpy : 0.011205673217773438 nb_pixel_total : 1842 time to create 1 rle with old method : 0.0024557113647460938 time for calcul the mask position with numpy : 0.010298728942871094 nb_pixel_total : 3061 time to create 1 rle with old method : 0.0035178661346435547 time for calcul the mask position with numpy : 0.010578155517578125 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004398822784423828 time for calcul the mask position with numpy : 0.01098489761352539 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006287097930908203 time for calcul the mask position with numpy : 0.010964393615722656 nb_pixel_total : 49 time to create 1 rle with old method : 9.083747863769531e-05 time for calcul the mask position with numpy : 0.011008739471435547 nb_pixel_total : 160 time to create 1 rle with old method : 0.00021982192993164062 time for calcul the mask position with numpy : 0.010736942291259766 nb_pixel_total : 612 time to create 1 rle with old method : 0.0007147789001464844 time for calcul the mask position with numpy : 0.010673761367797852 nb_pixel_total : 166 time to create 1 rle with old method : 0.00021505355834960938 time for calcul the mask position with numpy : 0.010805606842041016 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.01071476936340332 nb_pixel_total : 256 time to create 1 rle with old method : 0.00033402442932128906 time for calcul the mask position with numpy : 0.010882377624511719 nb_pixel_total : 1779 time to create 1 rle with old method : 0.003082752227783203 time for calcul the mask position with numpy : 0.016160011291503906 nb_pixel_total : 110 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.010844945907592773 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001475811004638672 time for calcul the mask position with numpy : 0.01080942153930664 nb_pixel_total : 242 time to create 1 rle with old method : 0.0004911422729492188 time for calcul the mask position with numpy : 0.010514497756958008 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002906322479248047 time for calcul the mask position with numpy : 0.010422945022583008 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003075599670410156 time for calcul the mask position with numpy : 0.006371974945068359 nb_pixel_total : 850 time to create 1 rle with old method : 0.0010137557983398438 time for calcul the mask position with numpy : 0.006602048873901367 nb_pixel_total : 69 time to create 1 rle with old method : 0.00014972686767578125 time for calcul the mask position with numpy : 0.007649421691894531 nb_pixel_total : 105777 time to create 1 rle with old method : 0.19248080253601074 time for calcul the mask position with numpy : 0.007674217224121094 nb_pixel_total : 658 time to create 1 rle with old method : 0.00130462646484375 time for calcul the mask position with numpy : 0.007503032684326172 nb_pixel_total : 2 time to create 1 rle with old method : 0.00012540817260742188 time for calcul the mask position with numpy : 0.007370948791503906 nb_pixel_total : 169 time to create 1 rle with old method : 0.0003647804260253906 time for calcul the mask position with numpy : 0.0068204402923583984 nb_pixel_total : 253 time to create 1 rle with old method : 0.00035381317138671875 time for calcul the mask position with numpy : 0.006586790084838867 nb_pixel_total : 193 time to create 1 rle with old method : 0.00030159950256347656 time for calcul the mask position with numpy : 0.00871896743774414 nb_pixel_total : 42596 time to create 1 rle with old method : 0.048116445541381836 time for calcul the mask position with numpy : 0.006231546401977539 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003108978271484375 time for calcul the mask position with numpy : 0.0067861080169677734 nb_pixel_total : 288 time to create 1 rle with old method : 0.00043892860412597656 time for calcul the mask position with numpy : 0.006793498992919922 nb_pixel_total : 217 time to create 1 rle with old method : 0.00032901763916015625 time for calcul the mask position with numpy : 0.006852149963378906 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006489753723144531 time for calcul the mask position with numpy : 0.0072667598724365234 nb_pixel_total : 115 time to create 1 rle with old method : 0.00015211105346679688 time for calcul the mask position with numpy : 0.006479024887084961 nb_pixel_total : 213 time to create 1 rle with old method : 0.00026702880859375 time for calcul the mask position with numpy : 0.006406545639038086 nb_pixel_total : 189 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.006409645080566406 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004410743713378906 time for calcul the mask position with numpy : 0.006300449371337891 nb_pixel_total : 317 time to create 1 rle with old method : 0.0003876686096191406 time for calcul the mask position with numpy : 0.0065958499908447266 nb_pixel_total : 2818 time to create 1 rle with old method : 0.0032258033752441406 time for calcul the mask position with numpy : 0.006525993347167969 nb_pixel_total : 629 time to create 1 rle with old method : 0.0007369518280029297 time for calcul the mask position with numpy : 0.006392002105712891 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.006434440612792969 nb_pixel_total : 182 time to create 1 rle with old method : 0.00022983551025390625 time for calcul the mask position with numpy : 0.006433963775634766 nb_pixel_total : 302 time to create 1 rle with old method : 0.0003821849822998047 time for calcul the mask position with numpy : 0.006357431411743164 nb_pixel_total : 84 time to create 1 rle with old method : 0.00011801719665527344 time for calcul the mask position with numpy : 0.0064563751220703125 nb_pixel_total : 919 time to create 1 rle with old method : 0.0011441707611083984 time for calcul the mask position with numpy : 0.0064754486083984375 nb_pixel_total : 355 time to create 1 rle with old method : 0.00042724609375 time for calcul the mask position with numpy : 0.006693601608276367 nb_pixel_total : 328 time to create 1 rle with old method : 0.00040912628173828125 time for calcul the mask position with numpy : 0.006742954254150391 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007543563842773438 time for calcul the mask position with numpy : 0.01173710823059082 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004115104675292969 time for calcul the mask position with numpy : 0.008659601211547852 nb_pixel_total : 2758 time to create 1 rle with old method : 0.004097700119018555 time for calcul the mask position with numpy : 0.007955789566040039 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002989768981933594 time for calcul the mask position with numpy : 0.00787496566772461 nb_pixel_total : 1027 time to create 1 rle with old method : 0.001499176025390625 time for calcul the mask position with numpy : 0.00663447380065918 nb_pixel_total : 987 time to create 1 rle with old method : 0.0012359619140625 time for calcul the mask position with numpy : 0.007216453552246094 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003809928894042969 time for calcul the mask position with numpy : 0.008782625198364258 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004591941833496094 time for calcul the mask position with numpy : 0.009068727493286133 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005350112915039062 time for calcul the mask position with numpy : 0.0077059268951416016 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005559921264648438 time for calcul the mask position with numpy : 0.00794839859008789 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.008436441421508789 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003383159637451172 time for calcul the mask position with numpy : 0.00818490982055664 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001533031463623047 time for calcul the mask position with numpy : 0.007945537567138672 nb_pixel_total : 15 time to create 1 rle with old method : 3.62396240234375e-05 time for calcul the mask position with numpy : 0.007550954818725586 nb_pixel_total : 369 time to create 1 rle with old method : 0.0005717277526855469 time for calcul the mask position with numpy : 0.00747990608215332 nb_pixel_total : 2464 time to create 1 rle with old method : 0.003002166748046875 time for calcul the mask position with numpy : 0.00694727897644043 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005245208740234375 time for calcul the mask position with numpy : 0.007514476776123047 nb_pixel_total : 683 time to create 1 rle with old method : 0.0009777545928955078 time for calcul the mask position with numpy : 0.0077168941497802734 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005135536193847656 time for calcul the mask position with numpy : 0.006857395172119141 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005431175231933594 time for calcul the mask position with numpy : 0.0066759586334228516 nb_pixel_total : 148 time to create 1 rle with old method : 0.00020456314086914062 time for calcul the mask position with numpy : 0.00735783576965332 nb_pixel_total : 2388 time to create 1 rle with old method : 0.0034461021423339844 time for calcul the mask position with numpy : 0.008792400360107422 nb_pixel_total : 414 time to create 1 rle with old method : 0.0007126331329345703 time for calcul the mask position with numpy : 0.008161067962646484 nb_pixel_total : 1495 time to create 1 rle with old method : 0.002397298812866211 time for calcul the mask position with numpy : 0.008710622787475586 nb_pixel_total : 27 time to create 1 rle with old method : 0.00017452239990234375 time for calcul the mask position with numpy : 0.008575916290283203 nb_pixel_total : 472 time to create 1 rle with old method : 0.0008039474487304688 time for calcul the mask position with numpy : 0.008485078811645508 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0014886856079101562 time for calcul the mask position with numpy : 0.00884699821472168 nb_pixel_total : 428 time to create 1 rle with old method : 0.0006926059722900391 time for calcul the mask position with numpy : 0.00925755500793457 nb_pixel_total : 309 time to create 1 rle with old method : 0.000514984130859375 time for calcul the mask position with numpy : 0.009196996688842773 nb_pixel_total : 93 time to create 1 rle with old method : 0.00025010108947753906 time for calcul the mask position with numpy : 0.009195089340209961 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001881122589111328 time for calcul the mask position with numpy : 0.009608745574951172 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001628398895263672 time for calcul the mask position with numpy : 0.012564420700073242 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002963542938232422 time for calcul the mask position with numpy : 0.013009071350097656 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005590915679931641 time for calcul the mask position with numpy : 0.012634754180908203 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004451274871826172 create new chi : 1.7975788116455078 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0025408267974853516 batch 1 Loaded 125 chid ids of type : 4230 Number RLEs to save : 11432 TO DO : save crop sub photo not yet done ! save time : 1.0634922981262207 map_output_result : {1339336850: (0.0, 'Should be the crop_list due to order', 0.0), 1339336847: (0.0, 'Should be the crop_list due to order', 0.0), 1339336844: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1339336850, 1339336847, 1339336844] Looping around the photos to save general results len do output : 3 /1339336850.Didn't retrieve data . /1339336847.Didn't retrieve data . /1339336844.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336850', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336847', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336844', None, None, None, None, None, '2609734') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01569223403930664 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.615097045898438 time spend to save output : 0.01635289192199707 total time spend for step 4 : 15.631449937820435 step5:crop_condition Tue Feb 25 01:21:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 366 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 145 About to insert : list_path_to_insert length 145 new photo from crops ! About to upload 145 photos upload in portfolio : 4869462 init cache_photo without model_param we have 145 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740442887_2902661 we have uploaded 145 photos in the portfolio 4869462 time of upload the photos Elapsed time : 40.76650786399841 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 77 About to insert : list_path_to_insert length 77 new photo from crops ! About to upload 77 photos upload in portfolio : 4869462 init cache_photo without model_param we have 77 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740442929_2902661 we have uploaded 77 photos in the portfolio 4869462 time of upload the photos Elapsed time : 21.773452758789062 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740442951_2902661 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.0432500839233398 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740442952_2902661 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.3530571460723877 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 4869462 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740442955_2902661 we have uploaded 30 photos in the portfolio 4869462 time of upload the photos Elapsed time : 9.291136503219604 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1339336850, 1339336847, 1339336844] Looping around the photos to save general results len do output : 263 /1339458833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339458999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339459421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336850', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336847', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336844', None, None, None, None, None, '2609734') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 792 time used for this insertion : 0.07117486000061035 save_final save missing photos in datou_result : time spend for datou_step_exec : 80.74957394599915 time spend to save output : 0.1668224334716797 total time spend for step 5 : 80.91639637947083 step6:thcl Tue Feb 25 01:22:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.011920928955078125 time to convert the images to numpy array : 0.0687859058380127 time to import caffe and check if the image exist : 0.025216341018676758 time to convert the images to numpy array : 0.08495330810546875 time to import caffe and check if the image exist : 0.035643815994262695 time to convert the images to numpy array : 0.07567286491394043 time to import caffe and check if the image exist : 0.03217792510986328 time to convert the images to numpy array : 0.09104442596435547 time to import caffe and check if the image exist : 0.03394627571105957 time to convert the images to numpy array : 0.09487771987915039 time to import caffe and check if the image exist : 0.022336244583129883 time to convert the images to numpy array : 0.11159586906433105 time to import caffe and check if the image exist : 0.022963762283325195 time to convert the images to numpy array : 0.1111605167388916 time to import caffe and check if the image exist : 0.03256487846374512 time to convert the images to numpy array : 0.10265588760375977 time to import caffe and check if the image exist : 0.024487972259521484 time to convert the images to numpy array : 0.11142849922180176 time to import caffe and check if the image exist : 0.05137348175048828 time to convert the images to numpy array : 0.09005594253540039 total time to convert the images to numpy array : 0.5613195896148682 list photo_ids error: [] list photo_ids correct : [1339459401, 1339459402, 1339459403, 1339459404, 1339459405, 1339459407, 1339459408, 1339459409, 1339459410, 1339459411, 1339459412, 1339459413, 1339459414, 1339459415, 1339459416, 1339459417, 1339459418, 1339459419, 1339459420, 1339459421, 1339458887, 1339458888, 1339458889, 1339458890, 1339458891, 1339458892, 1339458893, 1339458894, 1339458895, 1339458896, 1339458897, 1339458898, 1339458899, 1339458900, 1339458901, 1339458902, 1339458903, 1339458904, 1339458905, 1339458906, 1339458907, 1339458908, 1339458909, 1339458910, 1339458911, 1339458912, 1339458913, 1339458941, 1339458942, 1339458943, 1339458944, 1339458945, 1339458946, 1339458947, 1339458948, 1339458949, 1339458950, 1339458951, 1339458952, 1339458953, 1339458954, 1339458955, 1339458956, 1339458957, 1339458958, 1339458959, 1339458960, 1339458961, 1339458962, 1339458963, 1339458964, 1339458965, 1339458966, 1339458967, 1339458995, 1339458996, 1339458997, 1339458998, 1339458999, 1339459001, 1339459002, 1339459003, 1339459004, 1339459005, 1339459006, 1339459007, 1339459008, 1339459009, 1339459010, 1339459011, 1339459012, 1339459013, 1339459014, 1339459015, 1339459016, 1339459017, 1339459018, 1339459019, 1339459020, 1339459021, 1339459022, 1339458968, 1339458969, 1339458970, 1339458971, 1339458972, 1339458973, 1339458974, 1339458975, 1339458976, 1339458977, 1339458978, 1339458979, 1339458980, 1339458981, 1339458982, 1339458983, 1339458984, 1339458985, 1339458986, 1339458987, 1339458988, 1339458989, 1339458990, 1339458991, 1339458992, 1339458993, 1339458994, 1339458833, 1339458834, 1339458835, 1339458836, 1339458837, 1339458838, 1339458839, 1339458840, 1339458841, 1339458842, 1339458843, 1339458844, 1339458845, 1339458846, 1339458847, 1339458848, 1339458849, 1339458850, 1339458851, 1339458852, 1339458853, 1339458854, 1339458855, 1339458856, 1339458857, 1339458858, 1339458859, 1339458914, 1339458915, 1339458916, 1339458917, 1339458918, 1339458919, 1339458920, 1339458921, 1339458922, 1339458923, 1339458924, 1339458925, 1339458926, 1339458927, 1339458928, 1339458929, 1339458930, 1339458931, 1339458932, 1339458933, 1339458934, 1339458935, 1339458936, 1339458937, 1339458938, 1339458939, 1339458940, 1339459050, 1339459051, 1339459052, 1339459053, 1339459054, 1339459055, 1339459056, 1339459057, 1339459058, 1339459061, 1339459062, 1339459063, 1339459064, 1339459065, 1339459066, 1339459067, 1339459068, 1339459364, 1339459367, 1339459370, 1339459374, 1339459378, 1339459382, 1339459386, 1339459390, 1339459394, 1339459398, 1339459023, 1339459024, 1339459025, 1339459026, 1339459027, 1339459028, 1339459029, 1339459030, 1339459031, 1339459032, 1339459033, 1339459034, 1339459035, 1339459036, 1339459037, 1339459038, 1339459039, 1339459040, 1339459041, 1339459042, 1339459043, 1339459044, 1339459045, 1339459046, 1339459047, 1339459048, 1339459049, 1339458860, 1339458861, 1339458862, 1339458863, 1339458864, 1339458865, 1339458866, 1339458867, 1339458868, 1339458869, 1339458870, 1339458871, 1339458872, 1339458873, 1339458874, 1339458875, 1339458876, 1339458877, 1339458878, 1339458879, 1339458880, 1339458881, 1339458882, 1339458883, 1339458884, 1339458885, 1339458886] number of photos to traite : 263 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5857 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5638 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.448516607284546 time used to do the prediction : 1.1002986431121826 save descriptor for thcl : 3237 time to traite the descriptors : 1.5981948375701904 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1339459401 To insert : 1339459402 To insert : 1339459403 To insert : 1339459404 To insert : 1339459405 To insert : 1339459407 To insert : 1339459408 To insert : 1339459409 To insert : 1339459410 To insert : 1339459411 To insert : 1339459412 To insert : 1339459413 To insert : 1339459414 To insert : 1339459415 To insert : 1339459416 To insert : 1339459417 To insert : 1339459418 To insert : 1339459419 To insert : 1339459420 To insert : 1339459421 To insert : 1339458887 To insert : 1339458888 To insert : 1339458889 To insert : 1339458890 To insert : 1339458891 To insert : 1339458892 To insert : 1339458893 To insert : 1339458894 To insert : 1339458895 To insert : 1339458896 To insert : 1339458897 To insert : 1339458898 To insert : 1339458899 To insert : 1339458900 To insert : 1339458901 To insert : 1339458902 To insert : 1339458903 To insert : 1339458904 To insert : 1339458905 To insert : 1339458906 To insert : 1339458907 To insert : 1339458908 To insert : 1339458909 To insert : 1339458910 To insert : 1339458911 To insert : 1339458912 To insert : 1339458913 To insert : 1339458941 To insert : 1339458942 To insert : 1339458943 To insert : 1339458944 To insert : 1339458945 To insert : 1339458946 To insert : 1339458947 To insert : 1339458948 To insert : 1339458949 To insert : 1339458950 To insert : 1339458951 To insert : 1339458952 To insert : 1339458953 To insert : 1339458954 To insert : 1339458955 To insert : 1339458956 To insert : 1339458957 To insert : 1339458958 To insert : 1339458959 To insert : 1339458960 To insert : 1339458961 To insert : 1339458962 To insert : 1339458963 To insert : 1339458964 To insert : 1339458965 To insert : 1339458966 To insert : 1339458967 To insert : 1339458995 To insert : 1339458996 To insert : 1339458997 To insert : 1339458998 To insert : 1339458999 To insert : 1339459001 To insert : 1339459002 To insert : 1339459003 To insert : 1339459004 To insert : 1339459005 To insert : 1339459006 To insert : 1339459007 To insert : 1339459008 To insert : 1339459009 To insert : 1339459010 To insert : 1339459011 To insert : 1339459012 To insert : 1339459013 To insert : 1339459014 To insert : 1339459015 To insert : 1339459016 To insert : 1339459017 To insert : 1339459018 To insert : 1339459019 To insert : 1339459020 To insert : 1339459021 To insert : 1339459022 To insert : 1339458968 To insert : 1339458969 To insert : 1339458970 To insert : 1339458971 To insert : 1339458972 To insert : 1339458973 To insert : 1339458974 To insert : 1339458975 To insert : 1339458976 To insert : 1339458977 To insert : 1339458978 To insert : 1339458979 To insert : 1339458980 To insert : 1339458981 To insert : 1339458982 To insert : 1339458983 To insert : 1339458984 To insert : 1339458985 To insert : 1339458986 To insert : 1339458987 To insert : 1339458988 To insert : 1339458989 To insert : 1339458990 To insert : 1339458991 To insert : 1339458992 To insert : 1339458993 To insert : 1339458994 To insert : 1339458833 To insert : 1339458834 To insert : 1339458835 To insert : 1339458836 To insert : 1339458837 To insert : 1339458838 To insert : 1339458839 To insert : 1339458840 To insert : 1339458841 To insert : 1339458842 To insert : 1339458843 To insert : 1339458844 To insert : 1339458845 To insert : 1339458846 To insert : 1339458847 To insert : 1339458848 To insert : 1339458849 To insert : 1339458850 To insert : 1339458851 To insert : 1339458852 To insert : 1339458853 To insert : 1339458854 To insert : 1339458855 To insert : 1339458856 To insert : 1339458857 To insert : 1339458858 To insert : 1339458859 To insert : 1339458914 To insert : 1339458915 To insert : 1339458916 To insert : 1339458917 To insert : 1339458918 To insert : 1339458919 To insert : 1339458920 To insert : 1339458921 To insert : 1339458922 To insert : 1339458923 To insert : 1339458924 To insert : 1339458925 To insert : 1339458926 To insert : 1339458927 To insert : 1339458928 To insert : 1339458929 To insert : 1339458930 To insert : 1339458931 To insert : 1339458932 To insert : 1339458933 To insert : 1339458934 To insert : 1339458935 To insert : 1339458936 To insert : 1339458937 To insert : 1339458938 To insert : 1339458939 To insert : 1339458940 To insert : 1339459050 To insert : 1339459051 To insert : 1339459052 To insert : 1339459053 To insert : 1339459054 To insert : 1339459055 To insert : 1339459056 To insert : 1339459057 To insert : 1339459058 To insert : 1339459061 To insert : 1339459062 To insert : 1339459063 To insert : 1339459064 To insert : 1339459065 To insert : 1339459066 To insert : 1339459067 To insert : 1339459068 To insert : 1339459364 To insert : 1339459367 To insert : 1339459370 To insert : 1339459374 To insert : 1339459378 To insert : 1339459382 To insert : 1339459386 To insert : 1339459390 To insert : 1339459394 To insert : 1339459398 To insert : 1339459023 To insert : 1339459024 To insert : 1339459025 To insert : 1339459026 To insert : 1339459027 To insert : 1339459028 To insert : 1339459029 To insert : 1339459030 To insert : 1339459031 To insert : 1339459032 To insert : 1339459033 To insert : 1339459034 To insert : 1339459035 To insert : 1339459036 To insert : 1339459037 To insert : 1339459038 To insert : 1339459039 To insert : 1339459040 To insert : 1339459041 To insert : 1339459042 To insert : 1339459043 To insert : 1339459044 To insert : 1339459045 To insert : 1339459046 To insert : 1339459047 To insert : 1339459048 To insert : 1339459049 To insert : 1339458860 To insert : 1339458861 To insert : 1339458862 To insert : 1339458863 To insert : 1339458864 To insert : 1339458865 To insert : 1339458866 To insert : 1339458867 To insert : 1339458868 To insert : 1339458869 To insert : 1339458870 To insert : 1339458871 To insert : 1339458872 To insert : 1339458873 To insert : 1339458874 To insert : 1339458875 To insert : 1339458876 To insert : 1339458877 To insert : 1339458878 To insert : 1339458879 To insert : 1339458880 To insert : 1339458881 To insert : 1339458882 To insert : 1339458883 To insert : 1339458884 To insert : 1339458885 To insert : 1339458886 time to insert the descriptors : 57.252694606781006 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 401 time used for this insertion : 0.030494213104248047 save missing photos in datou_result : time spend for datou_step_exec : 66.30322098731995 time spend to save output : 0.22254657745361328 total time spend for step 6 : 66.52576756477356 step7:ventilate_hashtags_in_portfolio Tue Feb 25 01:23:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20771591 get user id for portfolio 20771591 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771591 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','pehd','mal_croppe','Papier','metal','pet_fonce','PET_clair','pet_clair','environnement','Tetrapak','PET_fonce','PEHD','refus','papier','Carton','Film_plastique','carton')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771591 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','pehd','mal_croppe','Papier','metal','pet_fonce','PET_clair','pet_clair','environnement','Tetrapak','PET_fonce','PEHD','refus','papier','Carton','Film_plastique','carton')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771591 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','pehd','mal_croppe','Papier','metal','pet_fonce','PET_clair','pet_clair','environnement','Tetrapak','PET_fonce','PEHD','refus','papier','Carton','Film_plastique','carton')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771591 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','pehd','mal_croppe','Papier','metal','pet_fonce','PET_clair','pet_clair','environnement','Tetrapak','PET_fonce','PEHD','refus','papier','Carton','Film_plastique','carton')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20785998,20785999,20786010,20786001,20786012,20786003,20786009,20786006,20786007,20786008,20786011,20786015,20786014?tags=autre,flou,pehd,mal_croppe,papier,metal,pet_fonce,pet_clair,environnement,tetrapak,refus,carton,film_plastique&datou_id_consolidate=4235&port_consolidate=20771591 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1339336850, 1339336847, 1339336844] Looping around the photos to save general results len do output : 1 /20771591. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336850', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336847', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336844', None, None, None, None, None, '2609734') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.015856027603149414 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.781301498413086 time spend to save output : 0.016077041625976562 total time spend for step 7 : 2.7973785400390625 step8:final Tue Feb 25 01:23:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1339336850: ('0.23798914132090335',), 1339336847: ('0.23798914132090335',), 1339336844: ('0.23798914132090335',)} new output for save of step final : {1339336850: ('0.23798914132090335',), 1339336847: ('0.23798914132090335',), 1339336844: ('0.23798914132090335',)} [1339336850, 1339336847, 1339336844] Looping around the photos to save general results len do output : 3 /1339336850.Didn't retrieve data . /1339336847.Didn't retrieve data . /1339336844.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336850', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336847', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336844', None, None, None, None, None, '2609734') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.05277085304260254 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.2188127040863037 time spend to save output : 0.05304121971130371 total time spend for step 8 : 0.2718539237976074 step9:velours_tree Tue Feb 25 01:23:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20785998,20785999,20786010,20786001,20786012,20786003,20786009,20786006,20786007,20786008,20786011,20786015,20786014 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20785998 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20785999 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786010 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786001 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786012 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786003 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786009 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786006 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786007 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786008 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786011 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786015 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20786014 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 263 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 0 0 1 5 5 5 1 1 1 0 5 0 5 1 5 5 1 3 5 5 1 5 3 1 0 5 0 1 5 1 1 2 0 2 2 1 0 5 5 1 3 0 0 1 1 5 0 2 0 0 0 0 1 5 5 1 5 5 1 1 1 0 0 5 0 2 5 0 1 3 0 5 5 1 1 1 0 5 1 1 5 3 2 0 2 1 3 5 5 3 2 0 1 1 5 0 0 0 0 1 5 0 0 1 5 1 5 5 1 1 1 0 0 0 5 5 1 1 3 5 5 1 5 1 1 0 1 1 5 1 2 0 2 1 3 5 3 0 0 1 5 1 1 5 4 0 2 1 1 0 1 0 5 2 1 1 5 5 5 0 3 1 2 2 3 5 1 5 3 2 1 4 2 1 0 1 3 1 1 3 2 5 1 1 5 0 1 0 2 3 2 1 5 2 1 0 4 2 0 0 1 1 1 3 5 1 3 1 0 0 1 0 2 3 5 5 3 5 1 1 2 5 5 5 3 1 0 3 1 2 3 1 2 3 3 0 2 3 2 0 2 4 3 1 1 3 2 2 2 5 2 4 4 0 1 1 5 3 2 2 0 5] Elapsed time: 0.052143096923828125 graph_id used : 80167 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20785998,20785999,20786010,20786001,20786012,20786003,20786009,20786006,20786007,20786008,20786011,20786015,20786014?tags=autre,flou,pehd,mal_croppe,papier,metal,pet_fonce,pet_clair,environnement,tetrapak,refus,carton,film_plastique&datou_id_consolidate=4235&port_consolidate=20771591&tree_id=80167 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1339336850, 1339336847, 1339336844] Looping around the photos to save general results len do output : 1 /20771591Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336850', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336847', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336844', None, None, None, None, None, '2609734') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.011892557144165039 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.956160068511963 time spend to save output : 0.012170791625976562 total time spend for step 9 : 26.96833086013794 step10:send_mail_cod Tue Feb 25 01:24:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20771591_25-02-2025_01_24_21.pdf 20785980 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207859801740443061 20785981 imagette207859811740443062 20785992 imagette207859921740443062 20785983 imagette207859831740443062 20785994 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207859941740443062 20785985 change filename to text .change filename to text .change filename to text .imagette207859851740443063 20785991 imagette207859911740443063 20785988 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207859881740443063 20785990 imagette207859901740443064 20785993 imagette207859931740443064 20785997 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207859971740443064 20785996 imagette207859961740443065 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20771591 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20785998,20785999,20786010,20786001,20786012,20786003,20786009,20786006,20786007,20786008,20786011,20786015,20786014?tags=autre,flou,pehd,mal_croppe,papier,metal,pet_fonce,pet_clair,environnement,tetrapak,refus,carton,film_plastique&datou_id_consolidate=4235&port_consolidate=20771591&tree_id=80167 your option no_mail is active, we will not send the real mail to your client args[1339336850] : ((1339336850, -7.744532023709289, 492609224), (1339336850, -0.6979691472729488, 501862349), '0.23798914132090335') We are sending mail with results at cod@fotonower.com args[1339336847] : ((1339336847, -7.749477207235637, 492609224), (1339336847, -0.6877294723961126, 501862349), '0.23798914132090335') We are sending mail with results at cod@fotonower.com args[1339336844] : ((1339336844, -7.741563513429847, 492609224), (1339336844, -0.7029655664042966, 501862349), '0.23798914132090335') We are sending mail with results at cod@fotonower.com refus_total : 0.23798914132090335 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20771591 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771591_25-02-2025_01_24_21.pdf results_Qualipapia_P20771591_25-02-2025_01_24_21.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771591_25-02-2025_01_24_21.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20771591','results_Qualipapia_P20771591_25-02-2025_01_24_21.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771591_25-02-2025_01_24_21.pdf','pdf','','0.16','0.23798914132090335') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1339336850, 1339336847, 1339336844] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336850', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336847', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336844', None, None, None, None, None, '2609734') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01159811019897461 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.431046009063721 time spend to save output : 0.011797189712524414 total time spend for step 10 : 4.442843198776245 step11:split_time_score Tue Feb 25 01:24:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24022025 20771591 Nombre de photos uploadées : 3 / 23040 (0%) 24022025 20771591 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 24022025 20771591 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 9.298324584960938e-06 ??? elapsed_time : fill_and_build_computed_from_old_data 0.000247955322265625 elapsed_time : insert_dashboard_record_day_entry 0.026995182037353516 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.12315286692610344 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20767926_24-02-2025_10_46_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20767926 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20767926 AND mptpi.`type`=4230 To do Qualite : 0.21892176331183677 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769927_25-02-2025_00_42_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769927 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769927 AND mptpi.`type`=4230 To do Qualite : 0.19192157647294192 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769928_24-02-2025_18_28_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769928 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769928 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769929 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769954 order by id desc limit 1 Qualite : 0.19472272069322913 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769955_24-02-2025_18_49_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769955 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769955 AND mptpi.`type`=4230 To do Qualite : 0.23070275987868197 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769956_25-02-2025_00_25_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769956 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769956 AND mptpi.`type`=4230 To do Qualite : 0.23355238148952678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769957_24-02-2025_18_55_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769957 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769957 AND mptpi.`type`=4230 To do Qualite : 0.19014267254990505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769958_24-02-2025_18_58_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769958 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769958 AND mptpi.`type`=4230 To do Qualite : 0.1833836220520911 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769983_24-02-2025_11_54_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769983 AND mptpi.`type`=4230 To do Qualite : 0.19665553106350908 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769984_24-02-2025_19_04_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769984 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769984 AND mptpi.`type`=4230 To do Qualite : 0.23731665410579766 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769985_24-02-2025_19_09_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769985 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769985 AND mptpi.`type`=4230 To do Qualite : 0.21937111169676032 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770547_24-02-2025_19_27_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770547 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770547 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770548 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770549 order by id desc limit 1 Qualite : 0.24072833978030664 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770550_24-02-2025_19_29_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770550 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770550 AND mptpi.`type`=4230 To do Qualite : 0.26387344144222896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770551_24-02-2025_19_32_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770551 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770551 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770552 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770553 order by id desc limit 1 Qualite : 0.23761633948862013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770554_24-02-2025_19_51_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770554 AND mptpi.`type`=4230 To do Qualite : 0.24234203905019133 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770555_24-02-2025_19_53_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770555 AND mptpi.`type`=4230 To do Qualite : 0.2550030691725577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770556_24-02-2025_20_15_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770556 AND mptpi.`type`=4230 To do Qualite : 0.2659923557004906 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770557_24-02-2025_20_07_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770557 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770557 AND mptpi.`type`=4230 To do Qualite : 0.2566031289772565 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771583_24-02-2025_20_13_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771583 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771583 AND mptpi.`type`=4230 To do Qualite : 0.2517094312879323 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771584_24-02-2025_20_18_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771584 AND mptpi.`type`=4230 To do Qualite : 0.18206223173915434 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771585_24-02-2025_20_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771585 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771585 AND mptpi.`type`=4230 To do Qualite : 0.23170815627849364 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771586_24-02-2025_20_27_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771586 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771586 AND mptpi.`type`=4230 To do Qualite : 0.25060066983533874 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771587_24-02-2025_20_34_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771587 AND mptpi.`type`=4230 To do Qualite : 0.2234444741551309 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771588_24-02-2025_20_38_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771588 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771588 AND mptpi.`type`=4230 To do Qualite : 0.24085128737355288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771589_24-02-2025_20_42_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771589 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771589 AND mptpi.`type`=4230 To do Qualite : 0.24404525214605174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771590_24-02-2025_20_56_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771590 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771590 AND mptpi.`type`=4230 To do Qualite : 0.23798914132090335 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771591_25-02-2025_01_24_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771591 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771591 AND mptpi.`type`=4230 To do Qualite : 0.2522572261957997 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771592_24-02-2025_21_06_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771592 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771592 AND mptpi.`type`=4230 To do Qualite : 0.2618522302441174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771593_24-02-2025_21_23_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771593 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771593 AND mptpi.`type`=4230 To do Qualite : 0.1806515155344998 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771594_24-02-2025_21_08_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771594 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771594 AND mptpi.`type`=4230 To do Qualite : 0.223188931033508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771595_24-02-2025_21_14_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771595 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771595 AND mptpi.`type`=4230 To do Qualite : 0.24013689870139143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771596_24-02-2025_12_48_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771596 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771596 AND mptpi.`type`=4230 To do Qualite : 0.21094636630514205 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771597_24-02-2025_12_33_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771597 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771597 AND mptpi.`type`=4230 To do Qualite : 0.24428012235668636 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771917_25-02-2025_00_50_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771917 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771917 AND mptpi.`type`=4230 To do Qualite : 0.2472142555454651 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771918_24-02-2025_15_49_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771918 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771918 AND mptpi.`type`=4230 To do Qualite : 0.2654924659269221 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771919_24-02-2025_14_50_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771919 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771919 AND mptpi.`type`=4230 To do Qualite : 0.24347313754946903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771920_24-02-2025_13_48_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771920 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771920 AND mptpi.`type`=4230 To do Qualite : 0.25477322572762684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771921_24-02-2025_13_42_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771921 AND mptpi.`type`=4230 To do Qualite : 0.2725419720648553 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774301_24-02-2025_21_38_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774301 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774301 AND mptpi.`type`=4230 To do Qualite : 0.2738987733388131 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774302_24-02-2025_21_38_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774302 AND mptpi.`type`=4230 To do Qualite : 0.295029482856265 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774303_24-02-2025_21_43_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774303 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774303 AND mptpi.`type`=4230 To do Qualite : 0.2909567315969779 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774304_24-02-2025_21_48_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774304 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774304 AND mptpi.`type`=4230 To do Qualite : 0.2842256248784778 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774305_24-02-2025_21_52_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774305 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774305 AND mptpi.`type`=4230 To do Qualite : 0.25955467649661085 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774306_24-02-2025_23_35_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774306 AND mptpi.`type`=4230 To do Qualite : 0.2599699209407511 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774307_24-02-2025_22_03_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774307 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774307 AND mptpi.`type`=4230 To do Qualite : 0.2567509423977914 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774308_24-02-2025_22_16_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774308 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774308 AND mptpi.`type`=4230 To do Qualite : 0.24870082571435193 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774309_25-02-2025_00_31_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774309 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774309 AND mptpi.`type`=4230 To do Qualite : 0.2676575485774257 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774310_24-02-2025_22_18_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774310 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774310 AND mptpi.`type`=4230 To do Qualite : 0.2739560737899723 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774311_24-02-2025_22_46_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774311 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774311 AND mptpi.`type`=4230 To do Qualite : 0.3156235099448955 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774312_24-02-2025_22_27_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774312 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774312 AND mptpi.`type`=4230 To do Qualite : 0.2128553944159406 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774313_24-02-2025_22_33_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774313 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774313 AND mptpi.`type`=4230 To do Qualite : 0.264903576070096 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774314_24-02-2025_23_50_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774314 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774314 AND mptpi.`type`=4230 To do Qualite : 0.2472664761991023 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774807_24-02-2025_23_27_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774807 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774807 AND mptpi.`type`=4230 To do Qualite : 0.23886260387248692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774808_24-02-2025_23_23_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774808 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774808 AND mptpi.`type`=4230 To do Qualite : 0.22512550723363015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774809_24-02-2025_16_32_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774809 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774809 AND mptpi.`type`=4230 To do Qualite : 0.2676980827896467 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774811_24-02-2025_16_17_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774811 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774811 AND mptpi.`type`=4230 To do Qualite : 0.2779446430507002 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776130_24-02-2025_22_52_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776130 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776130 AND mptpi.`type`=4230 To do Qualite : 0.23778536716945162 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776132_24-02-2025_23_24_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776132 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776132 AND mptpi.`type`=4230 To do Qualite : 0.2740202887306019 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776134_24-02-2025_17_34_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776134 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776134 AND mptpi.`type`=4230 To do Qualite : 0.14478572315220764 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776137_24-02-2025_21_47_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776137 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776137 AND mptpi.`type`=4230 To do Qualite : 0.15452677325102562 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776139_24-02-2025_16_50_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776139 AND mptpi.`type`=4230 To do Qualite : 0.26795604366198006 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20778556_24-02-2025_17_47_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20778556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20778556 AND mptpi.`type`=4230 To do Qualite : 0.2344766697681388 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779166 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779166 AND mptpi.`type`=4230 To do Qualite : 0.2406676044211381 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779167_24-02-2025_20_41_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779167 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779167 AND mptpi.`type`=4230 To do Qualite : 0.1845385493439375 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779168_24-02-2025_18_36_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779168 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779168 AND mptpi.`type`=4230 To do Qualite : 0.19892543137470436 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779169 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779169 AND mptpi.`type`=4230 To do Qualite : 0.22153100249252605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779170_24-02-2025_18_17_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779170 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779170 AND mptpi.`type`=4230 To do Qualite : 0.19899965223646818 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779577_24-02-2025_19_32_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779577 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779577 AND mptpi.`type`=4230 To do Qualite : 0.20246425862176948 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779578_24-02-2025_19_53_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779578 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779578 AND mptpi.`type`=4230 To do Qualite : 0.2461702807893893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779579_24-02-2025_18_48_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779579 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779579 AND mptpi.`type`=4230 To do Qualite : 0.19850863879984906 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779993_24-02-2025_19_23_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779993 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24022025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1339336850, 1339336847, 1339336844] Looping around the photos to save general results len do output : 1 /20771591Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336850', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336847', None, None, None, None, None, '2609734') ('4234', None, None, None, None, None, None, None, '2609734') ('4234', '20771591', '1339336844', None, None, None, None, None, '2609734') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013272762298583984 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.760620594024658 time spend to save output : 0.013548135757446289 total time spend for step 11 : 10.774168729782104 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 49.06user 31.94system 4:12.15elapsed 32%CPU (0avgtext+0avgdata 2518604maxresident)k 2098584inputs+19616outputs (7684major+3521877minor)pagefaults 0swaps