python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 640275 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2588611'] with mtr_portfolio_ids : ['20567468'] and first list_photo_ids : [] new path : /proc/640275/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.28717613220214844 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 15 11:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-15 11:20:33.197289: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-15 11:20:33.223215: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-15 11:20:33.225276: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f986c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-15 11:20:33.225323: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-15 11:20:33.228895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-15 11:20:33.546465: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x242629d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-15 11:20:33.546510: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-15 11:20:33.547488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 11:20:33.547756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 11:20:33.549595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 11:20:33.551417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 11:20:33.551786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 11:20:33.553808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 11:20:33.554848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 11:20:33.558911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 11:20:33.560487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 11:20:33.560562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 11:20:33.561353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-15 11:20:33.561370: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-15 11:20:33.561382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-15 11:20:33.562971: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-15 11:20:33.856047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 11:20:33.856173: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 11:20:33.856196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 11:20:33.856215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 11:20:33.856234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 11:20:33.856252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 11:20:33.856271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 11:20:33.856290: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 11:20:33.857847: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 11:20:33.859534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 11:20:33.859687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 11:20:33.859720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 11:20:33.859748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 11:20:33.859776: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 11:20:33.859804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 11:20:33.859831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 11:20:33.859859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 11:20:33.862053: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 11:20:33.862106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-15 11:20:33.862123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-15 11:20:33.862136: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-15 11:20:33.864357: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-15 11:20:40.142173: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 11:20:40.304188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.31719 max: 147.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.0017466545104980469 length of segment : 41 time for calcul the mask position with numpy : 0.00037932395935058594 nb_pixel_total : 21041 time to create 1 rle with old method : 0.03420448303222656 length of segment : 181 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 56 time to create 1 rle with old method : 0.00012230873107910156 length of segment : 27 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001742839813232422 length of segment : 30 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 50 time to create 1 rle with old method : 0.00013256072998046875 length of segment : 4 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00018739700317382812 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.50078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0006830692291259766 length of segment : 38 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 646 time to create 1 rle with old method : 0.0011031627655029297 length of segment : 47 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 12 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 50 time to create 1 rle with old method : 0.00016188621520996094 length of segment : 11 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0014986991882324219 length of segment : 39 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 42 time to create 1 rle with old method : 8.678436279296875e-05 length of segment : 6 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 993 time to create 1 rle with old method : 0.0012242794036865234 length of segment : 93 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006492137908935547 length of segment : 32 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1775 time to create 1 rle with old method : 0.0021550655364990234 length of segment : 43 length of segment : 0 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1829 time to create 1 rle with old method : 0.002201080322265625 length of segment : 110 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1499 time to create 1 rle with old method : 0.002628803253173828 length of segment : 56 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 1726 time to create 1 rle with old method : 0.002966165542602539 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.06328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 5896 time to create 1 rle with old method : 0.006866455078125 length of segment : 127 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 44 time to create 1 rle with old method : 0.00010418891906738281 length of segment : 6 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 2474 time to create 1 rle with old method : 0.0030481815338134766 length of segment : 102 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.00043582916259765625 length of segment : 10 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0010466575622558594 length of segment : 59 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00030922889709472656 length of segment : 25 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0004096031188964844 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0004451274871826172 length of segment : 17 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 971 time to create 1 rle with old method : 0.0012905597686767578 length of segment : 50 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 9124 time to create 1 rle with old method : 0.010330438613891602 length of segment : 131 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0008263587951660156 length of segment : 83 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006847381591796875 length of segment : 75 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0006389617919921875 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003154277801513672 length of segment : 18 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.96719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.000637054443359375 length of segment : 18 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005784034729003906 length of segment : 16 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2994 time to create 1 rle with old method : 0.0037195682525634766 length of segment : 103 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 203.00000 molded_images shape: (1, 640, 640, 3) min: -85.76641 max: 73.97734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.11016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 2685 time to create 1 rle with old method : 0.003233671188354492 length of segment : 47 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006508827209472656 length of segment : 29 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00021505355834960938 length of segment : 22 time for calcul the mask position with numpy : 0.0001323223114013672 nb_pixel_total : 6668 time to create 1 rle with old method : 0.007650136947631836 length of segment : 127 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1409 time to create 1 rle with old method : 0.00174713134765625 length of segment : 37 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1506 time to create 1 rle with old method : 0.0019838809967041016 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009696483612060547 length of segment : 57 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 764 time to create 1 rle with old method : 0.0011763572692871094 length of segment : 17 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00043082237243652344 length of segment : 18 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00034236907958984375 length of segment : 21 time for calcul the mask position with numpy : 0.0002593994140625 nb_pixel_total : 12326 time to create 1 rle with old method : 0.0144500732421875 length of segment : 178 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 15 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.00048279762268066406 length of segment : 25 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015163421630859375 length of segment : 14 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004363059997558594 length of segment : 30 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.00079345703125 length of segment : 20 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 675 time to create 1 rle with old method : 0.0007624626159667969 length of segment : 29 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0004558563232421875 length of segment : 19 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.00047135353088378906 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.15313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0011005401611328125 length of segment : 143 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1288 time to create 1 rle with old method : 0.001512289047241211 length of segment : 39 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.001155853271484375 length of segment : 35 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 21694 time to create 1 rle with old method : 0.024253368377685547 length of segment : 324 time for calcul the mask position with numpy : 0.00020742416381835938 nb_pixel_total : 4491 time to create 1 rle with old method : 0.0055065155029296875 length of segment : 211 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 963 time to create 1 rle with old method : 0.0015823841094970703 length of segment : 97 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0010035037994384766 length of segment : 37 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 6945 time to create 1 rle with old method : 0.00789189338684082 length of segment : 225 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1088 time to create 1 rle with old method : 0.0012965202331542969 length of segment : 65 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1294 time to create 1 rle with old method : 0.0015368461608886719 length of segment : 55 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1539 time to create 1 rle with old method : 0.001958608627319336 length of segment : 40 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 3345 time to create 1 rle with old method : 0.0038955211639404297 length of segment : 275 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1612 time to create 1 rle with old method : 0.0019032955169677734 length of segment : 78 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004467964172363281 length of segment : 37 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1683 time to create 1 rle with old method : 0.0021347999572753906 length of segment : 42 time for calcul the mask position with numpy : 0.00022220611572265625 nb_pixel_total : 4248 time to create 1 rle with old method : 0.004860639572143555 length of segment : 231 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 3241 time to create 1 rle with old method : 0.0036749839782714844 length of segment : 163 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 3327 time to create 1 rle with old method : 0.004018545150756836 length of segment : 87 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0013713836669921875 length of segment : 120 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.001033782958984375 length of segment : 65 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 3996 time to create 1 rle with old method : 0.0048065185546875 length of segment : 216 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 192.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 65.68047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.00046062469482421875 length of segment : 44 time for calcul the mask position with numpy : 0.0009496212005615234 nb_pixel_total : 106824 time to create 1 rle with old method : 0.11559414863586426 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.06484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 3473 time to create 1 rle with old method : 0.004113197326660156 length of segment : 59 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.000331878662109375 length of segment : 27 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 926 time to create 1 rle with old method : 0.0011951923370361328 length of segment : 35 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 2157 time to create 1 rle with old method : 0.0027518272399902344 length of segment : 84 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1757 time to create 1 rle with old method : 0.0022568702697753906 length of segment : 43 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 2207 time to create 1 rle with old method : 0.0026476383209228516 length of segment : 83 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.00043082237243652344 length of segment : 18 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 628 time to create 1 rle with old method : 0.0008134841918945312 length of segment : 43 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.0010402202606201172 length of segment : 43 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009005069732666016 length of segment : 65 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006456375122070312 length of segment : 27 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 1778 time to create 1 rle with old method : 0.0024840831756591797 length of segment : 50 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002841949462890625 length of segment : 18 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 10 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.00041604042053222656 length of segment : 17 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 746 time to create 1 rle with old method : 0.00095367431640625 length of segment : 64 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002865791320800781 length of segment : 15 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0004124641418457031 length of segment : 26 time for calcul the mask position with numpy : 0.00013828277587890625 nb_pixel_total : 1672 time to create 1 rle with old method : 0.002214670181274414 length of segment : 53 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00037288665771484375 length of segment : 16 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003139972686767578 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 54 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004341602325439453 length of segment : 19 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00036072731018066406 length of segment : 14 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005362033843994141 length of segment : 23 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00043964385986328125 length of segment : 21 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004467964172363281 length of segment : 35 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004076957702636719 length of segment : 23 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0005793571472167969 length of segment : 29 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002143383026123047 length of segment : 19 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00028967857360839844 length of segment : 22 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 690 time to create 1 rle with old method : 0.0008494853973388672 length of segment : 47 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001804828643798828 length of segment : 19 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002465248107910156 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00034236907958984375 length of segment : 16 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006864070892333984 length of segment : 44 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007116794586181641 length of segment : 28 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005137920379638672 length of segment : 32 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.00047588348388671875 length of segment : 20 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1211 time to create 1 rle with old method : 0.0016016960144042969 length of segment : 35 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1491 time to create 1 rle with old method : 0.001786947250366211 length of segment : 77 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.00046753883361816406 length of segment : 23 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1700 time to create 1 rle with old method : 0.00209808349609375 length of segment : 55 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 731 time to create 1 rle with old method : 0.0009236335754394531 length of segment : 42 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 2138 time to create 1 rle with old method : 0.002674579620361328 length of segment : 46 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1761 time to create 1 rle with old method : 0.0021805763244628906 length of segment : 72 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00011730194091796875 length of segment : 12 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 51 time to create 1 rle with old method : 0.00010776519775390625 length of segment : 6 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006830692291259766 length of segment : 27 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005927085876464844 length of segment : 23 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 13 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 912 time to create 1 rle with old method : 0.0011827945709228516 length of segment : 31 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.00041985511779785156 length of segment : 15 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00022721290588378906 length of segment : 17 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004448890686035156 length of segment : 25 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004343986511230469 length of segment : 18 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1132 time to create 1 rle with old method : 0.001325845718383789 length of segment : 62 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00023651123046875 length of segment : 8 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004699230194091797 length of segment : 25 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1388 time to create 1 rle with old method : 0.0017609596252441406 length of segment : 43 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00025653839111328125 length of segment : 18 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0017216205596923828 length of segment : 43 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 665 time to create 1 rle with old method : 0.0008821487426757812 length of segment : 43 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005857944488525391 length of segment : 28 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0010275840759277344 length of segment : 35 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00011301040649414062 length of segment : 11 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.00044536590576171875 length of segment : 24 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007152557373046875 length of segment : 32 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00022411346435546875 length of segment : 18 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010666847229003906 length of segment : 35 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007693767547607422 length of segment : 24 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005517005920410156 length of segment : 23 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1793 time to create 1 rle with old method : 0.00206756591796875 length of segment : 90 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002887248992919922 length of segment : 17 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00023293495178222656 length of segment : 17 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004391670227050781 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1378 time to create 1 rle with old method : 0.0017042160034179688 length of segment : 62 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.00038909912109375 length of segment : 21 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002770423889160156 length of segment : 28 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 8 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 32 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006551742553710938 length of segment : 27 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 3269 time to create 1 rle with old method : 0.003918647766113281 length of segment : 105 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00026035308837890625 length of segment : 15 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.78594 max: 145.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 893 time to create 1 rle with old method : 0.001653909683227539 length of segment : 35 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001819133758544922 length of segment : 29 time for calcul the mask position with numpy : 0.00031113624572753906 nb_pixel_total : 10469 time to create 1 rle with old method : 0.022164344787597656 length of segment : 186 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 39 time to create 1 rle with old method : 0.00011730194091796875 length of segment : 3 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 881 time to create 1 rle with old method : 0.0011322498321533203 length of segment : 32 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00019121170043945312 length of segment : 34 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001704692840576172 length of segment : 30 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1332 time to create 1 rle with old method : 0.0017638206481933594 length of segment : 71 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.11016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 801 time to create 1 rle with old method : 0.0010533332824707031 length of segment : 28 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 2072 time to create 1 rle with old method : 0.002566814422607422 length of segment : 44 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00029277801513671875 length of segment : 15 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0013837814331054688 length of segment : 40 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1215 time to create 1 rle with old method : 0.0015516281127929688 length of segment : 87 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006859302520751953 length of segment : 32 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2796 time to create 1 rle with old method : 0.0034782886505126953 length of segment : 52 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1587 time to create 1 rle with old method : 0.0019025802612304688 length of segment : 50 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1572 time to create 1 rle with old method : 0.0018222332000732422 length of segment : 68 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.00044798851013183594 length of segment : 22 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1709 time to create 1 rle with old method : 0.002125978469848633 length of segment : 89 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1833 time to create 1 rle with old method : 0.0021827220916748047 length of segment : 85 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1255 time to create 1 rle with old method : 0.001585245132446289 length of segment : 32 time for calcul the mask position with numpy : 2.574920654296875e-05 nb_pixel_total : 28 time to create 1 rle with old method : 6.103515625e-05 length of segment : 4 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0005040168762207031 length of segment : 26 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1590 time to create 1 rle with old method : 0.0018649101257324219 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.11406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 6523 time to create 1 rle with old method : 0.007189512252807617 length of segment : 123 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006773471832275391 length of segment : 21 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001404285430908203 length of segment : 9 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0004000663757324219 length of segment : 10 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0005123615264892578 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.13359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003173351287841797 length of segment : 16 time for calcul the mask position with numpy : 0.0001392364501953125 nb_pixel_total : 8364 time to create 1 rle with old method : 0.009751319885253906 length of segment : 143 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1014 time to create 1 rle with old method : 0.001238107681274414 length of segment : 54 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 749 time to create 1 rle with old method : 0.0009243488311767578 length of segment : 82 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.00030303001403808594 length of segment : 19 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.0008757114410400391 length of segment : 73 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0006501674652099609 length of segment : 23 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0006096363067626953 length of segment : 25 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.26797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004923343658447266 length of segment : 16 time for calcul the mask position with numpy : 0.0001690387725830078 nb_pixel_total : 7219 time to create 1 rle with old method : 0.007840156555175781 length of segment : 173 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 203.00000 molded_images shape: (1, 640, 640, 3) min: -84.34453 max: 76.10234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.72344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 2824 time to create 1 rle with old method : 0.0035562515258789062 length of segment : 47 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 30 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1257 time to create 1 rle with old method : 0.001642465591430664 length of segment : 32 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00020956993103027344 length of segment : 22 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 5302 time to create 1 rle with old method : 0.006275653839111328 length of segment : 157 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1021 time to create 1 rle with old method : 0.0012307167053222656 length of segment : 59 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0012974739074707031 length of segment : 40 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 1194 time to create 1 rle with old method : 0.0016107559204101562 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.41094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1297 time to create 1 rle with old method : 0.0016825199127197266 length of segment : 32 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001475811004638672 length of segment : 17 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005557537078857422 length of segment : 21 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 703 time to create 1 rle with old method : 0.0008893013000488281 length of segment : 30 time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 10224 time to create 1 rle with old method : 0.011151313781738281 length of segment : 224 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 3338 time to create 1 rle with old method : 0.004045724868774414 length of segment : 264 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00042176246643066406 length of segment : 15 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0004742145538330078 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.64141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 1409 time to create 1 rle with old method : 0.0018186569213867188 length of segment : 117 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 990 time to create 1 rle with old method : 0.0014050006866455078 length of segment : 36 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 871 time to create 1 rle with old method : 0.0012259483337402344 length of segment : 24 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0016090869903564453 length of segment : 42 time for calcul the mask position with numpy : 0.0005125999450683594 nb_pixel_total : 29301 time to create 1 rle with old method : 0.03285813331604004 length of segment : 363 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003173351287841797 length of segment : 24 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0018384456634521484 length of segment : 69 time for calcul the mask position with numpy : 0.00020194053649902344 nb_pixel_total : 4033 time to create 1 rle with old method : 0.004979848861694336 length of segment : 180 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.0009267330169677734 length of segment : 38 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 872 time to create 1 rle with old method : 0.0011246204376220703 length of segment : 23 time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 4982 time to create 1 rle with old method : 0.005646228790283203 length of segment : 178 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1159 time to create 1 rle with old method : 0.001390218734741211 length of segment : 54 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1814 time to create 1 rle with old method : 0.0021181106567382812 length of segment : 86 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.0011091232299804688 length of segment : 37 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0009329319000244141 length of segment : 42 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1670 time to create 1 rle with old method : 0.002064228057861328 length of segment : 39 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 1434 time to create 1 rle with old method : 0.0018024444580078125 length of segment : 152 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 2431 time to create 1 rle with old method : 0.002851247787475586 length of segment : 164 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1753 time to create 1 rle with old method : 0.0021796226501464844 length of segment : 41 time for calcul the mask position with numpy : 0.00014519691467285156 nb_pixel_total : 2660 time to create 1 rle with old method : 0.0029599666595458984 length of segment : 162 time for calcul the mask position with numpy : 0.0001399517059326172 nb_pixel_total : 2832 time to create 1 rle with old method : 0.003200531005859375 length of segment : 171 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 74.65313 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008809566497802734 nb_pixel_total : 106372 time to create 1 rle with old method : 0.10969853401184082 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 3596 time to create 1 rle with old method : 0.004030942916870117 length of segment : 62 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 957 time to create 1 rle with old method : 0.0011398792266845703 length of segment : 35 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 2199 time to create 1 rle with old method : 0.002509593963623047 length of segment : 68 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1838 time to create 1 rle with old method : 0.002237558364868164 length of segment : 83 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.0008370876312255859 length of segment : 63 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1660 time to create 1 rle with old method : 0.002098560333251953 length of segment : 50 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 2378 time to create 1 rle with old method : 0.002678394317626953 length of segment : 86 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 601 time to create 1 rle with old method : 0.0007004737854003906 length of segment : 44 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 838 time to create 1 rle with old method : 0.0009257793426513672 length of segment : 47 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005800724029541016 length of segment : 27 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00022172927856445312 length of segment : 23 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.00025463104248046875 length of segment : 17 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00033545494079589844 length of segment : 24 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0007340908050537109 length of segment : 28 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00034880638122558594 length of segment : 15 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019598007202148438 length of segment : 12 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001327991485595703 length of segment : 11 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005214214324951172 length of segment : 26 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005733966827392578 length of segment : 19 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003268718719482422 length of segment : 25 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007624626159667969 length of segment : 30 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003952980041503906 length of segment : 19 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 19 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005550384521484375 length of segment : 21 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 55 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00011324882507324219 length of segment : 11 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00028324127197265625 length of segment : 15 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005221366882324219 length of segment : 23 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00036406517028808594 length of segment : 29 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.00027489662170410156 length of segment : 20 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.00022792816162109375 length of segment : 18 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0014986991882324219 length of segment : 55 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.00047135353088378906 length of segment : 24 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 2196 time to create 1 rle with old method : 0.0025081634521484375 length of segment : 45 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 684 time to create 1 rle with old method : 0.0007882118225097656 length of segment : 47 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00038552284240722656 length of segment : 19 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.00024366378784179688 length of segment : 18 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005080699920654297 length of segment : 19 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1125 time to create 1 rle with old method : 0.0013921260833740234 length of segment : 40 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 4402 time to create 1 rle with old method : 0.0052301883697509766 length of segment : 101 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005557537078857422 length of segment : 28 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003609657287597656 length of segment : 33 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006840229034423828 length of segment : 28 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005257129669189453 length of segment : 24 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00021314620971679688 length of segment : 19 time for calcul the mask position with numpy : 2.6941299438476562e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00020003318786621094 length of segment : 17 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004477500915527344 length of segment : 16 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.00048160552978515625 length of segment : 33 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.00041675567626953125 length of segment : 25 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1636 time to create 1 rle with old method : 0.0017728805541992188 length of segment : 66 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1659 time to create 1 rle with old method : 0.0019397735595703125 length of segment : 90 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 910 time to create 1 rle with old method : 0.0010058879852294922 length of segment : 38 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00013685226440429688 length of segment : 11 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00029158592224121094 length of segment : 12 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0007669925689697266 length of segment : 45 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0010066032409667969 length of segment : 30 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00024199485778808594 length of segment : 16 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 728 time to create 1 rle with old method : 0.0008761882781982422 length of segment : 51 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.00039315223693847656 length of segment : 19 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1277 time to create 1 rle with old method : 0.0014493465423583984 length of segment : 41 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.00045013427734375 length of segment : 21 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005438327789306641 length of segment : 32 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1596 time to create 1 rle with old method : 0.0017592906951904297 length of segment : 63 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007274150848388672 length of segment : 22 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0009961128234863281 length of segment : 37 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003304481506347656 length of segment : 29 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1978 time to create 1 rle with old method : 0.0021164417266845703 length of segment : 92 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005061626434326172 length of segment : 28 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005724430084228516 length of segment : 32 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0006153583526611328 length of segment : 28 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.0010378360748291016 length of segment : 32 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00019669532775878906 length of segment : 17 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 1162 time to create 1 rle with old method : 0.0014331340789794922 length of segment : 36 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.00026035308837890625 length of segment : 18 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004642009735107422 length of segment : 23 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007259845733642578 length of segment : 35 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 21 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005135536193847656 length of segment : 27 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1382 time to create 1 rle with old method : 0.0015120506286621094 length of segment : 70 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.81875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 1605 time to create 1 rle with old method : 0.0026657581329345703 length of segment : 66 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002486705780029297 length of segment : 29 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006330013275146484 length of segment : 24 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002894401550292969 length of segment : 24 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.000347137451171875 length of segment : 22 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001990795135498047 length of segment : 8 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 20 time to create 1 rle with old method : 5.054473876953125e-05 length of segment : 4 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0004935264587402344 length of segment : 33 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 39127 time to create 1 rle with old method : 0.041409969329833984 length of segment : 262 Detection mask done ! Trying to reset tf kernel 640935 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5297 tf kernel not reseted sub process len(results) : 326 len(list_Values) 326 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 326 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10586 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 326 chid ids of type : 4228 Number RLEs to save : 16555 save missing photos in datou_result : time spend for datou_step_exec : 21.924328804016113 time spend to save output : 3.5394153594970703 total time spend for step 1 : 25.463744163513184 step2:brightness Sat Feb 15 11:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739614830_640275_1337666828_b87cc1f38d7dfd494abf0071d230d7c9.jpg treat image : temp/1739614830_640275_1337666820_40d3c3cfd57a0deab1299cac0dfeff9c.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.011568069458007812 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.012138605117797852 save missing photos in datou_result : time spend for datou_step_exec : 0.5089237689971924 time spend to save output : 0.0285036563873291 total time spend for step 2 : 0.5374274253845215 step3:blur_detection Sat Feb 15 11:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739614830_640275_1337666828_b87cc1f38d7dfd494abf0071d230d7c9.jpg resize: (1080, 1920) 1337666828 -7.769215147773252 treat image : temp/1739614830_640275_1337666820_40d3c3cfd57a0deab1299cac0dfeff9c.jpg resize: (1080, 1920) 1337666820 -7.757312430429466 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.011499643325805664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.011101245880126953 save missing photos in datou_result : time spend for datou_step_exec : 1.5566980838775635 time spend to save output : 0.027277231216430664 total time spend for step 3 : 1.5839753150939941 step4:rle_unique_nms_with_priority Sat Feb 15 11:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 326 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 160 nb_hashtags : 8 time to prepare the origin masks : 1.0694658756256104 time for calcul the mask position with numpy : 0.02819228172302246 nb_pixel_total : 1778521 time to create 1 rle with new method : 0.05295276641845703 time for calcul the mask position with numpy : 0.00815272331237793 nb_pixel_total : 2474 time to create 1 rle with old method : 0.0026733875274658203 time for calcul the mask position with numpy : 0.007925033569335938 nb_pixel_total : 769 time to create 1 rle with old method : 0.0008387565612792969 time for calcul the mask position with numpy : 0.008238792419433594 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.007865428924560547 nb_pixel_total : 646 time to create 1 rle with old method : 0.0007557868957519531 time for calcul the mask position with numpy : 0.008120059967041016 nb_pixel_total : 56 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.007842063903808594 nb_pixel_total : 944 time to create 1 rle with old method : 0.0009970664978027344 time for calcul the mask position with numpy : 0.008056640625 nb_pixel_total : 369 time to create 1 rle with old method : 0.00041174888610839844 time for calcul the mask position with numpy : 0.00798797607421875 nb_pixel_total : 29 time to create 1 rle with old method : 4.363059997558594e-05 time for calcul the mask position with numpy : 0.008139371871948242 nb_pixel_total : 50 time to create 1 rle with old method : 7.295608520507812e-05 time for calcul the mask position with numpy : 0.007881879806518555 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002205371856689453 time for calcul the mask position with numpy : 0.007970571517944336 nb_pixel_total : 50 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.007883071899414062 nb_pixel_total : 1775 time to create 1 rle with old method : 0.0020296573638916016 time for calcul the mask position with numpy : 0.007991790771484375 nb_pixel_total : 42 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.008085966110229492 nb_pixel_total : 44 time to create 1 rle with old method : 6.175041198730469e-05 time for calcul the mask position with numpy : 0.008165121078491211 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0013659000396728516 time for calcul the mask position with numpy : 0.008128166198730469 nb_pixel_total : 142 time to create 1 rle with old method : 0.00017309188842773438 time for calcul the mask position with numpy : 0.007953405380249023 nb_pixel_total : 21041 time to create 1 rle with old method : 0.022352933883666992 time for calcul the mask position with numpy : 0.00794219970703125 nb_pixel_total : 966 time to create 1 rle with old method : 0.0010340213775634766 time for calcul the mask position with numpy : 0.008222579956054688 nb_pixel_total : 655 time to create 1 rle with old method : 0.0007550716400146484 time for calcul the mask position with numpy : 0.007987737655639648 nb_pixel_total : 11 time to create 1 rle with old method : 2.5272369384765625e-05 time for calcul the mask position with numpy : 0.00780487060546875 nb_pixel_total : 252 time to create 1 rle with old method : 0.00027251243591308594 time for calcul the mask position with numpy : 0.0077915191650390625 nb_pixel_total : 525 time to create 1 rle with old method : 0.0005846023559570312 time for calcul the mask position with numpy : 0.008194208145141602 nb_pixel_total : 252 time to create 1 rle with old method : 0.00029349327087402344 time for calcul the mask position with numpy : 0.007719755172729492 nb_pixel_total : 26 time to create 1 rle with old method : 5.555152893066406e-05 time for calcul the mask position with numpy : 0.007893085479736328 nb_pixel_total : 225 time to create 1 rle with old method : 0.00024437904357910156 time for calcul the mask position with numpy : 0.007668733596801758 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.007687091827392578 nb_pixel_total : 397 time to create 1 rle with old method : 0.0004222393035888672 time for calcul the mask position with numpy : 0.0076465606689453125 nb_pixel_total : 1471 time to create 1 rle with old method : 0.001537322998046875 time for calcul the mask position with numpy : 0.007626771926879883 nb_pixel_total : 993 time to create 1 rle with old method : 0.0010554790496826172 time for calcul the mask position with numpy : 0.0076558589935302734 nb_pixel_total : 1829 time to create 1 rle with old method : 0.001981496810913086 time for calcul the mask position with numpy : 0.007688999176025391 nb_pixel_total : 5896 time to create 1 rle with old method : 0.0059278011322021484 time for calcul the mask position with numpy : 0.0076982975006103516 nb_pixel_total : 9124 time to create 1 rle with old method : 0.00915217399597168 time for calcul the mask position with numpy : 0.007677555084228516 nb_pixel_total : 2994 time to create 1 rle with old method : 0.0031816959381103516 time for calcul the mask position with numpy : 0.007679939270019531 nb_pixel_total : 461 time to create 1 rle with old method : 0.0004930496215820312 time for calcul the mask position with numpy : 0.007690906524658203 nb_pixel_total : 27 time to create 1 rle with old method : 5.221366882324219e-05 time for calcul the mask position with numpy : 0.007676839828491211 nb_pixel_total : 4491 time to create 1 rle with old method : 0.005024909973144531 time for calcul the mask position with numpy : 0.007879495620727539 nb_pixel_total : 499 time to create 1 rle with old method : 0.0005719661712646484 time for calcul the mask position with numpy : 0.007685661315917969 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005335807800292969 time for calcul the mask position with numpy : 0.007852315902709961 nb_pixel_total : 675 time to create 1 rle with old method : 0.0007750988006591797 time for calcul the mask position with numpy : 0.00794076919555664 nb_pixel_total : 840 time to create 1 rle with old method : 0.0009593963623046875 time for calcul the mask position with numpy : 0.007899999618530273 nb_pixel_total : 12172 time to create 1 rle with old method : 0.01305079460144043 time for calcul the mask position with numpy : 0.0077283382415771484 nb_pixel_total : 764 time to create 1 rle with old method : 0.0008733272552490234 time for calcul the mask position with numpy : 0.007689952850341797 nb_pixel_total : 1288 time to create 1 rle with old method : 0.001394510269165039 time for calcul the mask position with numpy : 0.007674455642700195 nb_pixel_total : 21621 time to create 1 rle with old method : 0.021593570709228516 time for calcul the mask position with numpy : 0.007693052291870117 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002353191375732422 time for calcul the mask position with numpy : 0.007657766342163086 nb_pixel_total : 1088 time to create 1 rle with old method : 0.0011327266693115234 time for calcul the mask position with numpy : 0.007676362991333008 nb_pixel_total : 1539 time to create 1 rle with old method : 0.0015592575073242188 time for calcul the mask position with numpy : 0.007673978805541992 nb_pixel_total : 6668 time to create 1 rle with old method : 0.0068683624267578125 time for calcul the mask position with numpy : 0.007983922958374023 nb_pixel_total : 324 time to create 1 rle with old method : 0.00037932395935058594 time for calcul the mask position with numpy : 0.007973432540893555 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0011124610900878906 time for calcul the mask position with numpy : 0.00785207748413086 nb_pixel_total : 4248 time to create 1 rle with old method : 0.004429340362548828 time for calcul the mask position with numpy : 0.007940053939819336 nb_pixel_total : 6865 time to create 1 rle with old method : 0.006880998611450195 time for calcul the mask position with numpy : 0.007893800735473633 nb_pixel_total : 256 time to create 1 rle with old method : 0.00030159950256347656 time for calcul the mask position with numpy : 0.007885217666625977 nb_pixel_total : 116 time to create 1 rle with old method : 0.00017380714416503906 time for calcul the mask position with numpy : 0.0076541900634765625 nb_pixel_total : 840 time to create 1 rle with old method : 0.0008862018585205078 time for calcul the mask position with numpy : 0.007693767547607422 nb_pixel_total : 790 time to create 1 rle with old method : 0.0008678436279296875 time for calcul the mask position with numpy : 0.0076313018798828125 nb_pixel_total : 3345 time to create 1 rle with old method : 0.0036721229553222656 time for calcul the mask position with numpy : 0.0076825618743896484 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.007685661315917969 nb_pixel_total : 3327 time to create 1 rle with old method : 0.003351449966430664 time for calcul the mask position with numpy : 0.00767970085144043 nb_pixel_total : 1294 time to create 1 rle with old method : 0.0013577938079833984 time for calcul the mask position with numpy : 0.007706165313720703 nb_pixel_total : 90 time to create 1 rle with old method : 0.00010776519775390625 time for calcul the mask position with numpy : 0.007727384567260742 nb_pixel_total : 455 time to create 1 rle with old method : 0.0004887580871582031 time for calcul the mask position with numpy : 0.0076999664306640625 nb_pixel_total : 2685 time to create 1 rle with old method : 0.002798318862915039 time for calcul the mask position with numpy : 0.007693767547607422 nb_pixel_total : 779 time to create 1 rle with old method : 0.0008504390716552734 time for calcul the mask position with numpy : 0.0076906681060791016 nb_pixel_total : 1612 time to create 1 rle with old method : 0.0017206668853759766 time for calcul the mask position with numpy : 0.007727146148681641 nb_pixel_total : 359 time to create 1 rle with old method : 0.0003991127014160156 time for calcul the mask position with numpy : 0.00782465934753418 nb_pixel_total : 1409 time to create 1 rle with old method : 0.0015022754669189453 time for calcul the mask position with numpy : 0.007824897766113281 nb_pixel_total : 143 time to create 1 rle with old method : 0.00018835067749023438 time for calcul the mask position with numpy : 0.007718086242675781 nb_pixel_total : 152 time to create 1 rle with old method : 0.00015974044799804688 time for calcul the mask position with numpy : 0.007711887359619141 nb_pixel_total : 255 time to create 1 rle with old method : 0.0002663135528564453 time for calcul the mask position with numpy : 0.007765054702758789 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003197193145751953 time for calcul the mask position with numpy : 0.007719755172729492 nb_pixel_total : 24 time to create 1 rle with old method : 4.887580871582031e-05 time for calcul the mask position with numpy : 0.007653951644897461 nb_pixel_total : 188 time to create 1 rle with old method : 0.00020647048950195312 time for calcul the mask position with numpy : 0.00771784782409668 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.0077054500579833984 nb_pixel_total : 31 time to create 1 rle with old method : 6.127357482910156e-05 time for calcul the mask position with numpy : 0.00806117057800293 nb_pixel_total : 106489 time to create 1 rle with old method : 0.10735511779785156 time for calcul the mask position with numpy : 0.0077326297760009766 nb_pixel_total : 628 time to create 1 rle with old method : 0.0006771087646484375 time for calcul the mask position with numpy : 0.007649898529052734 nb_pixel_total : 328 time to create 1 rle with old method : 0.00039315223693847656 time for calcul the mask position with numpy : 0.007682323455810547 nb_pixel_total : 2207 time to create 1 rle with old method : 0.002305746078491211 time for calcul the mask position with numpy : 0.007696866989135742 nb_pixel_total : 3473 time to create 1 rle with old method : 0.003621816635131836 time for calcul the mask position with numpy : 0.007708549499511719 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003123283386230469 time for calcul the mask position with numpy : 0.007679939270019531 nb_pixel_total : 150 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.011840105056762695 nb_pixel_total : 2 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.010184288024902344 nb_pixel_total : 51 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.007918834686279297 nb_pixel_total : 211 time to create 1 rle with old method : 0.00026488304138183594 time for calcul the mask position with numpy : 0.007858037948608398 nb_pixel_total : 104 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.007915019989013672 nb_pixel_total : 1700 time to create 1 rle with old method : 0.002366781234741211 time for calcul the mask position with numpy : 0.011051416397094727 nb_pixel_total : 215 time to create 1 rle with old method : 0.000370025634765625 time for calcul the mask position with numpy : 0.01045370101928711 nb_pixel_total : 926 time to create 1 rle with old method : 0.0010895729064941406 time for calcul the mask position with numpy : 0.007941961288452148 nb_pixel_total : 1761 time to create 1 rle with old method : 0.0018496513366699219 time for calcul the mask position with numpy : 0.008283853530883789 nb_pixel_total : 250 time to create 1 rle with old method : 0.0002894401550292969 time for calcul the mask position with numpy : 0.008243799209594727 nb_pixel_total : 5 time to create 1 rle with old method : 1.430511474609375e-05 time for calcul the mask position with numpy : 0.008115291595458984 nb_pixel_total : 136 time to create 1 rle with old method : 0.00015807151794433594 time for calcul the mask position with numpy : 0.008286714553833008 nb_pixel_total : 91 time to create 1 rle with old method : 0.00011181831359863281 time for calcul the mask position with numpy : 0.008324146270751953 nb_pixel_total : 229 time to create 1 rle with old method : 0.00026154518127441406 time for calcul the mask position with numpy : 0.008066654205322266 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005390644073486328 time for calcul the mask position with numpy : 0.008037567138671875 nb_pixel_total : 594 time to create 1 rle with old method : 0.0008771419525146484 time for calcul the mask position with numpy : 0.008074522018432617 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006606578826904297 time for calcul the mask position with numpy : 0.008122682571411133 nb_pixel_total : 544 time to create 1 rle with old method : 0.0005872249603271484 time for calcul the mask position with numpy : 0.008093595504760742 nb_pixel_total : 247 time to create 1 rle with old method : 0.00030684471130371094 time for calcul the mask position with numpy : 0.007788896560668945 nb_pixel_total : 1757 time to create 1 rle with old method : 0.0017752647399902344 time for calcul the mask position with numpy : 0.008104085922241211 nb_pixel_total : 1211 time to create 1 rle with old method : 0.0013167858123779297 time for calcul the mask position with numpy : 0.007994651794433594 nb_pixel_total : 807 time to create 1 rle with old method : 0.0008275508880615234 time for calcul the mask position with numpy : 0.007701396942138672 nb_pixel_total : 64 time to create 1 rle with old method : 8.320808410644531e-05 time for calcul the mask position with numpy : 0.008062124252319336 nb_pixel_total : 332 time to create 1 rle with old method : 0.0003838539123535156 time for calcul the mask position with numpy : 0.008117437362670898 nb_pixel_total : 36 time to create 1 rle with old method : 7.390975952148438e-05 time for calcul the mask position with numpy : 0.007929325103759766 nb_pixel_total : 690 time to create 1 rle with old method : 0.0007154941558837891 time for calcul the mask position with numpy : 0.008197784423828125 nb_pixel_total : 816 time to create 1 rle with old method : 0.0008480548858642578 time for calcul the mask position with numpy : 0.008067607879638672 nb_pixel_total : 912 time to create 1 rle with old method : 0.0009894371032714844 time for calcul the mask position with numpy : 0.007931947708129883 nb_pixel_total : 153 time to create 1 rle with old method : 0.0001652240753173828 time for calcul the mask position with numpy : 0.007850885391235352 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003364086151123047 time for calcul the mask position with numpy : 0.007693767547607422 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003254413604736328 time for calcul the mask position with numpy : 0.008149385452270508 nb_pixel_total : 665 time to create 1 rle with old method : 0.0007038116455078125 time for calcul the mask position with numpy : 0.008089303970336914 nb_pixel_total : 210 time to create 1 rle with old method : 0.00029087066650390625 time for calcul the mask position with numpy : 0.008371353149414062 nb_pixel_total : 1714 time to create 1 rle with old method : 0.0019528865814208984 time for calcul the mask position with numpy : 0.008366584777832031 nb_pixel_total : 2157 time to create 1 rle with old method : 0.0023698806762695312 time for calcul the mask position with numpy : 0.008375167846679688 nb_pixel_total : 110 time to create 1 rle with old method : 0.00014448165893554688 time for calcul the mask position with numpy : 0.008148908615112305 nb_pixel_total : 157 time to create 1 rle with old method : 0.00018715858459472656 time for calcul the mask position with numpy : 0.008148193359375 nb_pixel_total : 1120 time to create 1 rle with old method : 0.001257181167602539 time for calcul the mask position with numpy : 0.007926702499389648 nb_pixel_total : 491 time to create 1 rle with old method : 0.0005252361297607422 time for calcul the mask position with numpy : 0.007748126983642578 nb_pixel_total : 37 time to create 1 rle with old method : 4.935264587402344e-05 time for calcul the mask position with numpy : 0.009571552276611328 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002243518829345703 time for calcul the mask position with numpy : 0.007901430130004883 nb_pixel_total : 271 time to create 1 rle with old method : 0.00030493736267089844 time for calcul the mask position with numpy : 0.008042335510253906 nb_pixel_total : 169 time to create 1 rle with old method : 0.00020170211791992188 time for calcul the mask position with numpy : 0.00796818733215332 nb_pixel_total : 317 time to create 1 rle with old method : 0.00034546852111816406 time for calcul the mask position with numpy : 0.007846355438232422 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005173683166503906 time for calcul the mask position with numpy : 0.0077359676361083984 nb_pixel_total : 238 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.007744312286376953 nb_pixel_total : 2737 time to create 1 rle with old method : 0.00298309326171875 time for calcul the mask position with numpy : 0.007960319519042969 nb_pixel_total : 108 time to create 1 rle with old method : 0.00016236305236816406 time for calcul the mask position with numpy : 0.008234500885009766 nb_pixel_total : 682 time to create 1 rle with old method : 0.0007944107055664062 time for calcul the mask position with numpy : 0.008374452590942383 nb_pixel_total : 177 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.00813150405883789 nb_pixel_total : 191 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.008060216903686523 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004119873046875 time for calcul the mask position with numpy : 0.008206367492675781 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004551410675048828 time for calcul the mask position with numpy : 0.008360624313354492 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004181861877441406 time for calcul the mask position with numpy : 0.008283853530883789 nb_pixel_total : 297 time to create 1 rle with old method : 0.00038170814514160156 time for calcul the mask position with numpy : 0.008365631103515625 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002415180206298828 time for calcul the mask position with numpy : 0.008248090744018555 nb_pixel_total : 6 time to create 1 rle with old method : 1.811981201171875e-05 time for calcul the mask position with numpy : 0.007904529571533203 nb_pixel_total : 152 time to create 1 rle with old method : 0.0001685619354248047 time for calcul the mask position with numpy : 0.00822591781616211 nb_pixel_total : 1378 time to create 1 rle with old method : 0.0014622211456298828 time for calcul the mask position with numpy : 0.008074283599853516 nb_pixel_total : 1491 time to create 1 rle with old method : 0.0016398429870605469 time for calcul the mask position with numpy : 0.00925302505493164 nb_pixel_total : 288 time to create 1 rle with old method : 0.0006058216094970703 time for calcul the mask position with numpy : 0.012782096862792969 nb_pixel_total : 731 time to create 1 rle with old method : 0.0010025501251220703 time for calcul the mask position with numpy : 0.009106636047363281 nb_pixel_total : 311 time to create 1 rle with old method : 0.00033974647521972656 time for calcul the mask position with numpy : 0.008112668991088867 nb_pixel_total : 552 time to create 1 rle with old method : 0.0005834102630615234 time for calcul the mask position with numpy : 0.008118867874145508 nb_pixel_total : 385 time to create 1 rle with old method : 0.00040340423583984375 time for calcul the mask position with numpy : 0.007873058319091797 nb_pixel_total : 335 time to create 1 rle with old method : 0.0003986358642578125 time for calcul the mask position with numpy : 0.008208274841308594 nb_pixel_total : 435 time to create 1 rle with old method : 0.0005061626434326172 time for calcul the mask position with numpy : 0.007922887802124023 nb_pixel_total : 21 time to create 1 rle with old method : 5.364418029785156e-05 time for calcul the mask position with numpy : 0.00822758674621582 nb_pixel_total : 1385 time to create 1 rle with old method : 0.001569986343383789 time for calcul the mask position with numpy : 0.008290767669677734 nb_pixel_total : 2138 time to create 1 rle with old method : 0.0023097991943359375 time for calcul the mask position with numpy : 0.008318901062011719 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006134510040283203 time for calcul the mask position with numpy : 0.008383035659790039 nb_pixel_total : 33 time to create 1 rle with old method : 6.175041198730469e-05 time for calcul the mask position with numpy : 0.008056402206420898 nb_pixel_total : 390 time to create 1 rle with old method : 0.00041031837463378906 time for calcul the mask position with numpy : 0.008234500885009766 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003161430358886719 time for calcul the mask position with numpy : 0.00812387466430664 nb_pixel_total : 121 time to create 1 rle with old method : 0.00016069412231445312 time for calcul the mask position with numpy : 0.008322715759277344 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005626678466796875 time for calcul the mask position with numpy : 0.008433341979980469 nb_pixel_total : 342 time to create 1 rle with old method : 0.00038123130798339844 time for calcul the mask position with numpy : 0.008106470108032227 nb_pixel_total : 420 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.008049249649047852 nb_pixel_total : 133 time to create 1 rle with old method : 0.00016164779663085938 create new chi : 1.6907603740692139 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.007015705108642578 batch 1 Loaded 161 chid ids of type : 4230 Number RLEs to save : 15504 TO DO : save crop sub photo not yet done ! save time : 0.8918328285217285 nb_obj : 164 nb_hashtags : 7 time to prepare the origin masks : 2.680588960647583 time for calcul the mask position with numpy : 0.044480323791503906 nb_pixel_total : 1738388 time to create 1 rle with new method : 0.10514473915100098 time for calcul the mask position with numpy : 0.006458759307861328 nb_pixel_total : 7219 time to create 1 rle with old method : 0.007970094680786133 time for calcul the mask position with numpy : 0.006337642669677734 nb_pixel_total : 2796 time to create 1 rle with old method : 0.0030694007873535156 time for calcul the mask position with numpy : 0.006458759307861328 nb_pixel_total : 331 time to create 1 rle with old method : 0.00039839744567871094 time for calcul the mask position with numpy : 0.006414175033569336 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003833770751953125 time for calcul the mask position with numpy : 0.006512641906738281 nb_pixel_total : 801 time to create 1 rle with old method : 0.0009367465972900391 time for calcul the mask position with numpy : 0.006372213363647461 nb_pixel_total : 893 time to create 1 rle with old method : 0.0010421276092529297 time for calcul the mask position with numpy : 0.006323337554931641 nb_pixel_total : 86 time to create 1 rle with old method : 0.00012493133544921875 time for calcul the mask position with numpy : 0.0063266754150390625 nb_pixel_total : 17 time to create 1 rle with old method : 4.887580871582031e-05 time for calcul the mask position with numpy : 0.006433010101318359 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0012977123260498047 time for calcul the mask position with numpy : 0.006619691848754883 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002493858337402344 time for calcul the mask position with numpy : 0.006951570510864258 nb_pixel_total : 108 time to create 1 rle with old method : 0.00015592575073242188 time for calcul the mask position with numpy : 0.006739377975463867 nb_pixel_total : 49 time to create 1 rle with old method : 0.00011277198791503906 time for calcul the mask position with numpy : 0.006353855133056641 nb_pixel_total : 1332 time to create 1 rle with old method : 0.001592397689819336 time for calcul the mask position with numpy : 0.006226539611816406 nb_pixel_total : 39 time to create 1 rle with old method : 6.341934204101562e-05 time for calcul the mask position with numpy : 0.006371021270751953 nb_pixel_total : 2072 time to create 1 rle with old method : 0.002382040023803711 time for calcul the mask position with numpy : 0.00671076774597168 nb_pixel_total : 72 time to create 1 rle with old method : 0.00010824203491210938 time for calcul the mask position with numpy : 0.006383657455444336 nb_pixel_total : 1572 time to create 1 rle with old method : 0.0017533302307128906 time for calcul the mask position with numpy : 0.006148815155029297 nb_pixel_total : 28 time to create 1 rle with old method : 4.982948303222656e-05 time for calcul the mask position with numpy : 0.006169795989990234 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.010690450668334961 nb_pixel_total : 956 time to create 1 rle with old method : 0.0010454654693603516 time for calcul the mask position with numpy : 0.010354042053222656 nb_pixel_total : 10469 time to create 1 rle with old method : 0.011469602584838867 time for calcul the mask position with numpy : 0.013629674911499023 nb_pixel_total : 749 time to create 1 rle with old method : 0.0008766651153564453 time for calcul the mask position with numpy : 0.011013507843017578 nb_pixel_total : 31 time to create 1 rle with old method : 6.890296936035156e-05 time for calcul the mask position with numpy : 0.01065683364868164 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003108978271484375 time for calcul the mask position with numpy : 0.011746883392333984 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006000995635986328 time for calcul the mask position with numpy : 0.010710954666137695 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.010441303253173828 nb_pixel_total : 518 time to create 1 rle with old method : 0.0005991458892822266 time for calcul the mask position with numpy : 0.010647296905517578 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002722740173339844 time for calcul the mask position with numpy : 0.010587453842163086 nb_pixel_total : 1587 time to create 1 rle with old method : 0.0018270015716552734 time for calcul the mask position with numpy : 0.010067224502563477 nb_pixel_total : 53 time to create 1 rle with old method : 0.00011944770812988281 time for calcul the mask position with numpy : 0.010272979736328125 nb_pixel_total : 404 time to create 1 rle with old method : 0.0004978179931640625 time for calcul the mask position with numpy : 0.010351419448852539 nb_pixel_total : 29 time to create 1 rle with old method : 8.726119995117188e-05 time for calcul the mask position with numpy : 0.010648250579833984 nb_pixel_total : 398 time to create 1 rle with old method : 0.000576019287109375 time for calcul the mask position with numpy : 0.010378599166870117 nb_pixel_total : 1215 time to create 1 rle with old method : 0.0014464855194091797 time for calcul the mask position with numpy : 0.010345458984375 nb_pixel_total : 1709 time to create 1 rle with old method : 0.001995563507080078 time for calcul the mask position with numpy : 0.010381698608398438 nb_pixel_total : 6523 time to create 1 rle with old method : 0.0074176788330078125 time for calcul the mask position with numpy : 0.010509967803955078 nb_pixel_total : 8364 time to create 1 rle with old method : 0.009465456008911133 time for calcul the mask position with numpy : 0.0060880184173583984 nb_pixel_total : 378 time to create 1 rle with old method : 0.00042891502380371094 time for calcul the mask position with numpy : 0.006308794021606445 nb_pixel_total : 4982 time to create 1 rle with old method : 0.005418062210083008 time for calcul the mask position with numpy : 0.006433963775634766 nb_pixel_total : 2861 time to create 1 rle with old method : 0.0037734508514404297 time for calcul the mask position with numpy : 0.006219387054443359 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0014634132385253906 time for calcul the mask position with numpy : 0.006185770034790039 nb_pixel_total : 703 time to create 1 rle with old method : 0.0008990764617919922 time for calcul the mask position with numpy : 0.006230592727661133 nb_pixel_total : 836 time to create 1 rle with old method : 0.0009222030639648438 time for calcul the mask position with numpy : 0.006310224533081055 nb_pixel_total : 9912 time to create 1 rle with old method : 0.011079072952270508 time for calcul the mask position with numpy : 0.006134033203125 nb_pixel_total : 1297 time to create 1 rle with old method : 0.0015435218811035156 time for calcul the mask position with numpy : 0.006090879440307617 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0015044212341308594 time for calcul the mask position with numpy : 0.00618743896484375 nb_pixel_total : 28939 time to create 1 rle with old method : 0.03105616569519043 time for calcul the mask position with numpy : 0.007308006286621094 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.00717616081237793 nb_pixel_total : 721 time to create 1 rle with old method : 0.0010802745819091797 time for calcul the mask position with numpy : 0.007584571838378906 nb_pixel_total : 95 time to create 1 rle with old method : 0.00024199485778808594 time for calcul the mask position with numpy : 0.006424427032470703 nb_pixel_total : 1670 time to create 1 rle with old method : 0.00189208984375 time for calcul the mask position with numpy : 0.006363630294799805 nb_pixel_total : 5302 time to create 1 rle with old method : 0.005988359451293945 time for calcul the mask position with numpy : 0.006465911865234375 nb_pixel_total : 836 time to create 1 rle with old method : 0.0009837150573730469 time for calcul the mask position with numpy : 0.0061054229736328125 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002551078796386719 time for calcul the mask position with numpy : 0.00614619255065918 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005211830139160156 time for calcul the mask position with numpy : 0.006129026412963867 nb_pixel_total : 3335 time to create 1 rle with old method : 0.0038068294525146484 time for calcul the mask position with numpy : 0.006209373474121094 nb_pixel_total : 2431 time to create 1 rle with old method : 0.0027649402618408203 time for calcul the mask position with numpy : 0.006257534027099609 nb_pixel_total : 1409 time to create 1 rle with old method : 0.0016064643859863281 time for calcul the mask position with numpy : 0.00623774528503418 nb_pixel_total : 1159 time to create 1 rle with old method : 0.001285552978515625 time for calcul the mask position with numpy : 0.006399631500244141 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013208389282226562 time for calcul the mask position with numpy : 0.006299734115600586 nb_pixel_total : 1434 time to create 1 rle with old method : 0.0016803741455078125 time for calcul the mask position with numpy : 0.006168365478515625 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005512237548828125 time for calcul the mask position with numpy : 0.0062007904052734375 nb_pixel_total : 2824 time to create 1 rle with old method : 0.0031900405883789062 time for calcul the mask position with numpy : 0.006647825241088867 nb_pixel_total : 990 time to create 1 rle with old method : 0.0018074512481689453 time for calcul the mask position with numpy : 0.007665395736694336 nb_pixel_total : 1021 time to create 1 rle with old method : 0.00183868408203125 time for calcul the mask position with numpy : 0.01036691665649414 nb_pixel_total : 1814 time to create 1 rle with old method : 0.003509998321533203 time for calcul the mask position with numpy : 0.009247303009033203 nb_pixel_total : 1257 time to create 1 rle with old method : 0.0021414756774902344 time for calcul the mask position with numpy : 0.009100675582885742 nb_pixel_total : 219 time to create 1 rle with old method : 0.0005295276641845703 time for calcul the mask position with numpy : 0.007910728454589844 nb_pixel_total : 1004 time to create 1 rle with old method : 0.002139568328857422 time for calcul the mask position with numpy : 0.008517742156982422 nb_pixel_total : 871 time to create 1 rle with old method : 0.001638174057006836 time for calcul the mask position with numpy : 0.008648157119750977 nb_pixel_total : 149 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.006651878356933594 nb_pixel_total : 401 time to create 1 rle with old method : 0.000476837158203125 time for calcul the mask position with numpy : 0.0064389705657958984 nb_pixel_total : 18 time to create 1 rle with old method : 8.487701416015625e-05 time for calcul the mask position with numpy : 0.006383180618286133 nb_pixel_total : 273 time to create 1 rle with old method : 0.00034546852111816406 time for calcul the mask position with numpy : 0.006388187408447266 nb_pixel_total : 53 time to create 1 rle with old method : 0.00010251998901367188 time for calcul the mask position with numpy : 0.007085084915161133 nb_pixel_total : 106372 time to create 1 rle with old method : 0.11385345458984375 time for calcul the mask position with numpy : 0.00627899169921875 nb_pixel_total : 3596 time to create 1 rle with old method : 0.00421452522277832 time for calcul the mask position with numpy : 0.006416797637939453 nb_pixel_total : 601 time to create 1 rle with old method : 0.0007274150848388672 time for calcul the mask position with numpy : 0.006632566452026367 nb_pixel_total : 323 time to create 1 rle with old method : 0.0003924369812011719 time for calcul the mask position with numpy : 0.006511688232421875 nb_pixel_total : 2378 time to create 1 rle with old method : 0.002591371536254883 time for calcul the mask position with numpy : 0.00640559196472168 nb_pixel_total : 31 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.0064890384674072266 nb_pixel_total : 278 time to create 1 rle with old method : 0.00034999847412109375 time for calcul the mask position with numpy : 0.006319284439086914 nb_pixel_total : 1576 time to create 1 rle with old method : 0.0018205642700195312 time for calcul the mask position with numpy : 0.00629734992980957 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002944469451904297 time for calcul the mask position with numpy : 0.006829977035522461 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003113746643066406 time for calcul the mask position with numpy : 0.006474018096923828 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.006369829177856445 nb_pixel_total : 957 time to create 1 rle with old method : 0.0011167526245117188 time for calcul the mask position with numpy : 0.006172895431518555 nb_pixel_total : 1629 time to create 1 rle with old method : 0.0017969608306884766 time for calcul the mask position with numpy : 0.006188392639160156 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002961158752441406 time for calcul the mask position with numpy : 0.0063457489013671875 nb_pixel_total : 272 time to create 1 rle with old method : 0.00031757354736328125 time for calcul the mask position with numpy : 0.006391286849975586 nb_pixel_total : 38706 time to create 1 rle with old method : 0.04153895378112793 time for calcul the mask position with numpy : 0.006794929504394531 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002677440643310547 time for calcul the mask position with numpy : 0.0065877437591552734 nb_pixel_total : 161 time to create 1 rle with old method : 0.00020694732666015625 time for calcul the mask position with numpy : 0.006488323211669922 nb_pixel_total : 89 time to create 1 rle with old method : 0.00012302398681640625 time for calcul the mask position with numpy : 0.006178855895996094 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.007563591003417969 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002536773681640625 time for calcul the mask position with numpy : 0.006554841995239258 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005967617034912109 time for calcul the mask position with numpy : 0.006930112838745117 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004792213439941406 time for calcul the mask position with numpy : 0.006281614303588867 nb_pixel_total : 49 time to create 1 rle with old method : 0.00010585784912109375 time for calcul the mask position with numpy : 0.00620269775390625 nb_pixel_total : 401 time to create 1 rle with old method : 0.0004830360412597656 time for calcul the mask position with numpy : 0.0066356658935546875 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007030963897705078 time for calcul the mask position with numpy : 0.0062258243560791016 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.006157398223876953 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001266002655029297 time for calcul the mask position with numpy : 0.006105661392211914 nb_pixel_total : 2199 time to create 1 rle with old method : 0.0025773048400878906 time for calcul the mask position with numpy : 0.006191253662109375 nb_pixel_total : 838 time to create 1 rle with old method : 0.0009267330169677734 time for calcul the mask position with numpy : 0.006041526794433594 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007288455963134766 time for calcul the mask position with numpy : 0.0060787200927734375 nb_pixel_total : 1125 time to create 1 rle with old method : 0.0013110637664794922 time for calcul the mask position with numpy : 0.0062792301177978516 nb_pixel_total : 284 time to create 1 rle with old method : 0.00034427642822265625 time for calcul the mask position with numpy : 0.00639033317565918 nb_pixel_total : 65 time to create 1 rle with old method : 9.775161743164062e-05 time for calcul the mask position with numpy : 0.006162405014038086 nb_pixel_total : 338 time to create 1 rle with old method : 0.000408172607421875 time for calcul the mask position with numpy : 0.006268739700317383 nb_pixel_total : 1382 time to create 1 rle with old method : 0.0016238689422607422 time for calcul the mask position with numpy : 0.006221294403076172 nb_pixel_total : 684 time to create 1 rle with old method : 0.0007996559143066406 time for calcul the mask position with numpy : 0.006651163101196289 nb_pixel_total : 852 time to create 1 rle with old method : 0.0009534358978271484 time for calcul the mask position with numpy : 0.006164073944091797 nb_pixel_total : 891 time to create 1 rle with old method : 0.0010440349578857422 time for calcul the mask position with numpy : 0.006181955337524414 nb_pixel_total : 390 time to create 1 rle with old method : 0.00045990943908691406 time for calcul the mask position with numpy : 0.006438732147216797 nb_pixel_total : 150 time to create 1 rle with old method : 0.00018978118896484375 time for calcul the mask position with numpy : 0.006482124328613281 nb_pixel_total : 139 time to create 1 rle with old method : 0.00018405914306640625 time for calcul the mask position with numpy : 0.006193637847900391 nb_pixel_total : 303 time to create 1 rle with old method : 0.0003635883331298828 time for calcul the mask position with numpy : 0.006263256072998047 nb_pixel_total : 910 time to create 1 rle with old method : 0.0010166168212890625 time for calcul the mask position with numpy : 0.006510019302368164 nb_pixel_total : 1838 time to create 1 rle with old method : 0.002150297164916992 time for calcul the mask position with numpy : 0.006306886672973633 nb_pixel_total : 1636 time to create 1 rle with old method : 0.0018472671508789062 time for calcul the mask position with numpy : 0.006290435791015625 nb_pixel_total : 1 time to create 1 rle with old method : 2.6464462280273438e-05 time for calcul the mask position with numpy : 0.006293296813964844 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0015208721160888672 time for calcul the mask position with numpy : 0.006433963775634766 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004162788391113281 time for calcul the mask position with numpy : 0.0062389373779296875 nb_pixel_total : 201 time to create 1 rle with old method : 0.00025534629821777344 time for calcul the mask position with numpy : 0.006354808807373047 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003273487091064453 time for calcul the mask position with numpy : 0.006442070007324219 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002391338348388672 time for calcul the mask position with numpy : 0.006223917007446289 nb_pixel_total : 170 time to create 1 rle with old method : 0.00021386146545410156 time for calcul the mask position with numpy : 0.00696253776550293 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007262229919433594 time for calcul the mask position with numpy : 0.006424903869628906 nb_pixel_total : 70 time to create 1 rle with old method : 0.00011897087097167969 time for calcul the mask position with numpy : 0.006455183029174805 nb_pixel_total : 728 time to create 1 rle with old method : 0.0008780956268310547 time for calcul the mask position with numpy : 0.006474971771240234 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008082389831542969 time for calcul the mask position with numpy : 0.006409168243408203 nb_pixel_total : 4392 time to create 1 rle with old method : 0.004759311676025391 time for calcul the mask position with numpy : 0.006215572357177734 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002593994140625 time for calcul the mask position with numpy : 0.0062482357025146484 nb_pixel_total : 702 time to create 1 rle with old method : 0.0008237361907958984 time for calcul the mask position with numpy : 0.006198883056640625 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002155303955078125 time for calcul the mask position with numpy : 0.006179332733154297 nb_pixel_total : 163 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.006173610687255859 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004520416259765625 time for calcul the mask position with numpy : 0.0060977935791015625 nb_pixel_total : 1659 time to create 1 rle with old method : 0.0019025802612304688 time for calcul the mask position with numpy : 0.006171464920043945 nb_pixel_total : 336 time to create 1 rle with old method : 0.0004138946533203125 time for calcul the mask position with numpy : 0.0065174102783203125 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005018711090087891 time for calcul the mask position with numpy : 0.00613713264465332 nb_pixel_total : 20 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.0061724185943603516 nb_pixel_total : 196 time to create 1 rle with old method : 0.00023674964904785156 time for calcul the mask position with numpy : 0.006481170654296875 nb_pixel_total : 145 time to create 1 rle with old method : 0.00019168853759765625 time for calcul the mask position with numpy : 0.006630420684814453 nb_pixel_total : 1605 time to create 1 rle with old method : 0.0018630027770996094 time for calcul the mask position with numpy : 0.0067560672760009766 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006244182586669922 time for calcul the mask position with numpy : 0.006500720977783203 nb_pixel_total : 295 time to create 1 rle with old method : 0.0003619194030761719 time for calcul the mask position with numpy : 0.006398439407348633 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005512237548828125 time for calcul the mask position with numpy : 0.006585836410522461 nb_pixel_total : 399 time to create 1 rle with old method : 0.0004839897155761719 time for calcul the mask position with numpy : 0.00664973258972168 nb_pixel_total : 16 time to create 1 rle with old method : 0.00010037422180175781 time for calcul the mask position with numpy : 0.006696224212646484 nb_pixel_total : 23 time to create 1 rle with old method : 0.00020885467529296875 time for calcul the mask position with numpy : 0.007115602493286133 nb_pixel_total : 1277 time to create 1 rle with old method : 0.0014681816101074219 time for calcul the mask position with numpy : 0.007130861282348633 nb_pixel_total : 397 time to create 1 rle with old method : 0.0004723072052001953 time for calcul the mask position with numpy : 0.006483554840087891 nb_pixel_total : 46 time to create 1 rle with old method : 0.0001049041748046875 time for calcul the mask position with numpy : 0.006167411804199219 nb_pixel_total : 2196 time to create 1 rle with old method : 0.002515077590942383 time for calcul the mask position with numpy : 0.00615382194519043 nb_pixel_total : 9 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.006260395050048828 nb_pixel_total : 397 time to create 1 rle with old method : 0.0004889965057373047 time for calcul the mask position with numpy : 0.006348133087158203 nb_pixel_total : 318 time to create 1 rle with old method : 0.00037980079650878906 time for calcul the mask position with numpy : 0.006081104278564453 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006029605865478516 time for calcul the mask position with numpy : 0.006043910980224609 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005116462707519531 time for calcul the mask position with numpy : 0.006491184234619141 nb_pixel_total : 542 time to create 1 rle with old method : 0.0006902217864990234 time for calcul the mask position with numpy : 0.008267879486083984 nb_pixel_total : 392 time to create 1 rle with old method : 0.0004742145538330078 time for calcul the mask position with numpy : 0.008363723754882812 nb_pixel_total : 192 time to create 1 rle with old method : 0.00024127960205078125 time for calcul the mask position with numpy : 0.008493900299072266 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001590251922607422 create new chi : 1.6932947635650635 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.002239704132080078 batch 1 Loaded 165 chid ids of type : 4230 Number RLEs to save : 16610 TO DO : save crop sub photo not yet done ! save time : 3.3527016639709473 map_output_result : {1337666828: (0.0, 'Should be the crop_list due to order', 0.0), 1337666820: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337666828, 1337666820] Looping around the photos to save general results len do output : 2 /1337666828.Didn't retrieve data . /1337666820.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666828', None, None, None, None, None, '2588611') ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666820', None, None, None, None, None, '2588611') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012234926223754883 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.296561241149902 time spend to save output : 0.012528657913208008 total time spend for step 4 : 12.30908989906311 step5:crop_condition Sat Feb 15 11:21:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 326 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 93 About to insert : list_path_to_insert length 93 new photo from crops ! About to upload 93 photos upload in portfolio : 4869462 init cache_photo without model_param we have 93 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739614872_640275 we have uploaded 93 photos in the portfolio 4869462 time of upload the photos Elapsed time : 28.688463926315308 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 4869462 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739614901_640275 we have uploaded 36 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.88612699508667 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739614909_640275 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.0143747329711914 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739614911_640275 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.61417293548584 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 57 About to insert : list_path_to_insert length 57 new photo from crops ! About to upload 57 photos upload in portfolio : 4869462 init cache_photo without model_param we have 57 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739614914_640275 we have uploaded 57 photos in the portfolio 4869462 time of upload the photos Elapsed time : 22.48102641105652 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739614937_640275 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5309805870056152 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739614938_640275 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.2393999099731445 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337666828, 1337666820] Looping around the photos to save general results len do output : 200 /1337866951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337866999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337867188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666828', None, None, None, None, None, '2588611') ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666820', None, None, None, None, None, '2588611') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 602 time used for this insertion : 0.03540325164794922 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.67996668815613 time spend to save output : 0.0407254695892334 total time spend for step 5 : 68.72069215774536 step6:thcl Sat Feb 15 11:22:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.00699615478515625 time to convert the images to numpy array : 0.04113292694091797 time to import caffe and check if the image exist : 0.011403560638427734 time to convert the images to numpy array : 0.040610551834106445 time to import caffe and check if the image exist : 0.012862443923950195 time to convert the images to numpy array : 0.04024481773376465 time to import caffe and check if the image exist : 0.015079021453857422 time to convert the images to numpy array : 0.04434370994567871 time to import caffe and check if the image exist : 0.01946115493774414 time to convert the images to numpy array : 0.04065132141113281 time to import caffe and check if the image exist : 0.013900041580200195 time to convert the images to numpy array : 0.04687023162841797 time to import caffe and check if the image exist : 0.013434886932373047 time to convert the images to numpy array : 0.05075836181640625 time to import caffe and check if the image exist : 0.01865553855895996 time to convert the images to numpy array : 0.0443570613861084 time to import caffe and check if the image exist : 0.013294696807861328 time to convert the images to numpy array : 0.04981493949890137 time to import caffe and check if the image exist : 0.015372514724731445 time to convert the images to numpy array : 0.0494837760925293 total time to convert the images to numpy array : 0.2732524871826172 list photo_ids error: [] list photo_ids correct : [1337866951, 1337866952, 1337866953, 1337866954, 1337866955, 1337866956, 1337866957, 1337866958, 1337866959, 1337866960, 1337866961, 1337866962, 1337866963, 1337866964, 1337866965, 1337866966, 1337866967, 1337866968, 1337866969, 1337866970, 1337867015, 1337867016, 1337867017, 1337867018, 1337867019, 1337867020, 1337867021, 1337867022, 1337867023, 1337867024, 1337867025, 1337867026, 1337867027, 1337867028, 1337867029, 1337867030, 1337867031, 1337867032, 1337867033, 1337867034, 1337866971, 1337866972, 1337866973, 1337866974, 1337866975, 1337866976, 1337866977, 1337866978, 1337866979, 1337866980, 1337866981, 1337866982, 1337866984, 1337866985, 1337866986, 1337866987, 1337866988, 1337866989, 1337866990, 1337866991, 1337867079, 1337867080, 1337867081, 1337867082, 1337867083, 1337867084, 1337867085, 1337867086, 1337867087, 1337867088, 1337867089, 1337867091, 1337867092, 1337867093, 1337867094, 1337867095, 1337867096, 1337867097, 1337867098, 1337867099, 1337867123, 1337867124, 1337867125, 1337867126, 1337867127, 1337867128, 1337867129, 1337867130, 1337867131, 1337867132, 1337867133, 1337867134, 1337867135, 1337867136, 1337867137, 1337867138, 1337867139, 1337867140, 1337867141, 1337867142, 1337867100, 1337867103, 1337867104, 1337867105, 1337867106, 1337867107, 1337867108, 1337867109, 1337867110, 1337867111, 1337867112, 1337867113, 1337867114, 1337867115, 1337867116, 1337867117, 1337867118, 1337867120, 1337867121, 1337867122, 1337866992, 1337866993, 1337866994, 1337866995, 1337866996, 1337866997, 1337866998, 1337866999, 1337867001, 1337867003, 1337867004, 1337867005, 1337867006, 1337867007, 1337867009, 1337867010, 1337867011, 1337867012, 1337867013, 1337867014, 1337867059, 1337867060, 1337867061, 1337867062, 1337867063, 1337867064, 1337867065, 1337867066, 1337867067, 1337867068, 1337867069, 1337867070, 1337867071, 1337867072, 1337867073, 1337867074, 1337867075, 1337867076, 1337867077, 1337867078, 1337867143, 1337867144, 1337867145, 1337867146, 1337867147, 1337867148, 1337867149, 1337867150, 1337867151, 1337867152, 1337867153, 1337867154, 1337867155, 1337867156, 1337867157, 1337867158, 1337867159, 1337867160, 1337867170, 1337867188, 1337867035, 1337867037, 1337867038, 1337867039, 1337867040, 1337867041, 1337867042, 1337867043, 1337867044, 1337867045, 1337867046, 1337867047, 1337867048, 1337867052, 1337867053, 1337867054, 1337867055, 1337867056, 1337867057, 1337867058] number of photos to traite : 200 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3346 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3127 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.8938276767730713 time used to do the prediction : 0.7223124504089355 save descriptor for thcl : 3237 time to traite the descriptors : 1.217088222503662 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1337866951 To insert : 1337866952 To insert : 1337866953 To insert : 1337866954 To insert : 1337866955 To insert : 1337866956 To insert : 1337866957 To insert : 1337866958 To insert : 1337866959 To insert : 1337866960 To insert : 1337866961 To insert : 1337866962 To insert : 1337866963 To insert : 1337866964 To insert : 1337866965 To insert : 1337866966 To insert : 1337866967 To insert : 1337866968 To insert : 1337866969 To insert : 1337866970 To insert : 1337867015 To insert : 1337867016 To insert : 1337867017 To insert : 1337867018 To insert : 1337867019 To insert : 1337867020 To insert : 1337867021 To insert : 1337867022 To insert : 1337867023 To insert : 1337867024 To insert : 1337867025 To insert : 1337867026 To insert : 1337867027 To insert : 1337867028 To insert : 1337867029 To insert : 1337867030 To insert : 1337867031 To insert : 1337867032 To insert : 1337867033 To insert : 1337867034 To insert : 1337866971 To insert : 1337866972 To insert : 1337866973 To insert : 1337866974 To insert : 1337866975 To insert : 1337866976 To insert : 1337866977 To insert : 1337866978 To insert : 1337866979 To insert : 1337866980 To insert : 1337866981 To insert : 1337866982 To insert : 1337866984 To insert : 1337866985 To insert : 1337866986 To insert : 1337866987 To insert : 1337866988 To insert : 1337866989 To insert : 1337866990 To insert : 1337866991 To insert : 1337867079 To insert : 1337867080 To insert : 1337867081 To insert : 1337867082 To insert : 1337867083 To insert : 1337867084 To insert : 1337867085 To insert : 1337867086 To insert : 1337867087 To insert : 1337867088 To insert : 1337867089 To insert : 1337867091 To insert : 1337867092 To insert : 1337867093 To insert : 1337867094 To insert : 1337867095 To insert : 1337867096 To insert : 1337867097 To insert : 1337867098 To insert : 1337867099 To insert : 1337867123 To insert : 1337867124 To insert : 1337867125 To insert : 1337867126 To insert : 1337867127 To insert : 1337867128 To insert : 1337867129 To insert : 1337867130 To insert : 1337867131 To insert : 1337867132 To insert : 1337867133 To insert : 1337867134 To insert : 1337867135 To insert : 1337867136 To insert : 1337867137 To insert : 1337867138 To insert : 1337867139 To insert : 1337867140 To insert : 1337867141 To insert : 1337867142 To insert : 1337867100 To insert : 1337867103 To insert : 1337867104 To insert : 1337867105 To insert : 1337867106 To insert : 1337867107 To insert : 1337867108 To insert : 1337867109 To insert : 1337867110 To insert : 1337867111 To insert : 1337867112 To insert : 1337867113 To insert : 1337867114 To insert : 1337867115 To insert : 1337867116 To insert : 1337867117 To insert : 1337867118 To insert : 1337867120 To insert : 1337867121 To insert : 1337867122 To insert : 1337866992 To insert : 1337866993 To insert : 1337866994 To insert : 1337866995 To insert : 1337866996 To insert : 1337866997 To insert : 1337866998 To insert : 1337866999 To insert : 1337867001 To insert : 1337867003 To insert : 1337867004 To insert : 1337867005 To insert : 1337867006 To insert : 1337867007 To insert : 1337867009 To insert : 1337867010 To insert : 1337867011 To insert : 1337867012 To insert : 1337867013 To insert : 1337867014 To insert : 1337867059 To insert : 1337867060 To insert : 1337867061 To insert : 1337867062 To insert : 1337867063 To insert : 1337867064 To insert : 1337867065 To insert : 1337867066 To insert : 1337867067 To insert : 1337867068 To insert : 1337867069 To insert : 1337867070 To insert : 1337867071 To insert : 1337867072 To insert : 1337867073 To insert : 1337867074 To insert : 1337867075 To insert : 1337867076 To insert : 1337867077 To insert : 1337867078 To insert : 1337867143 To insert : 1337867144 To insert : 1337867145 To insert : 1337867146 To insert : 1337867147 To insert : 1337867148 To insert : 1337867149 To insert : 1337867150 To insert : 1337867151 To insert : 1337867152 To insert : 1337867153 To insert : 1337867154 To insert : 1337867155 To insert : 1337867156 To insert : 1337867157 To insert : 1337867158 To insert : 1337867159 To insert : 1337867160 To insert : 1337867170 To insert : 1337867188 To insert : 1337867035 To insert : 1337867037 To insert : 1337867038 To insert : 1337867039 To insert : 1337867040 To insert : 1337867041 To insert : 1337867042 To insert : 1337867043 To insert : 1337867044 To insert : 1337867045 To insert : 1337867046 To insert : 1337867047 To insert : 1337867048 To insert : 1337867052 To insert : 1337867053 To insert : 1337867054 To insert : 1337867055 To insert : 1337867056 To insert : 1337867057 To insert : 1337867058 time to insert the descriptors : 42.71082949638367 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 311 time used for this insertion : 0.02594733238220215 save missing photos in datou_result : time spend for datou_step_exec : 49.47392010688782 time spend to save output : 0.07551932334899902 total time spend for step 6 : 49.549439430236816 step7:ventilate_hashtags_in_portfolio Sat Feb 15 11:23:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20567468 get user id for portfolio 20567468 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567468 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Film_plastique','papier','carton','pehd','flou','mal_croppe','PET_fonce','pet_fonce','pet_clair','Tetrapak','Papier','PET_clair','refus','PEHD','Carton','autre','metal')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567468 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Film_plastique','papier','carton','pehd','flou','mal_croppe','PET_fonce','pet_fonce','pet_clair','Tetrapak','Papier','PET_clair','refus','PEHD','Carton','autre','metal')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567468 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Film_plastique','papier','carton','pehd','flou','mal_croppe','PET_fonce','pet_fonce','pet_clair','Tetrapak','Papier','PET_clair','refus','PEHD','Carton','autre','metal')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567468 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Film_plastique','papier','carton','pehd','flou','mal_croppe','PET_fonce','pet_fonce','pet_clair','Tetrapak','Papier','PET_clair','refus','PEHD','Carton','autre','metal')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20585917,20585918,20585928,20585932,20585931,20585922,20585923,20585925,20585929,20585927,20585930,20585933,20585934?tags=environnement,film_plastique,papier,carton,pehd,flou,mal_croppe,pet_fonce,pet_clair,tetrapak,refus,autre,metal&datou_id_consolidate=4235&port_consolidate=20567468 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337666828, 1337666820] Looping around the photos to save general results len do output : 1 /20567468. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666828', None, None, None, None, None, '2588611') ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666820', None, None, None, None, None, '2588611') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012578725814819336 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.5736474990844727 time spend to save output : 0.012846231460571289 total time spend for step 7 : 2.586493730545044 step8:final Sat Feb 15 11:23:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337666828: ('0.2522307679386869',), 1337666820: ('0.2522307679386869',)} new output for save of step final : {1337666828: ('0.2522307679386869',), 1337666820: ('0.2522307679386869',)} [1337666828, 1337666820] Looping around the photos to save general results len do output : 2 /1337666828.Didn't retrieve data . /1337666820.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666828', None, None, None, None, None, '2588611') ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666820', None, None, None, None, None, '2588611') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01173853874206543 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11314082145690918 time spend to save output : 0.011965274810791016 total time spend for step 8 : 0.1251060962677002 step9:velours_tree Sat Feb 15 11:23:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20585917,20585918,20585928,20585932,20585931,20585922,20585923,20585925,20585929,20585927,20585930,20585933,20585934 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585917 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585918 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585928 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585932 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585931 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585922 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585923 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585925 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585929 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585927 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585930 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585933 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585934 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 200 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [3 5 5 3 0 0 0 3 2 0 0 2 2 2 1 0 3 1 1 0 1 1 2 2 2 2 2 1 1 3 2 1 0 2 1 2 5 2 0 2 3 2 3 3 2 3 5 5 5 0 0 0 0 3 2 0 3 0 2 2 0 2 1 2 1 1 0 2 2 2 2 2 1 1 2 2 2 1 1 1 1 1 5 2 3 3 2 2 2 2 5 1 2 4 0 0 2 1 3 0 3 2 1 2 2 2 0 0 1 5 4 0 2 1 2 0 1 2 2 2 2 2 0 3 2 0 0 3 2 2 2 1 1 1 2 0 0 3 1 1 2 2 4 5 3 1 4 0 2 1 1 3 1 2 1 1 2 1 1 1 1 1 1 1 2 1 1 3 1 2 3 3 4 3 3 3 4 2 4 1 0 2 3 1 1 2 1 1 1 1 1 1 2 3 3 4 3 3 0 1] Elapsed time: 0.02847146987915039 graph_id used : 78872 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20585917,20585918,20585928,20585932,20585931,20585922,20585923,20585925,20585929,20585927,20585930,20585933,20585934?tags=environnement,film_plastique,papier,carton,pehd,flou,mal_croppe,pet_fonce,pet_clair,tetrapak,refus,autre,metal&datou_id_consolidate=4235&port_consolidate=20567468&tree_id=78872 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1337666828, 1337666820] Looping around the photos to save general results len do output : 1 /20567468Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666828', None, None, None, None, None, '2588611') ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666820', None, None, None, None, None, '2588611') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012505769729614258 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.589659452438354 time spend to save output : 0.012713909149169922 total time spend for step 9 : 12.602373361587524 step10:send_mail_cod Sat Feb 15 11:23:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20567468_15-02-2025_11_23_24.pdf 20585900 imagette205859001739615004 20585910 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205859101739615004 20585914 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205859141739615005 20585913 change filename to text .imagette205859131739615005 20585904 imagette205859041739615006 20585905 imagette205859051739615006 20585907 change filename to text .imagette205859071739615006 20585911 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205859111739615006 20585909 imagette205859091739615006 20585912 imagette205859121739615006 20585915 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205859151739615006 20585916 change filename to text .change filename to text .change filename to text .imagette205859161739615007 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20567468 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20585917,20585918,20585928,20585932,20585931,20585922,20585923,20585925,20585929,20585927,20585930,20585933,20585934?tags=environnement,film_plastique,papier,carton,pehd,flou,mal_croppe,pet_fonce,pet_clair,tetrapak,refus,autre,metal&datou_id_consolidate=4235&port_consolidate=20567468&tree_id=78872 your option no_mail is active, we will not send the real mail to your client args[1337666828] : ((1337666828, -7.769215147773252, 492609224), (1337666828, -0.48586264021883663, 501862349), '0.2522307679386869') apple ((1337666828, -7.769215147773252, 492609224), (1337666828, -0.48586264021883663, 501862349), '0.2522307679386869') We are sending mail with results at cod@fotonower.com args[1337666820] : ((1337666820, -7.757312430429466, 492609224), (1337666820, -0.45939450850635927, 496442774), '0.2522307679386869') apple ((1337666820, -7.757312430429466, 492609224), (1337666820, -0.45939450850635927, 496442774), '0.2522307679386869') We are sending mail with results at cod@fotonower.com refus_total : 0.2522307679386869 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20567468 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567468_15-02-2025_11_23_24.pdf results_Qualipapia_P20567468_15-02-2025_11_23_24.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567468_15-02-2025_11_23_24.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20567468','results_Qualipapia_P20567468_15-02-2025_11_23_24.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567468_15-02-2025_11_23_24.pdf','pdf','','0.15','0.2522307679386869') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337666828, 1337666820] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666828', None, None, None, None, None, '2588611') ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666820', None, None, None, None, None, '2588611') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.011877059936523438 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.511451005935669 time spend to save output : 0.01209259033203125 total time spend for step 10 : 4.5235435962677 step11:split_time_score Sat Feb 15 11:23:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14022025 20567468 Nombre de photos uploadées : 2 / 23040 (0%) 14022025 20567468 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 14022025 20567468 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 2.2649765014648438e-05 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00024175643920898438 elapsed_time : insert_dashboard_record_day_entry 0.024734973907470703 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14080265003567735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20557267_14-02-2025_13_16_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20557267 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20557267 AND mptpi.`type`=4230 To do Qualite : 0.16283505865355488 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20557268_14-02-2025_13_06_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20557268 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20557268 AND mptpi.`type`=4230 To do Qualite : 0.12385820099779768 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20578763_15-02-2025_00_23_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20578763 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20578763 AND mptpi.`type`=4230 To do Qualite : 0.17080943635979126 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561437_14-02-2025_16_47_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561437 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561437 AND mptpi.`type`=4230 To do Qualite : 0.15705737530364391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561438_14-02-2025_16_22_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561438 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561438 AND mptpi.`type`=4230 To do Qualite : 0.24123338678301143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561439_14-02-2025_16_36_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561439 AND mptpi.`type`=4230 To do Qualite : 0.2278315065084019 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561440_14-02-2025_15_49_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561440 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561440 AND mptpi.`type`=4230 To do Qualite : 0.21292784892651612 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20577017_14-02-2025_22_03_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577017 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577017 AND mptpi.`type`=4230 To do Qualite : 0.21228317775297423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20565004_14-02-2025_17_33_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565004 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20565004 AND mptpi.`type`=4230 To do Qualite : 0.18492439423286242 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20565005_15-02-2025_09_58_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565005 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20565005 AND mptpi.`type`=4230 To do Qualite : 0.23082729524202808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20565006_15-02-2025_10_03_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565006 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20565006 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565007 order by id desc limit 1 Qualite : 0.2534233030896306 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568568_15-02-2025_08_54_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568568 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568568 AND mptpi.`type`=4230 To do Qualite : 0.2588671757087973 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568570_15-02-2025_05_39_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568570 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568570 AND mptpi.`type`=4230 To do Qualite : 0.25108773598537126 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568571_15-02-2025_04_03_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568571 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568571 AND mptpi.`type`=4230 To do Qualite : 0.20697733701802679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568572_15-02-2025_04_38_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568572 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568572 AND mptpi.`type`=4230 To do Qualite : 0.21802253677162223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568575_15-02-2025_02_47_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568575 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568575 AND mptpi.`type`=4230 To do Qualite : 0.2522388465777581 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568587_15-02-2025_02_33_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568587 AND mptpi.`type`=4230 To do Qualite : 0.25095045419947665 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568601_15-02-2025_01_56_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568601 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568601 AND mptpi.`type`=4230 To do Qualite : 0.2392819042405134 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568602_15-02-2025_03_43_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568602 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568602 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567453 order by id desc limit 1 Qualite : 0.2583043303736873 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567454_15-02-2025_10_33_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567454 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567454 AND mptpi.`type`=4230 To do Qualite : 0.2063862632273461 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567455_15-02-2025_10_33_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567455 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567455 AND mptpi.`type`=4230 To do Qualite : 0.19970131662251972 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567456_15-02-2025_10_38_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567456 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567456 AND mptpi.`type`=4230 To do Qualite : 0.28329846835894773 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567457_15-02-2025_10_43_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567457 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567457 AND mptpi.`type`=4230 To do Qualite : 0.23510744137589373 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567458_15-02-2025_10_48_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567458 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567458 AND mptpi.`type`=4230 To do Qualite : 0.2740607973458327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567459_15-02-2025_10_53_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567459 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567459 AND mptpi.`type`=4230 To do Qualite : 0.2624806046701607 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567460_15-02-2025_11_00_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567460 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567460 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567461 order by id desc limit 1 Qualite : 0.2609089988552077 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567462_15-02-2025_11_09_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567462 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567462 AND mptpi.`type`=4230 To do Qualite : 0.20608939501616028 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567463_15-02-2025_11_14_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567463 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567463 AND mptpi.`type`=4230 To do Qualite : 0.2019944292002329 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567464_15-02-2025_11_19_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567464 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567465 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567466 order by id desc limit 1 Qualite : 0.20295396907322275 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567467_15-02-2025_10_49_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567467 AND mptpi.`type`=4230 To do Qualite : 0.2522307679386869 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567468_15-02-2025_11_23_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567468 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567468 AND mptpi.`type`=4230 To do Qualite : 0.28963136597642414 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567469_15-02-2025_09_32_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567469 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567469 AND mptpi.`type`=4230 To do Qualite : 0.2402249268024326 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567470_15-02-2025_10_23_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567470 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567470 AND mptpi.`type`=4230 To do Qualite : 0.22081808196868286 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567471_15-02-2025_09_48_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567471 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567471 AND mptpi.`type`=4230 To do Qualite : 0.24312637283776384 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567472_15-02-2025_07_47_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567472 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567472 AND mptpi.`type`=4230 To do Qualite : 0.20139709657864976 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567473_15-02-2025_09_17_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567473 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567473 AND mptpi.`type`=4230 To do Qualite : 0.204046268666926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567474 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567474 AND mptpi.`type`=4230 To do Qualite : 0.18417908255302992 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567475_15-02-2025_06_47_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567475 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567475 AND mptpi.`type`=4230 To do Qualite : 0.21982992715830277 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567476_15-02-2025_06_17_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567476 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567476 AND mptpi.`type`=4230 To do Qualite : 0.30472788576123255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567477_15-02-2025_05_47_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567477 AND mptpi.`type`=4230 To do Qualite : 0.23699891677009535 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567478_14-02-2025_18_34_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567478 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567478 AND mptpi.`type`=4230 To do Qualite : 0.2659324169831625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567479_14-02-2025_18_20_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567479 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567479 AND mptpi.`type`=4230 To do Qualite : 0.23264297907652698 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567480_14-02-2025_18_23_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567480 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567480 AND mptpi.`type`=4230 To do Qualite : 0.2402551151372868 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568604_15-02-2025_00_48_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568604 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568604 AND mptpi.`type`=4230 To do Qualite : 0.22023519577147693 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568605_14-02-2025_23_48_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568605 AND mptpi.`type`=4230 To do Qualite : 0.26055813790983423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568606_15-02-2025_00_34_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568606 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568606 AND mptpi.`type`=4230 To do Qualite : 0.25440762275141415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568607 AND mptpi.`type`=4230 To do Qualite : 0.23908227128633877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568608_14-02-2025_20_21_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568608 AND mptpi.`type`=4230 To do Qualite : 0.25379507447780547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568609_14-02-2025_18_47_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568609 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568609 AND mptpi.`type`=4230 To do Qualite : 0.255508684248806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568610_14-02-2025_19_35_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568610 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568610 AND mptpi.`type`=4230 To do Qualite : 0.24818222150458366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568611_14-02-2025_20_34_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568611 AND mptpi.`type`=4230 To do Qualite : 0.2428419785256863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568612_14-02-2025_18_37_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568612 AND mptpi.`type`=4230 To do Qualite : 0.2477337637088999 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20571465_14-02-2025_19_47_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20571465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20571465 AND mptpi.`type`=4230 To do Qualite : 0.23064257970638882 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20576591_14-02-2025_22_45_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20576591 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20576591 AND mptpi.`type`=4230 To do Qualite : 0.21982307840160847 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20576592_14-02-2025_23_29_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20576592 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20576592 AND mptpi.`type`=4230 To do Qualite : 0.21935584026591903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20575968_14-02-2025_23_32_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20575968 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20575968 AND mptpi.`type`=4230 To do Qualite : 0.20981345687102668 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20575969_14-02-2025_21_19_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20575969 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20575969 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14022025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337666828, 1337666820] Looping around the photos to save general results len do output : 1 /20567468Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666828', None, None, None, None, None, '2588611') ('4234', None, None, None, None, None, None, None, '2588611') ('4234', '20567468', '1337666820', None, None, None, None, None, '2588611') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013155460357666016 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.423392295837402 time spend to save output : 0.013302087783813477 total time spend for step 11 : 7.436694383621216 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 35.48user 21.94system 3:10.30elapsed 30%CPU (0avgtext+0avgdata 3125840maxresident)k 1368inputs+14512outputs (5major+2508322minor)pagefaults 0swaps