python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3156038 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2535873'] with mtr_portfolio_ids : ['20127279'] and first list_photo_ids : [] new path : /proc/3156038/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.29114317893981934 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 1 04:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10111 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 04:20:34.627212: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 04:20:34.659601: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 04:20:34.662137: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4f9c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 04:20:34.662207: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 04:20:34.667089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 04:20:34.925821: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x17d95e60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 04:20:34.925900: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 04:20:34.927755: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 04:20:34.928268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 04:20:34.931690: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 04:20:34.948849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 04:20:34.949331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 04:20:34.984861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 04:20:34.990969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 04:20:35.045162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 04:20:35.047037: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 04:20:35.047140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 04:20:35.048145: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 04:20:35.048167: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 04:20:35.048179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 04:20:35.049791: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9362 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 04:20:35.346286: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 04:20:35.346409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 04:20:35.346430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 04:20:35.346449: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 04:20:35.346467: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 04:20:35.346485: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 04:20:35.346503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 04:20:35.346522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 04:20:35.348027: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 04:20:35.349346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 04:20:35.349382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 04:20:35.349400: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 04:20:35.349417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 04:20:35.349437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 04:20:35.349454: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 04:20:35.349471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 04:20:35.349488: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 04:20:35.350957: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 04:20:35.350994: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 04:20:35.351005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 04:20:35.351014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 04:20:35.352579: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9362 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 04:20:43.366954: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 04:20:43.539713: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.57500 max: 149.64687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 33 time to create 1 rle with old method : 0.00017189979553222656 length of segment : 10 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 426 time to create 1 rle with old method : 0.0009241104125976562 length of segment : 29 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.0001666545867919922 length of segment : 12 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.0002186298370361328 length of segment : 22 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.0003211498260498047 length of segment : 25 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 1633 time to create 1 rle with old method : 0.009443283081054688 length of segment : 50 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.0002338886260986328 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.0010311603546142578 length of segment : 57 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00018215179443359375 length of segment : 13 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.00019431114196777344 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 41 time to create 1 rle with old method : 8.630752563476562e-05 length of segment : 7 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 2545 time to create 1 rle with old method : 0.0033195018768310547 length of segment : 56 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1255 time to create 1 rle with old method : 0.001795053482055664 length of segment : 40 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 2649 time to create 1 rle with old method : 0.0039348602294921875 length of segment : 63 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0009856224060058594 length of segment : 33 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0008056163787841797 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.04766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0007312297821044922 length of segment : 63 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.00025343894958496094 length of segment : 6 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 962 time to create 1 rle with old method : 0.0014693737030029297 length of segment : 39 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0007011890411376953 length of segment : 53 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0007932186126708984 length of segment : 47 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1306 time to create 1 rle with old method : 0.0019292831420898438 length of segment : 78 time for calcul the mask position with numpy : 0.00014519691467285156 nb_pixel_total : 3086 time to create 1 rle with old method : 0.0047376155853271484 length of segment : 55 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0010807514190673828 length of segment : 66 time for calcul the mask position with numpy : 0.0001728534698486328 nb_pixel_total : 5930 time to create 1 rle with old method : 0.007762908935546875 length of segment : 100 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1651 time to create 1 rle with old method : 0.002490520477294922 length of segment : 81 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1137 time to create 1 rle with old method : 0.0014655590057373047 length of segment : 46 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006146430969238281 length of segment : 51 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 968 time to create 1 rle with old method : 0.0015110969543457031 length of segment : 40 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0010883808135986328 length of segment : 71 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00034880638122558594 length of segment : 16 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 577 time to create 1 rle with old method : 0.0007100105285644531 length of segment : 54 time for calcul the mask position with numpy : 0.0001850128173828125 nb_pixel_total : 10261 time to create 1 rle with old method : 0.01221919059753418 length of segment : 114 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0006504058837890625 length of segment : 22 time for calcul the mask position with numpy : 0.00021767616271972656 nb_pixel_total : 27 time to create 1 rle with old method : 8.96453857421875e-05 length of segment : 12 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006456375122070312 length of segment : 61 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.00027823448181152344 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0003581047058105469 length of segment : 12 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.55703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0008666515350341797 length of segment : 21 time for calcul the mask position with numpy : 0.00010132789611816406 nb_pixel_total : 1861 time to create 1 rle with old method : 0.002393484115600586 length of segment : 126 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00017380714416503906 length of segment : 11 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1128 time to create 1 rle with old method : 0.001453399658203125 length of segment : 33 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0008060932159423828 length of segment : 16 time for calcul the mask position with numpy : 0.000621795654296875 nb_pixel_total : 50642 time to create 1 rle with old method : 0.059639692306518555 length of segment : 306 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0008156299591064453 length of segment : 23 time for calcul the mask position with numpy : 0.0005676746368408203 nb_pixel_total : 44801 time to create 1 rle with old method : 0.052634477615356445 length of segment : 290 Processing 1 images image shape: (400, 400, 3) min: 26.00000 max: 248.00000 molded_images shape: (1, 640, 640, 3) min: -75.15313 max: 104.13359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.52422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0009059906005859375 length of segment : 26 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00021123886108398438 length of segment : 13 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 738 time to create 1 rle with old method : 0.001119375228881836 length of segment : 40 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0004787445068359375 length of segment : 27 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0008447170257568359 length of segment : 27 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 1517 time to create 1 rle with old method : 0.002353191375732422 length of segment : 36 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0009417533874511719 length of segment : 24 time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 4484 time to create 1 rle with old method : 0.006649017333984375 length of segment : 68 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006628036499023438 length of segment : 27 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 706 time to create 1 rle with old method : 0.00095367431640625 length of segment : 29 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 4377 time to create 1 rle with old method : 0.00574946403503418 length of segment : 60 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0005104541778564453 length of segment : 20 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 510 time to create 1 rle with old method : 0.0007386207580566406 length of segment : 27 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00018262863159179688 length of segment : 10 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.0011708736419677734 length of segment : 33 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 41 time to create 1 rle with old method : 0.00010991096496582031 length of segment : 7 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0003020763397216797 length of segment : 14 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00033664703369140625 length of segment : 17 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00021219253540039062 length of segment : 10 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0005595684051513672 length of segment : 35 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002224445343017578 length of segment : 14 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0006651878356933594 length of segment : 18 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0003159046173095703 length of segment : 13 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 795 time to create 1 rle with old method : 0.0010983943939208984 length of segment : 40 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 32 time to create 1 rle with old method : 7.987022399902344e-05 length of segment : 9 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00015091896057128906 length of segment : 12 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00020051002502441406 length of segment : 15 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 615 time to create 1 rle with old method : 0.0009562969207763672 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.24297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00032401084899902344 length of segment : 13 time for calcul the mask position with numpy : 8.749961853027344e-05 nb_pixel_total : 1725 time to create 1 rle with old method : 0.002134561538696289 length of segment : 131 time for calcul the mask position with numpy : 0.0002892017364501953 nb_pixel_total : 10160 time to create 1 rle with old method : 0.012110471725463867 length of segment : 307 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003743171691894531 length of segment : 18 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1238 time to create 1 rle with old method : 0.001461029052734375 length of segment : 41 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 720 time to create 1 rle with old method : 0.0009648799896240234 length of segment : 35 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002994537353515625 length of segment : 26 time for calcul the mask position with numpy : 0.00012636184692382812 nb_pixel_total : 1731 time to create 1 rle with old method : 0.0021474361419677734 length of segment : 158 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 1896 time to create 1 rle with old method : 0.0036995410919189453 length of segment : 152 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.00041961669921875 length of segment : 14 time for calcul the mask position with numpy : 0.00014257431030273438 nb_pixel_total : 1844 time to create 1 rle with old method : 0.006960153579711914 length of segment : 91 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.33828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 718 time to create 1 rle with old method : 0.0009758472442626953 length of segment : 56 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 1723 time to create 1 rle with old method : 0.0020737648010253906 length of segment : 84 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00014257431030273438 length of segment : 15 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1274 time to create 1 rle with old method : 0.001756429672241211 length of segment : 51 length of segment : 0 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002665519714355469 length of segment : 7 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 4455 time to create 1 rle with old method : 0.005414009094238281 length of segment : 215 time for calcul the mask position with numpy : 0.00024366378784179688 nb_pixel_total : 4378 time to create 1 rle with old method : 0.0057375431060791016 length of segment : 146 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00017714500427246094 length of segment : 12 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006265640258789062 length of segment : 48 time for calcul the mask position with numpy : 0.00018596649169921875 nb_pixel_total : 3552 time to create 1 rle with old method : 0.004567384719848633 length of segment : 185 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 1376 time to create 1 rle with old method : 0.0016622543334960938 length of segment : 51 Processing 1 images image shape: (280, 400, 3) min: 17.00000 max: 208.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 75.18828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007257461547851562 length of segment : 56 time for calcul the mask position with numpy : 0.0009706020355224609 nb_pixel_total : 106152 time to create 1 rle with old method : 0.11577486991882324 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1691 time to create 1 rle with old method : 0.002045869827270508 length of segment : 87 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.0013217926025390625 length of segment : 36 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002205371856689453 length of segment : 11 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.00037670135498046875 length of segment : 32 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0009024143218994141 length of segment : 26 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002346038818359375 length of segment : 24 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00034308433532714844 length of segment : 19 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.000579833984375 length of segment : 19 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0008118152618408203 length of segment : 43 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008413791656494141 length of segment : 39 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1233 time to create 1 rle with old method : 0.001665353775024414 length of segment : 41 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 2804 time to create 1 rle with old method : 0.0036787986755371094 length of segment : 115 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1265 time to create 1 rle with old method : 0.0015256404876708984 length of segment : 42 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0010437965393066406 length of segment : 62 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0014657974243164062 length of segment : 38 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 46 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.00098419189453125 length of segment : 44 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0005211830139160156 length of segment : 30 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.00039505958557128906 length of segment : 18 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.00022602081298828125 length of segment : 21 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00028061866760253906 length of segment : 21 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.000316619873046875 length of segment : 22 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0005903244018554688 length of segment : 25 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007281303405761719 length of segment : 42 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00031828880310058594 length of segment : 18 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005745887756347656 length of segment : 30 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003910064697265625 length of segment : 21 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.00040078163146972656 length of segment : 24 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.00031065940856933594 length of segment : 13 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001513957977294922 length of segment : 10 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1324 time to create 1 rle with old method : 0.0016436576843261719 length of segment : 35 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00026702880859375 length of segment : 13 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.0009667873382568359 length of segment : 39 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005745887756347656 length of segment : 31 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0005507469177246094 length of segment : 20 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0011107921600341797 length of segment : 29 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003662109375 length of segment : 18 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1748 time to create 1 rle with old method : 0.0021843910217285156 length of segment : 41 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00014662742614746094 length of segment : 10 time for calcul the mask position with numpy : 0.00011897087097167969 nb_pixel_total : 1178 time to create 1 rle with old method : 0.002021312713623047 length of segment : 32 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0004730224609375 length of segment : 19 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0007216930389404297 length of segment : 34 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0006158351898193359 length of segment : 24 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0008015632629394531 length of segment : 25 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0009984970092773438 length of segment : 29 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0004639625549316406 length of segment : 16 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 53 time to create 1 rle with old method : 9.107589721679688e-05 length of segment : 10 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00029778480529785156 length of segment : 15 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003294944763183594 length of segment : 17 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00034356117248535156 length of segment : 23 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002772808074951172 length of segment : 16 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.00012731552124023438 length of segment : 9 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 704 time to create 1 rle with old method : 0.001119852066040039 length of segment : 34 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0011525154113769531 length of segment : 23 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 847 time to create 1 rle with old method : 0.001394033432006836 length of segment : 42 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 35 time to create 1 rle with old method : 8.058547973632812e-05 length of segment : 5 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 2691 time to create 1 rle with old method : 0.003407716751098633 length of segment : 35 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00029921531677246094 length of segment : 18 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.00031685829162597656 length of segment : 10 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004940032958984375 length of segment : 19 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 561 time to create 1 rle with old method : 0.0007894039154052734 length of segment : 27 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 719 time to create 1 rle with old method : 0.0009722709655761719 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.54141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 24 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001933574676513672 length of segment : 13 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005431175231933594 length of segment : 23 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.00020456314086914062 length of segment : 27 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003910064697265625 length of segment : 23 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0011048316955566406 length of segment : 48 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0008134841918945312 length of segment : 36 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 5167 time to create 1 rle with old method : 0.006645679473876953 length of segment : 133 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00023937225341796875 length of segment : 21 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.00044083595275878906 length of segment : 20 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001690387725830078 length of segment : 14 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001957416534423828 length of segment : 13 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 3832 time to create 1 rle with old method : 0.004392862319946289 length of segment : 166 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005240440368652344 length of segment : 27 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005099773406982422 length of segment : 26 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006668567657470703 length of segment : 32 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007355213165283203 length of segment : 134 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.00034809112548828125 length of segment : 19 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 27 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.0001933574676513672 length of segment : 9 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0005636215209960938 length of segment : 51 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.69609 max: 149.94375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 36 time to create 1 rle with old method : 8.106231689453125e-05 length of segment : 14 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.000560760498046875 length of segment : 33 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00014495849609375 length of segment : 25 length of segment : 0 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00010848045349121094 length of segment : 12 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.0002090930938720703 length of segment : 24 time for calcul the mask position with numpy : 0.0001437664031982422 nb_pixel_total : 3791 time to create 1 rle with old method : 0.004628896713256836 length of segment : 78 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00022029876708984375 length of segment : 25 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.0002765655517578125 length of segment : 23 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 1851 time to create 1 rle with old method : 0.003385782241821289 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.89141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006656646728515625 length of segment : 39 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 42 time to create 1 rle with old method : 8.463859558105469e-05 length of segment : 7 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002589225769042969 length of segment : 29 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 2624 time to create 1 rle with old method : 0.003236055374145508 length of segment : 59 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00013589859008789062 length of segment : 17 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 881 time to create 1 rle with old method : 0.0011126995086669922 length of segment : 38 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 2467 time to create 1 rle with old method : 0.003215312957763672 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.09844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 1884 time to create 1 rle with old method : 0.002287626266479492 length of segment : 71 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0014138221740722656 length of segment : 27 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0017330646514892578 length of segment : 45 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 705 time to create 1 rle with old method : 0.0010187625885009766 length of segment : 15 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003266334533691406 length of segment : 17 time for calcul the mask position with numpy : 0.00012803077697753906 nb_pixel_total : 6274 time to create 1 rle with old method : 0.007480621337890625 length of segment : 139 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005216598510742188 length of segment : 31 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 6889 time to create 1 rle with old method : 0.008635759353637695 length of segment : 129 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.0008656978607177734 length of segment : 48 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.0007941722869873047 length of segment : 14 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.000911712646484375 length of segment : 31 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.000507354736328125 length of segment : 25 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00024127960205078125 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.00078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 15 time for calcul the mask position with numpy : 0.00015783309936523438 nb_pixel_total : 10710 time to create 1 rle with old method : 0.012410879135131836 length of segment : 108 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.000629425048828125 length of segment : 52 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002779960632324219 length of segment : 18 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002472400665283203 length of segment : 11 time for calcul the mask position with numpy : 0.00023746490478515625 nb_pixel_total : 112 time to create 1 rle with old method : 0.0002014636993408203 length of segment : 33 time for calcul the mask position with numpy : 0.00018143653869628906 nb_pixel_total : 11977 time to create 1 rle with old method : 0.013871192932128906 length of segment : 89 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.70937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 2126 time to create 1 rle with old method : 0.003589153289794922 length of segment : 136 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.000774383544921875 length of segment : 20 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001876354217529297 length of segment : 12 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0008466243743896484 length of segment : 21 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1206 time to create 1 rle with old method : 0.00157928466796875 length of segment : 33 time for calcul the mask position with numpy : 0.0005061626434326172 nb_pixel_total : 47027 time to create 1 rle with old method : 0.06311178207397461 length of segment : 208 Processing 1 images image shape: (400, 400, 3) min: 27.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -73.73125 max: 106.82109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.52422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0008385181427001953 length of segment : 27 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004982948303222656 length of segment : 21 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 534 time to create 1 rle with old method : 0.0007843971252441406 length of segment : 23 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.000997781753540039 length of segment : 55 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0008990764617919922 length of segment : 25 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00016498565673828125 length of segment : 12 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 4164 time to create 1 rle with old method : 0.004984617233276367 length of segment : 66 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.00047779083251953125 length of segment : 15 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005338191986083984 length of segment : 34 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003147125244140625 length of segment : 21 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.000606536865234375 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.88750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002923011779785156 length of segment : 24 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.000885009765625 length of segment : 37 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0007491111755371094 length of segment : 20 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0005619525909423828 length of segment : 19 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00043582916259765625 length of segment : 19 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005598068237304688 length of segment : 30 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00013709068298339844 length of segment : 8 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.0011010169982910156 length of segment : 34 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 31 time to create 1 rle with old method : 7.700920104980469e-05 length of segment : 9 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 37 time to create 1 rle with old method : 8.034706115722656e-05 length of segment : 7 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00017213821411132812 length of segment : 11 time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 13326 time to create 1 rle with old method : 0.017258882522583008 length of segment : 283 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 236 time to create 1 rle with old method : 0.00038051605224609375 length of segment : 30 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00019240379333496094 length of segment : 12 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 534 time to create 1 rle with old method : 0.0008280277252197266 length of segment : 54 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0008864402770996094 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.95391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 957 time to create 1 rle with old method : 0.0012340545654296875 length of segment : 102 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003039836883544922 length of segment : 13 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 9771 time to create 1 rle with old method : 0.011041879653930664 length of segment : 241 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003597736358642578 length of segment : 14 time for calcul the mask position with numpy : 0.00014781951904296875 nb_pixel_total : 1292 time to create 1 rle with old method : 0.0017120838165283203 length of segment : 132 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.0009911060333251953 length of segment : 35 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 15 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1220 time to create 1 rle with old method : 0.0015592575073242188 length of segment : 40 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00040078163146972656 length of segment : 30 time for calcul the mask position with numpy : 0.00011038780212402344 nb_pixel_total : 1441 time to create 1 rle with old method : 0.001802682876586914 length of segment : 129 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0015904903411865234 length of segment : 67 time for calcul the mask position with numpy : 0.0001773834228515625 nb_pixel_total : 7026 time to create 1 rle with old method : 0.008569002151489258 length of segment : 160 time for calcul the mask position with numpy : 0.0003108978271484375 nb_pixel_total : 4629 time to create 1 rle with old method : 0.005707740783691406 length of segment : 202 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.70156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1809 time to create 1 rle with old method : 0.0023758411407470703 length of segment : 85 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 753 time to create 1 rle with old method : 0.0009675025939941406 length of segment : 58 time for calcul the mask position with numpy : 0.00024509429931640625 nb_pixel_total : 3828 time to create 1 rle with old method : 0.004608154296875 length of segment : 205 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0011916160583496094 length of segment : 51 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00021600723266601562 length of segment : 15 time for calcul the mask position with numpy : 0.00021195411682128906 nb_pixel_total : 2589 time to create 1 rle with old method : 0.003847360610961914 length of segment : 91 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00015401840209960938 length of segment : 12 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00017023086547851562 length of segment : 14 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0014879703521728516 length of segment : 48 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 3476 time to create 1 rle with old method : 0.004192829132080078 length of segment : 175 Processing 1 images image shape: (280, 400, 3) min: 16.00000 max: 214.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 81.56328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0010416507720947266 nb_pixel_total : 106586 time to create 1 rle with old method : 0.11789727210998535 length of segment : 281 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006258487701416016 length of segment : 52 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1011 time to create 1 rle with old method : 0.0013461112976074219 length of segment : 39 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007052421569824219 length of segment : 45 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1513 time to create 1 rle with old method : 0.001847982406616211 length of segment : 83 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006496906280517578 length of segment : 26 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.00074005126953125 length of segment : 43 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.00026607513427734375 length of segment : 12 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 2900 time to create 1 rle with old method : 0.0035560131072998047 length of segment : 91 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0006203651428222656 length of segment : 18 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003540515899658203 length of segment : 18 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002827644348144531 length of segment : 22 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1164 time to create 1 rle with old method : 0.00142669677734375 length of segment : 39 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 691 time to create 1 rle with old method : 0.0009064674377441406 length of segment : 61 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.0007860660552978516 length of segment : 32 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005755424499511719 length of segment : 18 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1163 time to create 1 rle with old method : 0.0015807151794433594 length of segment : 38 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 44 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 809 time to create 1 rle with old method : 0.0010497570037841797 length of segment : 45 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003540515899658203 length of segment : 25 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00024771690368652344 length of segment : 16 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00032448768615722656 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.00034165382385253906 length of segment : 14 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002384185791015625 length of segment : 20 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002598762512207031 length of segment : 13 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005443096160888672 length of segment : 25 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009589195251464844 length of segment : 32 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007319450378417969 length of segment : 23 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00058746337890625 length of segment : 22 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0010085105895996094 length of segment : 24 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0007891654968261719 length of segment : 32 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001850128173828125 length of segment : 23 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007216930389404297 length of segment : 39 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004487037658691406 length of segment : 20 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00030541419982910156 length of segment : 18 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0014472007751464844 length of segment : 33 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00026297569274902344 length of segment : 10 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.0001201629638671875 length of segment : 10 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005536079406738281 length of segment : 23 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.00034308433532714844 length of segment : 20 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0004923343658447266 length of segment : 35 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0015931129455566406 length of segment : 33 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005848407745361328 length of segment : 30 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00015664100646972656 length of segment : 28 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.000400543212890625 length of segment : 39 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006744861602783203 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002605915069580078 length of segment : 16 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00026798248291015625 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002524852752685547 length of segment : 13 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004336833953857422 length of segment : 21 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 683 time to create 1 rle with old method : 0.0009436607360839844 length of segment : 31 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1635 time to create 1 rle with old method : 0.0020456314086914062 length of segment : 44 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00010585784912109375 length of segment : 9 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005645751953125 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003542900085449219 length of segment : 20 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 12 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2859 time to create 1 rle with old method : 0.003824949264526367 length of segment : 37 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003006458282470703 length of segment : 15 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006616115570068359 length of segment : 30 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 592 time to create 1 rle with old method : 0.0008342266082763672 length of segment : 47 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 707 time to create 1 rle with old method : 0.0009484291076660156 length of segment : 33 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002560615539550781 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.00625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.0010750293731689453 length of segment : 75 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00033783912658691406 length of segment : 23 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003223419189453125 length of segment : 24 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00025582313537597656 length of segment : 35 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 1841 time to create 1 rle with old method : 0.002228260040283203 length of segment : 85 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 5033 time to create 1 rle with old method : 0.005617380142211914 length of segment : 118 time for calcul the mask position with numpy : 0.0003008842468261719 nb_pixel_total : 14154 time to create 1 rle with old method : 0.021622896194458008 length of segment : 423 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.0001938343048095703 length of segment : 26 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0007116794586181641 length of segment : 24 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.00067901611328125 length of segment : 25 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005586147308349609 length of segment : 25 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0006291866302490234 length of segment : 108 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003838539123535156 length of segment : 32 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001499652862548828 length of segment : 9 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.00041365623474121094 length of segment : 52 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003192424774169922 length of segment : 18 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 46 time to create 1 rle with old method : 7.557868957519531e-05 length of segment : 15 Detection mask done ! Trying to reset tf kernel 3156555 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4023 tf kernel not reseted sub process len(results) : 352 len(list_Values) 352 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 352 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9038 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 352 chid ids of type : 4228 Number RLEs to save : 15834 save missing photos in datou_result : time spend for datou_step_exec : 25.900238275527954 time spend to save output : 1.6690516471862793 total time spend for step 1 : 27.569289922714233 step2:brightness Sat Feb 1 04:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738380030_3156038_1333463758_b7db7ea18404eb217d7922fb9f3d69d3.jpg treat image : temp/1738380030_3156038_1333463755_2ed39d8281901a43ec5542651c42fb82.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.02552199363708496 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.011541604995727539 save missing photos in datou_result : time spend for datou_step_exec : 0.5208709239959717 time spend to save output : 0.04168105125427246 total time spend for step 2 : 0.5625519752502441 step3:blur_detection Sat Feb 1 04:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738380030_3156038_1333463758_b7db7ea18404eb217d7922fb9f3d69d3.jpg resize: (1080, 1920) 1333463758 -8.060805400040058 treat image : temp/1738380030_3156038_1333463755_2ed39d8281901a43ec5542651c42fb82.jpg resize: (1080, 1920) 1333463755 -8.050506030111803 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.028593778610229492 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.01447749137878418 save missing photos in datou_result : time spend for datou_step_exec : 1.9992568492889404 time spend to save output : 0.047530412673950195 total time spend for step 3 : 2.0467872619628906 step4:rle_unique_nms_with_priority Sat Feb 1 04:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 352 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 179 nb_hashtags : 7 time to prepare the origin masks : 1.108809471130371 time for calcul the mask position with numpy : 0.0564417839050293 nb_pixel_total : 1785565 time to create 1 rle with new method : 0.31177401542663574 time for calcul the mask position with numpy : 0.008551359176635742 nb_pixel_total : 100 time to create 1 rle with old method : 0.0001418590545654297 time for calcul the mask position with numpy : 0.008439302444458008 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005540847778320312 time for calcul the mask position with numpy : 0.008514165878295898 nb_pixel_total : 962 time to create 1 rle with old method : 0.0012574195861816406 time for calcul the mask position with numpy : 0.00845026969909668 nb_pixel_total : 786 time to create 1 rle with old method : 0.0008509159088134766 time for calcul the mask position with numpy : 0.0084686279296875 nb_pixel_total : 13 time to create 1 rle with old method : 3.0994415283203125e-05 time for calcul the mask position with numpy : 0.00847005844116211 nb_pixel_total : 19 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.008409976959228516 nb_pixel_total : 1861 time to create 1 rle with old method : 0.0025510787963867188 time for calcul the mask position with numpy : 0.008466005325317383 nb_pixel_total : 1306 time to create 1 rle with old method : 0.0014295578002929688 time for calcul the mask position with numpy : 0.008672952651977539 nb_pixel_total : 109 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.0096893310546875 nb_pixel_total : 47 time to create 1 rle with old method : 7.319450378417969e-05 time for calcul the mask position with numpy : 0.008415699005126953 nb_pixel_total : 3876 time to create 1 rle with old method : 0.004570722579956055 time for calcul the mask position with numpy : 0.008474588394165039 nb_pixel_total : 87 time to create 1 rle with old method : 0.00010323524475097656 time for calcul the mask position with numpy : 0.008453130722045898 nb_pixel_total : 627 time to create 1 rle with old method : 0.0007126331329345703 time for calcul the mask position with numpy : 0.008557558059692383 nb_pixel_total : 50431 time to create 1 rle with old method : 0.054087162017822266 time for calcul the mask position with numpy : 0.008572578430175781 nb_pixel_total : 33 time to create 1 rle with old method : 5.0067901611328125e-05 time for calcul the mask position with numpy : 0.009230613708496094 nb_pixel_total : 62 time to create 1 rle with old method : 9.489059448242188e-05 time for calcul the mask position with numpy : 0.00857996940612793 nb_pixel_total : 16 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.008486270904541016 nb_pixel_total : 61 time to create 1 rle with old method : 8.320808410644531e-05 time for calcul the mask position with numpy : 0.008544921875 nb_pixel_total : 1633 time to create 1 rle with old method : 0.0017709732055664062 time for calcul the mask position with numpy : 0.008486270904541016 nb_pixel_total : 426 time to create 1 rle with old method : 0.0004825592041015625 time for calcul the mask position with numpy : 0.00852060317993164 nb_pixel_total : 1255 time to create 1 rle with old method : 0.0014529228210449219 time for calcul the mask position with numpy : 0.008484840393066406 nb_pixel_total : 236 time to create 1 rle with old method : 0.00033164024353027344 time for calcul the mask position with numpy : 0.008493185043334961 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005259513854980469 time for calcul the mask position with numpy : 0.008502721786499023 nb_pixel_total : 75 time to create 1 rle with old method : 9.322166442871094e-05 time for calcul the mask position with numpy : 0.008551359176635742 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005414485931396484 time for calcul the mask position with numpy : 0.009169340133666992 nb_pixel_total : 2545 time to create 1 rle with old method : 0.0028896331787109375 time for calcul the mask position with numpy : 0.008457660675048828 nb_pixel_total : 8 time to create 1 rle with old method : 1.9788742065429688e-05 time for calcul the mask position with numpy : 0.008440017700195312 nb_pixel_total : 773 time to create 1 rle with old method : 0.0009448528289794922 time for calcul the mask position with numpy : 0.008444786071777344 nb_pixel_total : 1137 time to create 1 rle with old method : 0.0012753009796142578 time for calcul the mask position with numpy : 0.008533477783203125 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005822181701660156 time for calcul the mask position with numpy : 0.008482933044433594 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006291866302490234 time for calcul the mask position with numpy : 0.00845026969909668 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002434253692626953 time for calcul the mask position with numpy : 0.008455991744995117 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006051063537597656 time for calcul the mask position with numpy : 0.00854945182800293 nb_pixel_total : 27 time to create 1 rle with old method : 4.57763671875e-05 time for calcul the mask position with numpy : 0.008476495742797852 nb_pixel_total : 3086 time to create 1 rle with old method : 0.003473997116088867 time for calcul the mask position with numpy : 0.008477210998535156 nb_pixel_total : 37 time to create 1 rle with old method : 5.555152893066406e-05 time for calcul the mask position with numpy : 0.008453607559204102 nb_pixel_total : 401 time to create 1 rle with old method : 0.0004849433898925781 time for calcul the mask position with numpy : 0.008600711822509766 nb_pixel_total : 5930 time to create 1 rle with old method : 0.006796121597290039 time for calcul the mask position with numpy : 0.008834123611450195 nb_pixel_total : 556 time to create 1 rle with old method : 0.0008749961853027344 time for calcul the mask position with numpy : 0.01016092300415039 nb_pixel_total : 1651 time to create 1 rle with old method : 0.0018856525421142578 time for calcul the mask position with numpy : 0.008881807327270508 nb_pixel_total : 10261 time to create 1 rle with old method : 0.01143956184387207 time for calcul the mask position with numpy : 0.008522272109985352 nb_pixel_total : 88 time to create 1 rle with old method : 0.0001068115234375 time for calcul the mask position with numpy : 0.008473396301269531 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002663135528564453 time for calcul the mask position with numpy : 0.008441925048828125 nb_pixel_total : 1128 time to create 1 rle with old method : 0.001249074935913086 time for calcul the mask position with numpy : 0.008479833602905273 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006368160247802734 time for calcul the mask position with numpy : 0.008487939834594727 nb_pixel_total : 19 time to create 1 rle with old method : 5.793571472167969e-05 time for calcul the mask position with numpy : 0.008469343185424805 nb_pixel_total : 1731 time to create 1 rle with old method : 0.001895904541015625 time for calcul the mask position with numpy : 0.008468389511108398 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005276203155517578 time for calcul the mask position with numpy : 0.008459806442260742 nb_pixel_total : 1844 time to create 1 rle with old method : 0.0019974708557128906 time for calcul the mask position with numpy : 0.008484601974487305 nb_pixel_total : 111 time to create 1 rle with old method : 0.00013065338134765625 time for calcul the mask position with numpy : 0.008522510528564453 nb_pixel_total : 720 time to create 1 rle with old method : 0.0008111000061035156 time for calcul the mask position with numpy : 0.009320974349975586 nb_pixel_total : 4484 time to create 1 rle with old method : 0.004945993423461914 time for calcul the mask position with numpy : 0.00847768783569336 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001933574676513672 time for calcul the mask position with numpy : 0.008507251739501953 nb_pixel_total : 1238 time to create 1 rle with old method : 0.0013327598571777344 time for calcul the mask position with numpy : 0.00847005844116211 nb_pixel_total : 718 time to create 1 rle with old method : 0.0007953643798828125 time for calcul the mask position with numpy : 0.008493423461914062 nb_pixel_total : 215 time to create 1 rle with old method : 0.0002567768096923828 time for calcul the mask position with numpy : 0.008510351181030273 nb_pixel_total : 1854 time to create 1 rle with old method : 0.0021469593048095703 time for calcul the mask position with numpy : 0.008397102355957031 nb_pixel_total : 10160 time to create 1 rle with old method : 0.011315107345581055 time for calcul the mask position with numpy : 0.009004831314086914 nb_pixel_total : 4455 time to create 1 rle with old method : 0.005098581314086914 time for calcul the mask position with numpy : 0.008495330810546875 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001270771026611328 time for calcul the mask position with numpy : 0.008480072021484375 nb_pixel_total : 115 time to create 1 rle with old method : 0.00019073486328125 time for calcul the mask position with numpy : 0.008419275283813477 nb_pixel_total : 4378 time to create 1 rle with old method : 0.004862785339355469 time for calcul the mask position with numpy : 0.008376121520996094 nb_pixel_total : 1725 time to create 1 rle with old method : 0.0019063949584960938 time for calcul the mask position with numpy : 0.00846409797668457 nb_pixel_total : 97 time to create 1 rle with old method : 0.00011014938354492188 time for calcul the mask position with numpy : 0.008446931838989258 nb_pixel_total : 615 time to create 1 rle with old method : 0.000682830810546875 time for calcul the mask position with numpy : 0.008472442626953125 nb_pixel_total : 795 time to create 1 rle with old method : 0.0008950233459472656 time for calcul the mask position with numpy : 0.00845193862915039 nb_pixel_total : 204 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.008599281311035156 nb_pixel_total : 1274 time to create 1 rle with old method : 0.0019807815551757812 time for calcul the mask position with numpy : 0.00862431526184082 nb_pixel_total : 107 time to create 1 rle with old method : 0.00012612342834472656 time for calcul the mask position with numpy : 0.008470535278320312 nb_pixel_total : 706 time to create 1 rle with old method : 0.0007791519165039062 time for calcul the mask position with numpy : 0.008439302444458008 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002334117889404297 time for calcul the mask position with numpy : 0.008471250534057617 nb_pixel_total : 752 time to create 1 rle with old method : 0.0008192062377929688 time for calcul the mask position with numpy : 0.00848698616027832 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005612373352050781 time for calcul the mask position with numpy : 0.008460044860839844 nb_pixel_total : 1517 time to create 1 rle with old method : 0.0016689300537109375 time for calcul the mask position with numpy : 0.00839543342590332 nb_pixel_total : 1723 time to create 1 rle with old method : 0.0019054412841796875 time for calcul the mask position with numpy : 0.008462905883789062 nb_pixel_total : 167 time to create 1 rle with old method : 0.0001990795135498047 time for calcul the mask position with numpy : 0.008449316024780273 nb_pixel_total : 163 time to create 1 rle with old method : 0.00019311904907226562 time for calcul the mask position with numpy : 0.008558273315429688 nb_pixel_total : 89 time to create 1 rle with old method : 0.00011754035949707031 time for calcul the mask position with numpy : 0.008589029312133789 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006272792816162109 time for calcul the mask position with numpy : 0.008545160293579102 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003504753112792969 time for calcul the mask position with numpy : 0.008545160293579102 nb_pixel_total : 510 time to create 1 rle with old method : 0.0005838871002197266 time for calcul the mask position with numpy : 0.008473873138427734 nb_pixel_total : 41 time to create 1 rle with old method : 5.6743621826171875e-05 time for calcul the mask position with numpy : 0.008548974990844727 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005478858947753906 time for calcul the mask position with numpy : 0.010010242462158203 nb_pixel_total : 321 time to create 1 rle with old method : 0.00038433074951171875 time for calcul the mask position with numpy : 0.008462667465209961 nb_pixel_total : 182 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.008478641510009766 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006659030914306641 time for calcul the mask position with numpy : 0.008476972579956055 nb_pixel_total : 89 time to create 1 rle with old method : 0.00011563301086425781 time for calcul the mask position with numpy : 0.008590221405029297 nb_pixel_total : 738 time to create 1 rle with old method : 0.0008628368377685547 time for calcul the mask position with numpy : 0.008490324020385742 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011491775512695312 time for calcul the mask position with numpy : 0.008455038070678711 nb_pixel_total : 117 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.008440494537353516 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003275871276855469 time for calcul the mask position with numpy : 0.008448362350463867 nb_pixel_total : 156 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.008507490158081055 nb_pixel_total : 211 time to create 1 rle with old method : 0.00025177001953125 time for calcul the mask position with numpy : 0.008454561233520508 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006203651428222656 time for calcul the mask position with numpy : 0.008502483367919922 nb_pixel_total : 32 time to create 1 rle with old method : 4.363059997558594e-05 time for calcul the mask position with numpy : 0.008487939834594727 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001800060272216797 time for calcul the mask position with numpy : 0.008512496948242188 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003256797790527344 time for calcul the mask position with numpy : 0.00955510139465332 nb_pixel_total : 105753 time to create 1 rle with old method : 0.11449933052062988 time for calcul the mask position with numpy : 0.00850987434387207 nb_pixel_total : 974 time to create 1 rle with old method : 0.0010802745819091797 time for calcul the mask position with numpy : 0.008499622344970703 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001652240753173828 time for calcul the mask position with numpy : 0.008604288101196289 nb_pixel_total : 132 time to create 1 rle with old method : 0.0001697540283203125 time for calcul the mask position with numpy : 0.008545160293579102 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006670951843261719 time for calcul the mask position with numpy : 0.008497238159179688 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007145404815673828 time for calcul the mask position with numpy : 0.008529424667358398 nb_pixel_total : 24 time to create 1 rle with old method : 5.1021575927734375e-05 time for calcul the mask position with numpy : 0.008461713790893555 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002484321594238281 time for calcul the mask position with numpy : 0.008424520492553711 nb_pixel_total : 229 time to create 1 rle with old method : 0.00026345252990722656 time for calcul the mask position with numpy : 0.008434772491455078 nb_pixel_total : 175 time to create 1 rle with old method : 0.0003814697265625 time for calcul the mask position with numpy : 0.008474349975585938 nb_pixel_total : 126 time to create 1 rle with old method : 0.00015735626220703125 time for calcul the mask position with numpy : 0.008459806442260742 nb_pixel_total : 191 time to create 1 rle with old method : 0.00021791458129882812 time for calcul the mask position with numpy : 0.008435487747192383 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006897449493408203 time for calcul the mask position with numpy : 0.008467912673950195 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002334117889404297 time for calcul the mask position with numpy : 0.008418560028076172 nb_pixel_total : 5167 time to create 1 rle with old method : 0.005599260330200195 time for calcul the mask position with numpy : 0.008489608764648438 nb_pixel_total : 96 time to create 1 rle with old method : 0.00016307830810546875 time for calcul the mask position with numpy : 0.008450984954833984 nb_pixel_total : 369 time to create 1 rle with old method : 0.00047898292541503906 time for calcul the mask position with numpy : 0.008446931838989258 nb_pixel_total : 63 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.008685827255249023 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0013878345489501953 time for calcul the mask position with numpy : 0.008693695068359375 nb_pixel_total : 118 time to create 1 rle with old method : 0.00017070770263671875 time for calcul the mask position with numpy : 0.00934147834777832 nb_pixel_total : 177 time to create 1 rle with old method : 0.00023818016052246094 time for calcul the mask position with numpy : 0.008674383163452148 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004315376281738281 time for calcul the mask position with numpy : 0.014303207397460938 nb_pixel_total : 227 time to create 1 rle with old method : 0.00027823448181152344 time for calcul the mask position with numpy : 0.008504152297973633 nb_pixel_total : 376 time to create 1 rle with old method : 0.0006527900695800781 time for calcul the mask position with numpy : 0.011252164840698242 nb_pixel_total : 847 time to create 1 rle with old method : 0.001528024673461914 time for calcul the mask position with numpy : 0.014070510864257812 nb_pixel_total : 217 time to create 1 rle with old method : 0.00046825408935546875 time for calcul the mask position with numpy : 0.009529590606689453 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005831718444824219 time for calcul the mask position with numpy : 0.008533000946044922 nb_pixel_total : 142 time to create 1 rle with old method : 0.00018215179443359375 time for calcul the mask position with numpy : 0.009270668029785156 nb_pixel_total : 88 time to create 1 rle with old method : 0.00010585784912109375 time for calcul the mask position with numpy : 0.00847005844116211 nb_pixel_total : 6 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.008475303649902344 nb_pixel_total : 383 time to create 1 rle with old method : 0.00042724609375 time for calcul the mask position with numpy : 0.008458137512207031 nb_pixel_total : 84 time to create 1 rle with old method : 0.00011086463928222656 time for calcul the mask position with numpy : 0.008440494537353516 nb_pixel_total : 255 time to create 1 rle with old method : 0.0002930164337158203 time for calcul the mask position with numpy : 0.008488655090332031 nb_pixel_total : 1324 time to create 1 rle with old method : 0.001451253890991211 time for calcul the mask position with numpy : 0.008472442626953125 nb_pixel_total : 348 time to create 1 rle with old method : 0.00042366981506347656 time for calcul the mask position with numpy : 0.008431196212768555 nb_pixel_total : 511 time to create 1 rle with old method : 0.0005712509155273438 time for calcul the mask position with numpy : 0.008570194244384766 nb_pixel_total : 2804 time to create 1 rle with old method : 0.003109455108642578 time for calcul the mask position with numpy : 0.008654117584228516 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005743503570556641 time for calcul the mask position with numpy : 0.008939504623413086 nb_pixel_total : 200 time to create 1 rle with old method : 0.00028443336486816406 time for calcul the mask position with numpy : 0.008777379989624023 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004961490631103516 time for calcul the mask position with numpy : 0.008659839630126953 nb_pixel_total : 285 time to create 1 rle with old method : 0.00036072731018066406 time for calcul the mask position with numpy : 0.00847935676574707 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006229877471923828 time for calcul the mask position with numpy : 0.008461952209472656 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.008456945419311523 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002639293670654297 time for calcul the mask position with numpy : 0.008462190628051758 nb_pixel_total : 230 time to create 1 rle with old method : 0.00025844573974609375 time for calcul the mask position with numpy : 0.008467674255371094 nb_pixel_total : 17 time to create 1 rle with old method : 4.315376281738281e-05 time for calcul the mask position with numpy : 0.008839130401611328 nb_pixel_total : 602 time to create 1 rle with old method : 0.0008041858673095703 time for calcul the mask position with numpy : 0.008693456649780273 nb_pixel_total : 311 time to create 1 rle with old method : 0.00038623809814453125 time for calcul the mask position with numpy : 0.008713006973266602 nb_pixel_total : 228 time to create 1 rle with old method : 0.00036215782165527344 time for calcul the mask position with numpy : 0.008867025375366211 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003185272216796875 time for calcul the mask position with numpy : 0.009156227111816406 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002117156982421875 time for calcul the mask position with numpy : 0.008674383163452148 nb_pixel_total : 72 time to create 1 rle with old method : 9.989738464355469e-05 time for calcul the mask position with numpy : 0.008624553680419922 nb_pixel_total : 779 time to create 1 rle with old method : 0.00087738037109375 time for calcul the mask position with numpy : 0.008555173873901367 nb_pixel_total : 189 time to create 1 rle with old method : 0.00022077560424804688 time for calcul the mask position with numpy : 0.008587360382080078 nb_pixel_total : 1691 time to create 1 rle with old method : 0.0019860267639160156 time for calcul the mask position with numpy : 0.009186267852783203 nb_pixel_total : 704 time to create 1 rle with old method : 0.0009131431579589844 time for calcul the mask position with numpy : 0.009064197540283203 nb_pixel_total : 245 time to create 1 rle with old method : 0.00031304359436035156 time for calcul the mask position with numpy : 0.008692264556884766 nb_pixel_total : 35 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.009048223495483398 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009806156158447266 time for calcul the mask position with numpy : 0.00862741470336914 nb_pixel_total : 4 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.008725643157958984 nb_pixel_total : 263 time to create 1 rle with old method : 0.00035071372985839844 time for calcul the mask position with numpy : 0.011293888092041016 nb_pixel_total : 251 time to create 1 rle with old method : 0.00042176246643066406 time for calcul the mask position with numpy : 0.011675596237182617 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007102489471435547 time for calcul the mask position with numpy : 0.009173393249511719 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004673004150390625 time for calcul the mask position with numpy : 0.008992433547973633 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002276897430419922 time for calcul the mask position with numpy : 0.008589506149291992 nb_pixel_total : 53 time to create 1 rle with old method : 6.985664367675781e-05 time for calcul the mask position with numpy : 0.0086212158203125 nb_pixel_total : 63 time to create 1 rle with old method : 0.00010323524475097656 time for calcul the mask position with numpy : 0.009428977966308594 nb_pixel_total : 741 time to create 1 rle with old method : 0.0009405612945556641 time for calcul the mask position with numpy : 0.008573770523071289 nb_pixel_total : 64 time to create 1 rle with old method : 0.00010824203491210938 time for calcul the mask position with numpy : 0.008508443832397461 nb_pixel_total : 69 time to create 1 rle with old method : 0.00011157989501953125 time for calcul the mask position with numpy : 0.008854866027832031 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007050037384033203 time for calcul the mask position with numpy : 0.008701801300048828 nb_pixel_total : 407 time to create 1 rle with old method : 0.00048613548278808594 time for calcul the mask position with numpy : 0.008539438247680664 nb_pixel_total : 35 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.00848698616027832 nb_pixel_total : 211 time to create 1 rle with old method : 0.00024271011352539062 time for calcul the mask position with numpy : 0.008420228958129883 nb_pixel_total : 1748 time to create 1 rle with old method : 0.0019278526306152344 time for calcul the mask position with numpy : 0.008550882339477539 nb_pixel_total : 560 time to create 1 rle with old method : 0.00064849853515625 time for calcul the mask position with numpy : 0.008571147918701172 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.008649110794067383 nb_pixel_total : 2691 time to create 1 rle with old method : 0.0028946399688720703 time for calcul the mask position with numpy : 0.008481979370117188 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001456737518310547 time for calcul the mask position with numpy : 0.008559226989746094 nb_pixel_total : 552 time to create 1 rle with old method : 0.0006129741668701172 time for calcul the mask position with numpy : 0.00847935676574707 nb_pixel_total : 246 time to create 1 rle with old method : 0.00028634071350097656 time for calcul the mask position with numpy : 0.008468389511108398 nb_pixel_total : 5 time to create 1 rle with old method : 3.838539123535156e-05 create new chi : 2.2668917179107666 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.011139869689941406 batch 1 Loaded 180 chid ids of type : 4230 Number RLEs to save : 14800 TO DO : save crop sub photo not yet done ! save time : 4.130127668380737 nb_obj : 170 nb_hashtags : 6 time to prepare the origin masks : 2.889730453491211 time for calcul the mask position with numpy : 0.03426527976989746 nb_pixel_total : 1757490 time to create 1 rle with new method : 0.0741112232208252 time for calcul the mask position with numpy : 0.010690689086914062 nb_pixel_total : 2126 time to create 1 rle with old method : 0.0023276805877685547 time for calcul the mask position with numpy : 0.010134696960449219 nb_pixel_total : 881 time to create 1 rle with old method : 0.0009775161743164062 time for calcul the mask position with numpy : 0.009989261627197266 nb_pixel_total : 95 time to create 1 rle with old method : 0.00012087821960449219 time for calcul the mask position with numpy : 0.010404825210571289 nb_pixel_total : 36 time to create 1 rle with old method : 6.413459777832031e-05 time for calcul the mask position with numpy : 0.006424665451049805 nb_pixel_total : 65 time to create 1 rle with old method : 0.00010371208190917969 time for calcul the mask position with numpy : 0.0071868896484375 nb_pixel_total : 31 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.006587982177734375 nb_pixel_total : 19 time to create 1 rle with old method : 3.552436828613281e-05 time for calcul the mask position with numpy : 0.006405353546142578 nb_pixel_total : 1851 time to create 1 rle with old method : 0.0020601749420166016 time for calcul the mask position with numpy : 0.006272792816162109 nb_pixel_total : 437 time to create 1 rle with old method : 0.0004947185516357422 time for calcul the mask position with numpy : 0.006505012512207031 nb_pixel_total : 64 time to create 1 rle with old method : 9.036064147949219e-05 time for calcul the mask position with numpy : 0.006947517395019531 nb_pixel_total : 52 time to create 1 rle with old method : 0.00012755393981933594 time for calcul the mask position with numpy : 0.0069811344146728516 nb_pixel_total : 2624 time to create 1 rle with old method : 0.002929210662841797 time for calcul the mask position with numpy : 0.006565570831298828 nb_pixel_total : 132 time to create 1 rle with old method : 0.0001976490020751953 time for calcul the mask position with numpy : 0.006617307662963867 nb_pixel_total : 42 time to create 1 rle with old method : 6.651878356933594e-05 time for calcul the mask position with numpy : 0.0066394805908203125 nb_pixel_total : 47027 time to create 1 rle with old method : 0.0510561466217041 time for calcul the mask position with numpy : 0.007642030715942383 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0014841556549072266 time for calcul the mask position with numpy : 0.0070536136627197266 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005381107330322266 time for calcul the mask position with numpy : 0.006208181381225586 nb_pixel_total : 3791 time to create 1 rle with old method : 0.004136562347412109 time for calcul the mask position with numpy : 0.009573221206665039 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002346038818359375 time for calcul the mask position with numpy : 0.006367683410644531 nb_pixel_total : 1044 time to create 1 rle with old method : 0.001165628433227539 time for calcul the mask position with numpy : 0.006201744079589844 nb_pixel_total : 112 time to create 1 rle with old method : 0.00016689300537109375 time for calcul the mask position with numpy : 0.006303310394287109 nb_pixel_total : 1884 time to create 1 rle with old method : 0.0020661354064941406 time for calcul the mask position with numpy : 0.0061838626861572266 nb_pixel_total : 5190 time to create 1 rle with old method : 0.0058345794677734375 time for calcul the mask position with numpy : 0.006448030471801758 nb_pixel_total : 183 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.006331920623779297 nb_pixel_total : 220 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.006195545196533203 nb_pixel_total : 705 time to create 1 rle with old method : 0.0007956027984619141 time for calcul the mask position with numpy : 0.006018638610839844 nb_pixel_total : 95 time to create 1 rle with old method : 0.00014162063598632812 time for calcul the mask position with numpy : 0.006259918212890625 nb_pixel_total : 6274 time to create 1 rle with old method : 0.007191896438598633 time for calcul the mask position with numpy : 0.006334781646728516 nb_pixel_total : 513 time to create 1 rle with old method : 0.0005707740783691406 time for calcul the mask position with numpy : 0.0061533451080322266 nb_pixel_total : 206 time to create 1 rle with old method : 0.00023484230041503906 time for calcul the mask position with numpy : 0.0061185359954833984 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004413127899169922 time for calcul the mask position with numpy : 0.006129264831542969 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005013942718505859 time for calcul the mask position with numpy : 0.009383201599121094 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0018639564514160156 time for calcul the mask position with numpy : 0.006161212921142578 nb_pixel_total : 10710 time to create 1 rle with old method : 0.011452674865722656 time for calcul the mask position with numpy : 0.006165027618408203 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006108283996582031 time for calcul the mask position with numpy : 0.006068229675292969 nb_pixel_total : 105 time to create 1 rle with old method : 0.00013566017150878906 time for calcul the mask position with numpy : 0.006148338317871094 nb_pixel_total : 158 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.0060389041900634766 nb_pixel_total : 1206 time to create 1 rle with old method : 0.0013306140899658203 time for calcul the mask position with numpy : 0.007848978042602539 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005366802215576172 time for calcul the mask position with numpy : 0.0060482025146484375 nb_pixel_total : 254 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.006049156188964844 nb_pixel_total : 523 time to create 1 rle with old method : 0.0005805492401123047 time for calcul the mask position with numpy : 0.005967140197753906 nb_pixel_total : 26 time to create 1 rle with old method : 6.842613220214844e-05 time for calcul the mask position with numpy : 0.006308794021606445 nb_pixel_total : 439 time to create 1 rle with old method : 0.00048828125 time for calcul the mask position with numpy : 0.006127119064331055 nb_pixel_total : 200 time to create 1 rle with old method : 0.00023293495178222656 time for calcul the mask position with numpy : 0.006093025207519531 nb_pixel_total : 1292 time to create 1 rle with old method : 0.001447916030883789 time for calcul the mask position with numpy : 0.0060253143310546875 nb_pixel_total : 7026 time to create 1 rle with old method : 0.011037826538085938 time for calcul the mask position with numpy : 0.0065081119537353516 nb_pixel_total : 93 time to create 1 rle with old method : 0.00011968612670898438 time for calcul the mask position with numpy : 0.006433248519897461 nb_pixel_total : 416 time to create 1 rle with old method : 0.0004863739013671875 time for calcul the mask position with numpy : 0.008665323257446289 nb_pixel_total : 408 time to create 1 rle with old method : 0.00047516822814941406 time for calcul the mask position with numpy : 0.006405353546142578 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0014140605926513672 time for calcul the mask position with numpy : 0.0067827701568603516 nb_pixel_total : 752 time to create 1 rle with old method : 0.0008823871612548828 time for calcul the mask position with numpy : 0.006087541580200195 nb_pixel_total : 4164 time to create 1 rle with old method : 0.004542350769042969 time for calcul the mask position with numpy : 0.006232261657714844 nb_pixel_total : 13326 time to create 1 rle with old method : 0.014403820037841797 time for calcul the mask position with numpy : 0.0061190128326416016 nb_pixel_total : 427 time to create 1 rle with old method : 0.00047469139099121094 time for calcul the mask position with numpy : 0.006008148193359375 nb_pixel_total : 1220 time to create 1 rle with old method : 0.0013599395751953125 time for calcul the mask position with numpy : 0.006078004837036133 nb_pixel_total : 753 time to create 1 rle with old method : 0.0008542537689208984 time for calcul the mask position with numpy : 0.0060749053955078125 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003540515899658203 time for calcul the mask position with numpy : 0.009399890899658203 nb_pixel_total : 176 time to create 1 rle with old method : 0.00021505355834960938 time for calcul the mask position with numpy : 0.006264686584472656 nb_pixel_total : 59 time to create 1 rle with old method : 0.00011491775512695312 time for calcul the mask position with numpy : 0.00605463981628418 nb_pixel_total : 957 time to create 1 rle with old method : 0.001081705093383789 time for calcul the mask position with numpy : 0.007040500640869141 nb_pixel_total : 9763 time to create 1 rle with old method : 0.010657310485839844 time for calcul the mask position with numpy : 0.006154060363769531 nb_pixel_total : 3828 time to create 1 rle with old method : 0.004129886627197266 time for calcul the mask position with numpy : 0.006190061569213867 nb_pixel_total : 82 time to create 1 rle with old method : 0.00018453598022460938 time for calcul the mask position with numpy : 0.006093740463256836 nb_pixel_total : 2589 time to create 1 rle with old method : 0.0040166378021240234 time for calcul the mask position with numpy : 0.007921695709228516 nb_pixel_total : 88 time to create 1 rle with old method : 0.000110626220703125 time for calcul the mask position with numpy : 0.006009817123413086 nb_pixel_total : 160 time to create 1 rle with old method : 0.00024509429931640625 time for calcul the mask position with numpy : 0.006065845489501953 nb_pixel_total : 81 time to create 1 rle with old method : 0.00010704994201660156 time for calcul the mask position with numpy : 0.0060079097747802734 nb_pixel_total : 1441 time to create 1 rle with old method : 0.0016467571258544922 time for calcul the mask position with numpy : 0.005984783172607422 nb_pixel_total : 692 time to create 1 rle with old method : 0.0007600784301757812 time for calcul the mask position with numpy : 0.005982875823974609 nb_pixel_total : 316 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.009481430053710938 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0013513565063476562 time for calcul the mask position with numpy : 0.0066225528717041016 nb_pixel_total : 794 time to create 1 rle with old method : 0.0009200572967529297 time for calcul the mask position with numpy : 0.007447957992553711 nb_pixel_total : 654 time to create 1 rle with old method : 0.0007367134094238281 time for calcul the mask position with numpy : 0.007171630859375 nb_pixel_total : 1809 time to create 1 rle with old method : 0.002002716064453125 time for calcul the mask position with numpy : 0.006126880645751953 nb_pixel_total : 182 time to create 1 rle with old method : 0.00022554397583007812 time for calcul the mask position with numpy : 0.006200313568115234 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013399124145507812 time for calcul the mask position with numpy : 0.0063359737396240234 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007431507110595703 time for calcul the mask position with numpy : 0.006362199783325195 nb_pixel_total : 328 time to create 1 rle with old method : 0.0003883838653564453 time for calcul the mask position with numpy : 0.006215810775756836 nb_pixel_total : 660 time to create 1 rle with old method : 0.0011429786682128906 time for calcul the mask position with numpy : 0.007114887237548828 nb_pixel_total : 19 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.006778717041015625 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003609657287597656 time for calcul the mask position with numpy : 0.0068128108978271484 nb_pixel_total : 37 time to create 1 rle with old method : 8.249282836914062e-05 time for calcul the mask position with numpy : 0.006501197814941406 nb_pixel_total : 268 time to create 1 rle with old method : 0.00046133995056152344 time for calcul the mask position with numpy : 0.006715536117553711 nb_pixel_total : 241 time to create 1 rle with old method : 0.00041747093200683594 time for calcul the mask position with numpy : 0.012575626373291016 nb_pixel_total : 645 time to create 1 rle with old method : 0.0010793209075927734 time for calcul the mask position with numpy : 0.007269620895385742 nb_pixel_total : 765 time to create 1 rle with old method : 0.0013384819030761719 time for calcul the mask position with numpy : 0.006618499755859375 nb_pixel_total : 44 time to create 1 rle with old method : 0.00010180473327636719 time for calcul the mask position with numpy : 0.006626605987548828 nb_pixel_total : 466 time to create 1 rle with old method : 0.0008118152618408203 time for calcul the mask position with numpy : 0.00640559196472168 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001304149627685547 time for calcul the mask position with numpy : 0.0061914920806884766 nb_pixel_total : 227 time to create 1 rle with old method : 0.00036263465881347656 time for calcul the mask position with numpy : 0.006100893020629883 nb_pixel_total : 534 time to create 1 rle with old method : 0.0006034374237060547 time for calcul the mask position with numpy : 0.0062563419342041016 nb_pixel_total : 31 time to create 1 rle with old method : 5.173683166503906e-05 time for calcul the mask position with numpy : 0.006180763244628906 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003037452697753906 time for calcul the mask position with numpy : 0.006989240646362305 nb_pixel_total : 106586 time to create 1 rle with old method : 0.1409912109375 time for calcul the mask position with numpy : 0.00699305534362793 nb_pixel_total : 1011 time to create 1 rle with old method : 0.0012900829315185547 time for calcul the mask position with numpy : 0.006539821624755859 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002353191375732422 time for calcul the mask position with numpy : 0.006252288818359375 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002524852752685547 time for calcul the mask position with numpy : 0.010230779647827148 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007290840148925781 time for calcul the mask position with numpy : 0.007798433303833008 nb_pixel_total : 1841 time to create 1 rle with old method : 0.002219676971435547 time for calcul the mask position with numpy : 0.010244369506835938 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005178451538085938 time for calcul the mask position with numpy : 0.009992837905883789 nb_pixel_total : 55 time to create 1 rle with old method : 8.320808410644531e-05 time for calcul the mask position with numpy : 0.010100364685058594 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020194053649902344 time for calcul the mask position with numpy : 0.010608434677124023 nb_pixel_total : 153 time to create 1 rle with old method : 0.00034236907958984375 time for calcul the mask position with numpy : 0.011640548706054688 nb_pixel_total : 7 time to create 1 rle with old method : 3.62396240234375e-05 time for calcul the mask position with numpy : 0.010430574417114258 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006392002105712891 time for calcul the mask position with numpy : 0.010265827178955078 nb_pixel_total : 14154 time to create 1 rle with old method : 0.01557159423828125 time for calcul the mask position with numpy : 0.010174751281738281 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004069805145263672 time for calcul the mask position with numpy : 0.010439157485961914 nb_pixel_total : 582 time to create 1 rle with old method : 0.000993967056274414 time for calcul the mask position with numpy : 0.010403633117675781 nb_pixel_total : 283 time to create 1 rle with old method : 0.00035190582275390625 time for calcul the mask position with numpy : 0.010327339172363281 nb_pixel_total : 483 time to create 1 rle with old method : 0.0005457401275634766 time for calcul the mask position with numpy : 0.010551691055297852 nb_pixel_total : 168 time to create 1 rle with old method : 0.00021600723266601562 time for calcul the mask position with numpy : 0.010218620300292969 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002856254577636719 time for calcul the mask position with numpy : 0.01028752326965332 nb_pixel_total : 229 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.010225534439086914 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001232624053955078 time for calcul the mask position with numpy : 0.010057449340820312 nb_pixel_total : 61 time to create 1 rle with old method : 0.00012350082397460938 time for calcul the mask position with numpy : 0.010141849517822266 nb_pixel_total : 1164 time to create 1 rle with old method : 0.00130462646484375 time for calcul the mask position with numpy : 0.0101776123046875 nb_pixel_total : 5033 time to create 1 rle with old method : 0.005829334259033203 time for calcul the mask position with numpy : 0.014473199844360352 nb_pixel_total : 392 time to create 1 rle with old method : 0.0004923343658447266 time for calcul the mask position with numpy : 0.010238885879516602 nb_pixel_total : 10 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.010143518447875977 nb_pixel_total : 368 time to create 1 rle with old method : 0.00044536590576171875 time for calcul the mask position with numpy : 0.010355949401855469 nb_pixel_total : 408 time to create 1 rle with old method : 0.0004985332489013672 time for calcul the mask position with numpy : 0.011021137237548828 nb_pixel_total : 14 time to create 1 rle with old method : 6.341934204101562e-05 time for calcul the mask position with numpy : 0.010561704635620117 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002262592315673828 time for calcul the mask position with numpy : 0.010409116744995117 nb_pixel_total : 147 time to create 1 rle with old method : 0.00019049644470214844 time for calcul the mask position with numpy : 0.010592222213745117 nb_pixel_total : 80 time to create 1 rle with old method : 0.00011563301086425781 time for calcul the mask position with numpy : 0.01109623908996582 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003104209899902344 time for calcul the mask position with numpy : 0.012151479721069336 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004210472106933594 time for calcul the mask position with numpy : 0.012541055679321289 nb_pixel_total : 166 time to create 1 rle with old method : 0.00048828125 time for calcul the mask position with numpy : 0.013720273971557617 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0014879703521728516 time for calcul the mask position with numpy : 0.011516809463500977 nb_pixel_total : 416 time to create 1 rle with old method : 0.000507354736328125 time for calcul the mask position with numpy : 0.010935783386230469 nb_pixel_total : 2900 time to create 1 rle with old method : 0.003603696823120117 time for calcul the mask position with numpy : 0.011089563369750977 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006794929504394531 time for calcul the mask position with numpy : 0.011158466339111328 nb_pixel_total : 146 time to create 1 rle with old method : 0.00021600723266601562 time for calcul the mask position with numpy : 0.011749505996704102 nb_pixel_total : 283 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.012061357498168945 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005662441253662109 time for calcul the mask position with numpy : 0.011988162994384766 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005030632019042969 time for calcul the mask position with numpy : 0.015299797058105469 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003151893615722656 time for calcul the mask position with numpy : 0.01183629035949707 nb_pixel_total : 683 time to create 1 rle with old method : 0.0008325576782226562 time for calcul the mask position with numpy : 0.011521100997924805 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003001689910888672 time for calcul the mask position with numpy : 0.011820793151855469 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003452301025390625 time for calcul the mask position with numpy : 0.012297391891479492 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007293224334716797 time for calcul the mask position with numpy : 0.012097358703613281 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004627704620361328 time for calcul the mask position with numpy : 0.012422561645507812 nb_pixel_total : 43 time to create 1 rle with old method : 0.00010204315185546875 time for calcul the mask position with numpy : 0.013781547546386719 nb_pixel_total : 247 time to create 1 rle with old method : 0.00035500526428222656 time for calcul the mask position with numpy : 0.013417482376098633 nb_pixel_total : 185 time to create 1 rle with old method : 0.00025534629821777344 time for calcul the mask position with numpy : 0.012495756149291992 nb_pixel_total : 1 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.012510299682617188 nb_pixel_total : 691 time to create 1 rle with old method : 0.0009713172912597656 time for calcul the mask position with numpy : 0.012306928634643555 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003218650817871094 time for calcul the mask position with numpy : 0.01245260238647461 nb_pixel_total : 712 time to create 1 rle with old method : 0.0010104179382324219 time for calcul the mask position with numpy : 0.013354778289794922 nb_pixel_total : 1513 time to create 1 rle with old method : 0.0019991397857666016 time for calcul the mask position with numpy : 0.01213526725769043 nb_pixel_total : 88 time to create 1 rle with old method : 0.00022745132446289062 time for calcul the mask position with numpy : 0.012337446212768555 nb_pixel_total : 809 time to create 1 rle with old method : 0.0010745525360107422 time for calcul the mask position with numpy : 0.012529850006103516 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003173351287841797 time for calcul the mask position with numpy : 0.012999534606933594 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.017117023468017578 nb_pixel_total : 102 time to create 1 rle with old method : 0.00018334388732910156 time for calcul the mask position with numpy : 0.011355876922607422 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005085468292236328 time for calcul the mask position with numpy : 0.011623620986938477 nb_pixel_total : 170 time to create 1 rle with old method : 0.00025177001953125 time for calcul the mask position with numpy : 0.012111186981201172 nb_pixel_total : 751 time to create 1 rle with old method : 0.0010418891906738281 time for calcul the mask position with numpy : 0.012704849243164062 nb_pixel_total : 62 time to create 1 rle with old method : 0.00010323524475097656 time for calcul the mask position with numpy : 0.012034177780151367 nb_pixel_total : 707 time to create 1 rle with old method : 0.0009045600891113281 time for calcul the mask position with numpy : 0.012320518493652344 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005810260772705078 time for calcul the mask position with numpy : 0.012859106063842773 nb_pixel_total : 592 time to create 1 rle with old method : 0.0009086132049560547 time for calcul the mask position with numpy : 0.011643648147583008 nb_pixel_total : 33 time to create 1 rle with old method : 7.176399230957031e-05 time for calcul the mask position with numpy : 0.01211094856262207 nb_pixel_total : 217 time to create 1 rle with old method : 0.0003113746643066406 time for calcul the mask position with numpy : 0.01254129409790039 nb_pixel_total : 1635 time to create 1 rle with old method : 0.0021820068359375 time for calcul the mask position with numpy : 0.013295412063598633 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007960796356201172 time for calcul the mask position with numpy : 0.01300811767578125 nb_pixel_total : 2859 time to create 1 rle with old method : 0.0032498836517333984 time for calcul the mask position with numpy : 0.010994911193847656 nb_pixel_total : 232 time to create 1 rle with old method : 0.0004227161407470703 time for calcul the mask position with numpy : 0.009676456451416016 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004494190216064453 time for calcul the mask position with numpy : 0.010408639907836914 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005848407745361328 create new chi : 2.0061681270599365 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0019190311431884766 batch 1 Loaded 171 chid ids of type : 4230 Number RLEs to save : 15523 TO DO : save crop sub photo not yet done ! save time : 1.1479368209838867 map_output_result : {1333463758: (0.0, 'Should be the crop_list due to order', 0.0), 1333463755: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333463758, 1333463755] Looping around the photos to save general results len do output : 2 /1333463758.Didn't retrieve data . /1333463755.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463758', None, None, None, None, None, '2535873') ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463755', None, None, None, None, None, '2535873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.0874173641204834 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.107321739196777 time spend to save output : 0.08797478675842285 total time spend for step 4 : 14.1952965259552 step5:crop_condition Sat Feb 1 04:21:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 351 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 150 About to insert : list_path_to_insert length 150 new photo from crops ! About to upload 150 photos upload in portfolio : 4869462 init cache_photo without model_param we have 150 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738380077_3156038 we have uploaded 150 photos in the portfolio 4869462 time of upload the photos Elapsed time : 37.6556453704834 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 4869462 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738380115_3156038 we have uploaded 39 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.46064805984497 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738380128_3156038 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.082711935043335 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738380132_3156038 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.894392967224121 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 4869462 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738380137_3156038 we have uploaded 40 photos in the portfolio 4869462 time of upload the photos Elapsed time : 16.5588059425354 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738380154_3156038 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.0899138450622559 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333463758, 1333463755] Looping around the photos to save general results len do output : 246 /1333585521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333585796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463758', None, None, None, None, None, '2535873') ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463755', None, None, None, None, None, '2535873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 740 time used for this insertion : 0.09207653999328613 save_final save missing photos in datou_result : time spend for datou_step_exec : 81.82554268836975 time spend to save output : 0.09919166564941406 total time spend for step 5 : 81.92473435401917 step6:thcl Sat Feb 1 04:22:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.011727571487426758 time to convert the images to numpy array : 0.07154512405395508 time to import caffe and check if the image exist : 0.014049053192138672 time to convert the images to numpy array : 0.07110929489135742 time to import caffe and check if the image exist : 0.018343210220336914 time to convert the images to numpy array : 0.08293724060058594 time to import caffe and check if the image exist : 0.026101350784301758 time to convert the images to numpy array : 0.07600212097167969 time to import caffe and check if the image exist : 0.021687746047973633 time to convert the images to numpy array : 0.0821998119354248 time to import caffe and check if the image exist : 0.035152435302734375 time to convert the images to numpy array : 0.07059979438781738 time to import caffe and check if the image exist : 0.030338048934936523 time to convert the images to numpy array : 0.07558488845825195 time to import caffe and check if the image exist : 0.020502805709838867 time to convert the images to numpy array : 0.08519244194030762 time to import caffe and check if the image exist : 0.02265024185180664 time to convert the images to numpy array : 0.08491039276123047 time to import caffe and check if the image exist : 0.021692752838134766 time to convert the images to numpy array : 0.08644747734069824 total time to convert the images to numpy array : 0.4159657955169678 list photo_ids error: [] list photo_ids correct : [1333585600, 1333585601, 1333585602, 1333585603, 1333585604, 1333585606, 1333585607, 1333585608, 1333585609, 1333585610, 1333585611, 1333585612, 1333585613, 1333585614, 1333585615, 1333585616, 1333585617, 1333585618, 1333585619, 1333585620, 1333585621, 1333585622, 1333585623, 1333585624, 1333585625, 1333585772, 1333585773, 1333585774, 1333585775, 1333585776, 1333585777, 1333585780, 1333585781, 1333585782, 1333585783, 1333585786, 1333585787, 1333585788, 1333585789, 1333585790, 1333585791, 1333585792, 1333585793, 1333585794, 1333585795, 1333585796, 1333585651, 1333585652, 1333585654, 1333585655, 1333585656, 1333585657, 1333585658, 1333585659, 1333585660, 1333585661, 1333585662, 1333585664, 1333585665, 1333585666, 1333585667, 1333585668, 1333585669, 1333585670, 1333585671, 1333585672, 1333585673, 1333585674, 1333585675, 1333585676, 1333585677, 1333585681, 1333585682, 1333585683, 1333585684, 1333585685, 1333585686, 1333585687, 1333585688, 1333585689, 1333585690, 1333585691, 1333585692, 1333585693, 1333585694, 1333585695, 1333585696, 1333585697, 1333585698, 1333585699, 1333585700, 1333585701, 1333585702, 1333585703, 1333585704, 1333585705, 1333585521, 1333585522, 1333585523, 1333585524, 1333585525, 1333585526, 1333585527, 1333585528, 1333585529, 1333585531, 1333585532, 1333585533, 1333585534, 1333585535, 1333585536, 1333585538, 1333585539, 1333585540, 1333585541, 1333585542, 1333585544, 1333585545, 1333585546, 1333585547, 1333585548, 1333585549, 1333585550, 1333585551, 1333585552, 1333585553, 1333585554, 1333585555, 1333585556, 1333585557, 1333585558, 1333585559, 1333585560, 1333585561, 1333585562, 1333585563, 1333585564, 1333585565, 1333585566, 1333585567, 1333585568, 1333585569, 1333585570, 1333585571, 1333585572, 1333585573, 1333585574, 1333585575, 1333585576, 1333585577, 1333585578, 1333585579, 1333585580, 1333585581, 1333585582, 1333585583, 1333585584, 1333585585, 1333585586, 1333585587, 1333585588, 1333585589, 1333585590, 1333585591, 1333585592, 1333585593, 1333585594, 1333585595, 1333585596, 1333585598, 1333585599, 1333585738, 1333585739, 1333585742, 1333585743, 1333585747, 1333585748, 1333585749, 1333585750, 1333585751, 1333585753, 1333585754, 1333585755, 1333585756, 1333585758, 1333585759, 1333585761, 1333585762, 1333585763, 1333585764, 1333585765, 1333585766, 1333585767, 1333585769, 1333585770, 1333585771, 1333585626, 1333585627, 1333585628, 1333585629, 1333585630, 1333585631, 1333585632, 1333585633, 1333585634, 1333585635, 1333585636, 1333585637, 1333585638, 1333585639, 1333585640, 1333585641, 1333585642, 1333585643, 1333585644, 1333585645, 1333585646, 1333585647, 1333585648, 1333585649, 1333585650, 1333585706, 1333585707, 1333585708, 1333585709, 1333585710, 1333585711, 1333585712, 1333585713, 1333585714, 1333585717, 1333585718, 1333585719, 1333585720, 1333585721, 1333585722, 1333585728, 1333585729, 1333585730, 1333585731, 1333585732, 1333585733, 1333585734, 1333585735, 1333585736, 1333585737] number of photos to traite : 246 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10555 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10334 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.1585674285888672 time used to do the prediction : 0.8966233730316162 save descriptor for thcl : 3237 time to traite the descriptors : 1.4348437786102295 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333585600 To insert : 1333585601 To insert : 1333585602 To insert : 1333585603 To insert : 1333585604 To insert : 1333585606 To insert : 1333585607 To insert : 1333585608 To insert : 1333585609 To insert : 1333585610 To insert : 1333585611 To insert : 1333585612 To insert : 1333585613 To insert : 1333585614 To insert : 1333585615 To insert : 1333585616 To insert : 1333585617 To insert : 1333585618 To insert : 1333585619 To insert : 1333585620 To insert : 1333585621 To insert : 1333585622 To insert : 1333585623 To insert : 1333585624 To insert : 1333585625 To insert : 1333585772 To insert : 1333585773 To insert : 1333585774 To insert : 1333585775 To insert : 1333585776 To insert : 1333585777 To insert : 1333585780 To insert : 1333585781 To insert : 1333585782 To insert : 1333585783 To insert : 1333585786 To insert : 1333585787 To insert : 1333585788 To insert : 1333585789 To insert : 1333585790 To insert : 1333585791 To insert : 1333585792 To insert : 1333585793 To insert : 1333585794 To insert : 1333585795 To insert : 1333585796 To insert : 1333585651 To insert : 1333585652 To insert : 1333585654 To insert : 1333585655 To insert : 1333585656 To insert : 1333585657 To insert : 1333585658 To insert : 1333585659 To insert : 1333585660 To insert : 1333585661 To insert : 1333585662 To insert : 1333585664 To insert : 1333585665 To insert : 1333585666 To insert : 1333585667 To insert : 1333585668 To insert : 1333585669 To insert : 1333585670 To insert : 1333585671 To insert : 1333585672 To insert : 1333585673 To insert : 1333585674 To insert : 1333585675 To insert : 1333585676 To insert : 1333585677 To insert : 1333585681 To insert : 1333585682 To insert : 1333585683 To insert : 1333585684 To insert : 1333585685 To insert : 1333585686 To insert : 1333585687 To insert : 1333585688 To insert : 1333585689 To insert : 1333585690 To insert : 1333585691 To insert : 1333585692 To insert : 1333585693 To insert : 1333585694 To insert : 1333585695 To insert : 1333585696 To insert : 1333585697 To insert : 1333585698 To insert : 1333585699 To insert : 1333585700 To insert : 1333585701 To insert : 1333585702 To insert : 1333585703 To insert : 1333585704 To insert : 1333585705 To insert : 1333585521 To insert : 1333585522 To insert : 1333585523 To insert : 1333585524 To insert : 1333585525 To insert : 1333585526 To insert : 1333585527 To insert : 1333585528 To insert : 1333585529 To insert : 1333585531 To insert : 1333585532 To insert : 1333585533 To insert : 1333585534 To insert : 1333585535 To insert : 1333585536 To insert : 1333585538 To insert : 1333585539 To insert : 1333585540 To insert : 1333585541 To insert : 1333585542 To insert : 1333585544 To insert : 1333585545 To insert : 1333585546 To insert : 1333585547 To insert : 1333585548 To insert : 1333585549 To insert : 1333585550 To insert : 1333585551 To insert : 1333585552 To insert : 1333585553 To insert : 1333585554 To insert : 1333585555 To insert : 1333585556 To insert : 1333585557 To insert : 1333585558 To insert : 1333585559 To insert : 1333585560 To insert : 1333585561 To insert : 1333585562 To insert : 1333585563 To insert : 1333585564 To insert : 1333585565 To insert : 1333585566 To insert : 1333585567 To insert : 1333585568 To insert : 1333585569 To insert : 1333585570 To insert : 1333585571 To insert : 1333585572 To insert : 1333585573 To insert : 1333585574 To insert : 1333585575 To insert : 1333585576 To insert : 1333585577 To insert : 1333585578 To insert : 1333585579 To insert : 1333585580 To insert : 1333585581 To insert : 1333585582 To insert : 1333585583 To insert : 1333585584 To insert : 1333585585 To insert : 1333585586 To insert : 1333585587 To insert : 1333585588 To insert : 1333585589 To insert : 1333585590 To insert : 1333585591 To insert : 1333585592 To insert : 1333585593 To insert : 1333585594 To insert : 1333585595 To insert : 1333585596 To insert : 1333585598 To insert : 1333585599 To insert : 1333585738 To insert : 1333585739 To insert : 1333585742 To insert : 1333585743 To insert : 1333585747 To insert : 1333585748 To insert : 1333585749 To insert : 1333585750 To insert : 1333585751 To insert : 1333585753 To insert : 1333585754 To insert : 1333585755 To insert : 1333585756 To insert : 1333585758 To insert : 1333585759 To insert : 1333585761 To insert : 1333585762 To insert : 1333585763 To insert : 1333585764 To insert : 1333585765 To insert : 1333585766 To insert : 1333585767 To insert : 1333585769 To insert : 1333585770 To insert : 1333585771 To insert : 1333585626 To insert : 1333585627 To insert : 1333585628 To insert : 1333585629 To insert : 1333585630 To insert : 1333585631 To insert : 1333585632 To insert : 1333585633 To insert : 1333585634 To insert : 1333585635 To insert : 1333585636 To insert : 1333585637 To insert : 1333585638 To insert : 1333585639 To insert : 1333585640 To insert : 1333585641 To insert : 1333585642 To insert : 1333585643 To insert : 1333585644 To insert : 1333585645 To insert : 1333585646 To insert : 1333585647 To insert : 1333585648 To insert : 1333585649 To insert : 1333585650 To insert : 1333585706 To insert : 1333585707 To insert : 1333585708 To insert : 1333585709 To insert : 1333585710 To insert : 1333585711 To insert : 1333585712 To insert : 1333585713 To insert : 1333585714 To insert : 1333585717 To insert : 1333585718 To insert : 1333585719 To insert : 1333585720 To insert : 1333585721 To insert : 1333585722 To insert : 1333585728 To insert : 1333585729 To insert : 1333585730 To insert : 1333585731 To insert : 1333585732 To insert : 1333585733 To insert : 1333585734 To insert : 1333585735 To insert : 1333585736 To insert : 1333585737 time to insert the descriptors : 39.612892389297485 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 374 time used for this insertion : 0.14530158042907715 save missing photos in datou_result : time spend for datou_step_exec : 47.78717017173767 time spend to save output : 0.19907784461975098 total time spend for step 6 : 47.98624801635742 step7:ventilate_hashtags_in_portfolio Sat Feb 1 04:23:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20127279 get user id for portfolio 20127279 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127279 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Carton','Film_plastique','PET_fonce','Papier','environnement','PEHD','flou','carton','metal','refus','Tetrapak','autre','PET_clair','pet_fonce','papier','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127279 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Carton','Film_plastique','PET_fonce','Papier','environnement','PEHD','flou','carton','metal','refus','Tetrapak','autre','PET_clair','pet_fonce','papier','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127279 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Carton','Film_plastique','PET_fonce','Papier','environnement','PEHD','flou','carton','metal','refus','Tetrapak','autre','PET_clair','pet_fonce','papier','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127279 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Carton','Film_plastique','PET_fonce','Papier','environnement','PEHD','flou','carton','metal','refus','Tetrapak','autre','PET_clair','pet_fonce','papier','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20134199,20134201,20134195,20134207,20134208,20134198,20134200,20134202,20134203,20134204,20134205,20134210,20134209?tags=pehd,carton,film_plastique,pet_fonce,papier,environnement,flou,metal,refus,tetrapak,autre,pet_clair,mal_croppe&datou_id_consolidate=4235&port_consolidate=20127279 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333463758, 1333463755] Looping around the photos to save general results len do output : 1 /20127279. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463758', None, None, None, None, None, '2535873') ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463755', None, None, None, None, None, '2535873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.016945838928222656 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.166947364807129 time spend to save output : 0.0172274112701416 total time spend for step 7 : 4.1841747760772705 step8:final Sat Feb 1 04:23:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333463758: ('0.2277805082446173',), 1333463755: ('0.2277805082446173',)} new output for save of step final : {1333463758: ('0.2277805082446173',), 1333463755: ('0.2277805082446173',)} [1333463758, 1333463755] Looping around the photos to save general results len do output : 2 /1333463758.Didn't retrieve data . /1333463755.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463758', None, None, None, None, None, '2535873') ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463755', None, None, None, None, None, '2535873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012706756591796875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11623764038085938 time spend to save output : 0.01297616958618164 total time spend for step 8 : 0.12921380996704102 step9:velours_tree Sat Feb 1 04:23:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20134199,20134201,20134195,20134207,20134208,20134198,20134200,20134202,20134203,20134204,20134205,20134210,20134209 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134199 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134201 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134195 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134207 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134208 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134198 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134200 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134202 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134203 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134204 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134205 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134210 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20134209 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 246 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 5 1 3 2 1 1 1 2 0 0 4 0 2 4 4 1 2 4 4 2 2 2 2 0 1 2 2 2 4 2 4 0 0 2 2 0 2 2 4 0 4 0 4 3 0 2 4 4 2 0 2 2 4 3 2 2 4 2 2 2 4 3 1 2 1 4 2 2 0 0 2 1 0 2 5 0 2 1 2 2 1 5 5 1 4 1 2 0 4 0 0 2 3 2 4 1 2 2 2 4 3 0 2 1 2 3 0 0 0 2 3 2 0 2 4 0 4 2 0 2 4 4 4 2 4 2 4 0 2 2 0 2 2 4 3 1 3 2 3 0 2 5 1 0 2 0 2 2 2 5 3 2 3 2 0 0 0 0 0 0 4 1 1 2 0 1 2 3 5 2 2 0 1 2 2 2 0 0 0 0 1 0 1 1 0 0 2 2 2 4 2 2 3 2 3 3 1 0 4 3 2 3 3 2 0 3 5 1 1 3 2 5 0 4 3 3 3 0 3 3 0 0 3 5 0 1 2 2 2 2 0 2 2 2 5 4 3 0 2 3 3 0 2 4 4] Elapsed time: 0.039528608322143555 graph_id used : 74939 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20134199,20134201,20134195,20134207,20134208,20134198,20134200,20134202,20134203,20134204,20134205,20134210,20134209?tags=pehd,carton,film_plastique,pet_fonce,papier,environnement,flou,metal,refus,tetrapak,autre,pet_clair,mal_croppe&datou_id_consolidate=4235&port_consolidate=20127279&tree_id=74939 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1333463758, 1333463755] Looping around the photos to save general results len do output : 1 /20127279Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463758', None, None, None, None, None, '2535873') ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463755', None, None, None, None, None, '2535873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.014336585998535156 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.566039085388184 time spend to save output : 0.014637947082519531 total time spend for step 9 : 19.580677032470703 step10:send_mail_cod Sat Feb 1 04:23:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20127279_01-02-2025_04_23_49.pdf 20134157 imagette201341571738380229 20134159 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201341591738380229 20134153 imagette201341531738380229 20134165 change filename to text .change filename to text .imagette201341651738380229 20134166 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201341661738380230 20134158 imagette201341581738380231 20134160 change filename to text .imagette201341601738380231 20134161 imagette201341611738380231 20134162 imagette201341621738380231 20134163 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201341631738380231 20134172 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201341721738380231 20134167 imagette201341671738380232 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20127279 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20134199,20134201,20134195,20134207,20134208,20134198,20134200,20134202,20134203,20134204,20134205,20134210,20134209?tags=pehd,carton,film_plastique,pet_fonce,papier,environnement,flou,metal,refus,tetrapak,autre,pet_clair,mal_croppe&datou_id_consolidate=4235&port_consolidate=20127279&tree_id=74939 your option no_mail is active, we will not send the real mail to your client args[1333463758] : ((1333463758, -8.060805400040058, 492609224), (1333463758, -0.18962187826324095, 496442774), '0.2277805082446173') We are sending mail with results at cod@fotonower.com args[1333463755] : ((1333463755, -8.050506030111803, 492609224), (1333463755, -0.16258073924290709, 496442774), '0.2277805082446173') We are sending mail with results at cod@fotonower.com refus_total : 0.2277805082446173 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127279 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127279_01-02-2025_04_23_49.pdf results_Qualipapia_P20127279_01-02-2025_04_23_49.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127279_01-02-2025_04_23_49.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20127279','results_Qualipapia_P20127279_01-02-2025_04_23_49.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127279_01-02-2025_04_23_49.pdf','pdf','','0.16','0.2277805082446173') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333463758, 1333463755] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463758', None, None, None, None, None, '2535873') ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463755', None, None, None, None, None, '2535873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.014515161514282227 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.514917612075806 time spend to save output : 0.014672279357910156 total time spend for step 10 : 4.529589891433716 step11:split_time_score Sat Feb 1 04:23:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 31012025 20127279 Nombre de photos uploadées : 2 / 23040 (0%) 31012025 20127279 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 31012025 20127279 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.0002052783966064453 elapsed_time : insert_dashboard_record_day_entry 0.02599644660949707 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.16675929361879244 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20104701_31-01-2025_08_52_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104701 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104701 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106630 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106631 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106632 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106633 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106634 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106635 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106636 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106637 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106638 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106639 order by id desc limit 1 Qualite : 0.19140746727627336 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20106640_31-01-2025_09_48_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106640 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20106640 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106641 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108219 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108222 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108224 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108226 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108227 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108229 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108231 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108233 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108237 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108239 order by id desc limit 1 Qualite : 0.2536259478254959 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20115128_31-01-2025_18_26_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115128 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115128 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110610 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110613 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110616 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110618 order by id desc limit 1 Qualite : 0.25117894084688863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110621_31-01-2025_11_49_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110621 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110621 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110623 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110625 order by id desc limit 1 Qualite : 0.2879457038717212 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110626_31-01-2025_11_33_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110626 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110626 AND mptpi.`type`=4230 To do Qualite : 0.29441342724686403 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110628_31-01-2025_11_19_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110628 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110628 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114557 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114558 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114560 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114561 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114562 order by id desc limit 1 Qualite : 0.23808314138688313 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114563_31-01-2025_17_48_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114563 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114564 order by id desc limit 1 Qualite : 0.2576423828494527 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114565_31-01-2025_12_57_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114565 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114565 AND mptpi.`type`=4230 To do Qualite : 0.19770651428243047 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114566_31-01-2025_16_47_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114566 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114566 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113516 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113517 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113519 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113521 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113523 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113525 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113527 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113529 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113530 order by id desc limit 1 Qualite : 0.2760275473614038 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20113531_31-01-2025_12_33_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113531 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113531 AND mptpi.`type`=4230 To do Qualite : 0.20026238582895103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20113532_31-01-2025_12_18_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113532 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113532 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119099 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119100 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119101 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119102 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119103 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119104 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119105 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119106 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119107 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119108 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119109 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119110 order by id desc limit 1 Qualite : 0.20617911161510105 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119111_31-01-2025_18_33_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119111 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119112 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119113 order by id desc limit 1 Qualite : 0.25044888642272845 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119114_31-01-2025_18_17_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119114 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119335 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119336 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119337 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119338 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119339 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119340 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119341 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119342 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119343 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119344 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119345 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119346 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119347 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119348 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119349 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119350 order by id desc limit 1 Qualite : 0.21454922986087174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119351_31-01-2025_18_47_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119351 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119351 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119740 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119741 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119742 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119743 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119770 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119782 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119784 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119785 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119786 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119787 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119789 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119791 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119793 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119795 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119797 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119799 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119800 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119802 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119804 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119806 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119808 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119810 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119812 order by id desc limit 1 Qualite : 0.21446781006255577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119813_31-01-2025_19_40_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119813 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119813 AND mptpi.`type`=4230 To do Qualite : 0.16814914130885286 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119814_31-01-2025_19_18_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119814 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119814 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120234 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120235 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120236 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120237 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120238 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120239 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120240 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120241 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120243 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120572 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120573 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120574 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120575 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120576 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120577 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120578 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120579 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120580 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120581 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120582 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120583 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120584 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120585 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120586 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120589 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120590 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120591 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120247 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120249 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120253 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120255 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120257 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120258 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120259 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120260 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120261 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120262 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120263 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120264 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120265 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120266 order by id desc limit 1 Qualite : 0.22127035710538484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20120267_31-01-2025_19_48_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120267 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20120267 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120268 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120592 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120593 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120594 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120595 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120596 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120597 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120598 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120599 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120600 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120601 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120602 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120603 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120604 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120605 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120606 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120607 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120609 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120610 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120611 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120612 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120613 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120614 order by id desc limit 1 Qualite : 0.20803760148353112 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20120615_31-01-2025_20_32_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120615 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20120615 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120932 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120933 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120934 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120935 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120936 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120937 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120938 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120939 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120940 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120941 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120942 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120943 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120944 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120945 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120946 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120947 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120948 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120949 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120950 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120951 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120952 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120953 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120954 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120955 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121223 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121225 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121226 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121228 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121230 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121232 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121234 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121236 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121238 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121240 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121242 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121246 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121249 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121253 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121255 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121294 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121295 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121296 order by id desc limit 1 Qualite : 0.21380180788067177 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20121297_31-01-2025_21_35_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121297 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121297 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121298 order by id desc limit 1 Qualite : 0.21134396715307036 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20121299_31-01-2025_21_18_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121299 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121299 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121300 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122167 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127274 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127275 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127276 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127277 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122170 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122171 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122172 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122173 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122174 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122175 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122176 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122177 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122178 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122179 order by id desc limit 1 Qualite : 0.23284957561511838 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20122180_31-01-2025_21_49_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20122180 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122181 order by id desc limit 1 Qualite : 0.23112596477729677 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127278_01-02-2025_04_18_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127278 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127278 AND mptpi.`type`=4230 To do Qualite : 0.2277805082446173 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127279_01-02-2025_04_23_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127279 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127279 AND mptpi.`type`=4230 To do Qualite : 0.24813908175903673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127280_01-02-2025_03_50_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127280 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127280 AND mptpi.`type`=4230 To do Qualite : 0.21818659201066368 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127281_01-02-2025_03_41_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127281 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127281 AND mptpi.`type`=4230 To do Qualite : 0.19463025646536283 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127282_01-02-2025_03_07_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127282 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127282 AND mptpi.`type`=4230 To do Qualite : 0.20875846811683288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127283_01-02-2025_02_18_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127283 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127283 AND mptpi.`type`=4230 To do Qualite : 0.21310064590352304 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127284_01-02-2025_02_26_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127284 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127284 AND mptpi.`type`=4230 To do Qualite : 0.22321303428912254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127285_01-02-2025_01_49_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127285 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127285 AND mptpi.`type`=4230 To do Qualite : 0.22430908149608844 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127286_01-02-2025_00_52_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127286 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127286 AND mptpi.`type`=4230 To do Qualite : 0.24309344249940346 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127287_01-02-2025_00_53_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127287 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127287 AND mptpi.`type`=4230 To do Qualite : 0.2258821297970158 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127302_01-02-2025_00_51_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127302 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123398 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123423 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123424 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123425 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123426 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123427 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123428 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123429 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123430 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123431 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123432 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123433 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123434 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123435 order by id desc limit 1 Qualite : 0.24394261262748643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20123436_31-01-2025_22_33_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123436 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20123436 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123437 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123438 order by id desc limit 1 Qualite : 0.2256012896625769 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20123439_31-01-2025_22_18_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20123439 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124861 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124862 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124863 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124864 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124865 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124867 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124869 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124870 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124871 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124872 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124873 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124874 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124875 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124876 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124877 order by id desc limit 1 Qualite : 0.21109570840898997 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124878_31-01-2025_23_48_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124878 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124878 AND mptpi.`type`=4230 To do Qualite : 0.17361163724086415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124896_31-01-2025_23_34_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124896 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124896 AND mptpi.`type`=4230 To do Qualite : 0.20118689386707925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124922_31-01-2025_22_51_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124922 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124922 AND mptpi.`type`=4230 To do Qualite : 0.2484028433508808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127303_01-02-2025_04_22_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127303 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127303 AND mptpi.`type`=4230 To do Qualite : 0.21067357955438912 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127304_01-02-2025_03_15_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127304 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127304 AND mptpi.`type`=4230 To do Qualite : 0.21373297021850063 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127305_01-02-2025_00_27_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127305 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127305 AND mptpi.`type`=4230 To do Qualite : 0.2047372684132672 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127306 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'31012025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333463758, 1333463755] Looping around the photos to save general results len do output : 1 /20127279Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463758', None, None, None, None, None, '2535873') ('4234', None, None, None, None, None, None, None, '2535873') ('4234', '20127279', '1333463755', None, None, None, None, None, '2535873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.014886617660522461 save_final save missing photos in datou_result : time spend for datou_step_exec : 218.55485677719116 time spend to save output : 0.015120983123779297 total time spend for step 11 : 218.56997776031494 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 39.79user 26.79system 7:06.12elapsed 15%CPU (0avgtext+0avgdata 3259264maxresident)k 1657048inputs+16720outputs (5839major+2936655minor)pagefaults 0swaps