python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4015661 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2588617'] with mtr_portfolio_ids : ['20567474'] and first list_photo_ids : [] new path : /proc/4015661/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.45949745178222656 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 15 06:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4475 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-15 06:20:32.830564: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-15 06:20:32.859231: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-15 06:20:32.861313: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8e14000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-15 06:20:32.861385: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-15 06:20:32.865550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-15 06:20:33.124218: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xbb60c30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-15 06:20:33.124320: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-15 06:20:33.128418: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 06:20:33.129277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 06:20:33.132572: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 06:20:33.135473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 06:20:33.136025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 06:20:33.140618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 06:20:33.142463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 06:20:33.149242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 06:20:33.150547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 06:20:33.150646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 06:20:33.151321: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-15 06:20:33.151340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-15 06:20:33.151350: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-15 06:20:33.152380: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-15 06:20:33.464780: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 06:20:33.464870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 06:20:33.464894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 06:20:33.464915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 06:20:33.464935: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 06:20:33.464955: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 06:20:33.464975: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 06:20:33.464994: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 06:20:33.466111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 06:20:33.467214: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 06:20:33.467262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 06:20:33.467282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 06:20:33.467299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 06:20:33.467316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 06:20:33.467333: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 06:20:33.467350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 06:20:33.467368: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 06:20:33.468333: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 06:20:33.468361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-15 06:20:33.468369: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-15 06:20:33.468377: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-15 06:20:33.469348: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-15 06:20:41.240780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 06:20:41.419769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 06:20:42.670567: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.477841: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-15 06:20:43.567545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.567641: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.568926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.568972: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.576072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.576129: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.577161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.577226: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.609768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.609853: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.609872: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-15 06:20:43.610675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.610700: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.611497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.611526: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.618829: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.618953: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.619748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.619776: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.620528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.620551: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-15 06:20:43.621325: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.630039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.630863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.648443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.649228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.650036: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.650767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.655486: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.656266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.657009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.657715: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.659043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.669127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.669858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.679875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.680810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.681729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.682591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.683821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-15 06:20:43.684607: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.43G (3683516416 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.62188 max: 145.43203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.0001480579376220703 nb_pixel_total : 938 time to create 1 rle with old method : 0.0022470951080322266 length of segment : 39 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.00021648406982421875 length of segment : 29 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 47 time to create 1 rle with old method : 0.00012874603271484375 length of segment : 27 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 38 time to create 1 rle with old method : 0.00019788742065429688 length of segment : 2 time for calcul the mask position with numpy : 0.0004582405090332031 nb_pixel_total : 15325 time to create 1 rle with old method : 0.03331398963928223 length of segment : 182 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 808 time to create 1 rle with old method : 0.0015456676483154297 length of segment : 76 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00016760826110839844 length of segment : 30 time for calcul the mask position with numpy : 0.00039386749267578125 nb_pixel_total : 14993 time to create 1 rle with old method : 0.02266526222229004 length of segment : 147 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001838207244873047 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.30547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 2122 time to create 1 rle with old method : 0.0033664703369140625 length of segment : 46 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.002094745635986328 length of segment : 43 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 23 time to create 1 rle with old method : 0.00013184547424316406 length of segment : 6 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1414 time to create 1 rle with old method : 0.0019788742065429688 length of segment : 45 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 927 time to create 1 rle with old method : 0.0012810230255126953 length of segment : 75 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 846 time to create 1 rle with old method : 0.001352548599243164 length of segment : 97 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 787 time to create 1 rle with old method : 0.0012023448944091797 length of segment : 104 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1427 time to create 1 rle with old method : 0.0017437934875488281 length of segment : 48 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 25 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1238 time to create 1 rle with old method : 0.0015869140625 length of segment : 37 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006344318389892578 length of segment : 35 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0007777214050292969 length of segment : 39 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1358 time to create 1 rle with old method : 0.001697540283203125 length of segment : 100 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0007791519165039062 length of segment : 51 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 690 time to create 1 rle with old method : 0.0009772777557373047 length of segment : 73 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.54375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 6779 time to create 1 rle with old method : 0.007922649383544922 length of segment : 107 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.00047516822814941406 length of segment : 12 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0011301040649414062 length of segment : 46 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 11 time to create 1 rle with old method : 3.9577484130859375e-05 length of segment : 4 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.07109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003445148468017578 length of segment : 16 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.0010843276977539062 length of segment : 61 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 8664 time to create 1 rle with old method : 0.010037660598754883 length of segment : 143 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003483295440673828 length of segment : 19 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0006744861602783203 length of segment : 24 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0004267692565917969 length of segment : 26 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0008094310760498047 length of segment : 17 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 2725 time to create 1 rle with old method : 0.0033621788024902344 length of segment : 78 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008440017700195312 length of segment : 127 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -86.73125 max: 73.80938 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -104.25078 max: 150.80703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 2667 time to create 1 rle with old method : 0.0047032833099365234 length of segment : 49 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00020170211791992188 length of segment : 21 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1451 time to create 1 rle with old method : 0.0019145011901855469 length of segment : 35 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.00033736228942871094 length of segment : 21 time for calcul the mask position with numpy : 0.00019788742065429688 nb_pixel_total : 5455 time to create 1 rle with old method : 0.012032747268676758 length of segment : 99 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1062 time to create 1 rle with old method : 0.0015094280242919922 length of segment : 36 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1384 time to create 1 rle with old method : 0.001748800277709961 length of segment : 31 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0007562637329101562 length of segment : 18 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0008072853088378906 length of segment : 22 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1204 time to create 1 rle with old method : 0.0015215873718261719 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.02031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00015997886657714844 length of segment : 15 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 597 time to create 1 rle with old method : 0.0007684230804443359 length of segment : 43 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0012309551239013672 length of segment : 17 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009205341339111328 length of segment : 29 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0007696151733398438 length of segment : 19 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.00026488304138183594 length of segment : 13 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004246234893798828 length of segment : 15 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004134178161621094 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0009677410125732422 length of segment : 119 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003311634063720703 length of segment : 23 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 925 time to create 1 rle with old method : 0.0013666152954101562 length of segment : 39 time for calcul the mask position with numpy : 0.00018453598022460938 nb_pixel_total : 861 time to create 1 rle with old method : 0.0011148452758789062 length of segment : 56 time for calcul the mask position with numpy : 0.00018358230590820312 nb_pixel_total : 3582 time to create 1 rle with old method : 0.004595756530761719 length of segment : 159 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1276 time to create 1 rle with old method : 0.001580953598022461 length of segment : 40 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.0011096000671386719 length of segment : 24 time for calcul the mask position with numpy : 0.00016069412231445312 nb_pixel_total : 7215 time to create 1 rle with old method : 0.00838017463684082 length of segment : 172 time for calcul the mask position with numpy : 0.000518798828125 nb_pixel_total : 29592 time to create 1 rle with old method : 0.03359341621398926 length of segment : 327 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.0009312629699707031 length of segment : 35 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 934 time to create 1 rle with old method : 0.0012323856353759766 length of segment : 39 time for calcul the mask position with numpy : 0.00014925003051757812 nb_pixel_total : 3960 time to create 1 rle with old method : 0.0047838687896728516 length of segment : 120 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.0001513957977294922 nb_pixel_total : 7819 time to create 1 rle with old method : 0.009142637252807617 length of segment : 273 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1530 time to create 1 rle with old method : 0.0019419193267822266 length of segment : 70 time for calcul the mask position with numpy : 0.00020885467529296875 nb_pixel_total : 3615 time to create 1 rle with old method : 0.0045964717864990234 length of segment : 164 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1608 time to create 1 rle with old method : 0.002019643783569336 length of segment : 64 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0012481212615966797 length of segment : 72 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0021457672119140625 length of segment : 39 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 3641 time to create 1 rle with old method : 0.004419088363647461 length of segment : 193 Processing 1 images image shape: (280, 400, 3) min: 6.00000 max: 205.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 70.70391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0011622905731201172 nb_pixel_total : 106263 time to create 1 rle with old method : 0.1216423511505127 length of segment : 283 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006909370422363281 length of segment : 46 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 3673 time to create 1 rle with old method : 0.004437685012817383 length of segment : 60 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0011129379272460938 length of segment : 49 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 1762 time to create 1 rle with old method : 0.002526521682739258 length of segment : 59 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1931 time to create 1 rle with old method : 0.0026099681854248047 length of segment : 50 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 931 time to create 1 rle with old method : 0.0011773109436035156 length of segment : 33 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006964206695556641 length of segment : 28 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 761 time to create 1 rle with old method : 0.0014123916625976562 length of segment : 63 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003795623779296875 length of segment : 24 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0007894039154052734 length of segment : 47 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 1773 time to create 1 rle with old method : 0.00290679931640625 length of segment : 58 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2400 time to create 1 rle with old method : 0.0028846263885498047 length of segment : 83 time for calcul the mask position with numpy : 0.00011467933654785156 nb_pixel_total : 1758 time to create 1 rle with old method : 0.0038766860961914062 length of segment : 73 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.00042629241943359375 length of segment : 18 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003330707550048828 length of segment : 21 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002532005310058594 length of segment : 18 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0003018379211425781 length of segment : 44 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003871917724609375 length of segment : 26 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003147125244140625 length of segment : 17 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0007951259613037109 length of segment : 35 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006220340728759766 length of segment : 20 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00013875961303710938 length of segment : 10 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00014829635620117188 length of segment : 10 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 58 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 22 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.00045609474182128906 length of segment : 20 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00023126602172851562 length of segment : 21 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 2215 time to create 1 rle with old method : 0.0027637481689453125 length of segment : 45 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00011229515075683594 length of segment : 11 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007042884826660156 length of segment : 28 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0008945465087890625 length of segment : 48 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004661083221435547 length of segment : 20 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00016450881958007812 length of segment : 16 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005626678466796875 length of segment : 41 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007252693176269531 length of segment : 23 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002753734588623047 length of segment : 20 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1340 time to create 1 rle with old method : 0.0018734931945800781 length of segment : 43 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003020763397216797 length of segment : 21 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0012612342834472656 length of segment : 42 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00019669532775878906 length of segment : 11 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1683 time to create 1 rle with old method : 0.002882242202758789 length of segment : 89 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0003921985626220703 length of segment : 16 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0006618499755859375 length of segment : 40 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0003707408905029297 length of segment : 19 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0006308555603027344 length of segment : 26 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0006871223449707031 length of segment : 20 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00016450881958007812 length of segment : 15 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 28 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00038504600524902344 length of segment : 18 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1538 time to create 1 rle with old method : 0.0027332305908203125 length of segment : 58 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0004448890686035156 length of segment : 17 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00058746337890625 length of segment : 17 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0006253719329833984 length of segment : 17 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1697 time to create 1 rle with old method : 0.0028984546661376953 length of segment : 89 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0008776187896728516 length of segment : 36 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.00045371055603027344 length of segment : 29 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005233287811279297 length of segment : 24 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.00043129920959472656 length of segment : 22 time for calcul the mask position with numpy : 0.00011444091796875 nb_pixel_total : 3434 time to create 1 rle with old method : 0.004161834716796875 length of segment : 88 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00019121170043945312 length of segment : 15 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00018596649169921875 length of segment : 19 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002014636993408203 length of segment : 18 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004737377166748047 length of segment : 19 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003566741943359375 length of segment : 17 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 913 time to create 1 rle with old method : 0.0011267662048339844 length of segment : 36 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.0013151168823242188 length of segment : 35 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.00047016143798828125 length of segment : 25 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1236 time to create 1 rle with old method : 0.001581430435180664 length of segment : 40 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005452632904052734 length of segment : 23 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 649 time to create 1 rle with old method : 0.0008547306060791016 length of segment : 42 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 510 time to create 1 rle with old method : 0.0006549358367919922 length of segment : 30 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005002021789550781 length of segment : 24 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 510 time to create 1 rle with old method : 0.0007319450378417969 length of segment : 27 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.0011246204376220703 length of segment : 35 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005443096160888672 length of segment : 26 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 634 time to create 1 rle with old method : 0.0008206367492675781 length of segment : 50 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 597 time to create 1 rle with old method : 0.0008141994476318359 length of segment : 23 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 18 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1195 time to create 1 rle with old method : 0.0015072822570800781 length of segment : 39 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 608 time to create 1 rle with old method : 0.0007598400115966797 length of segment : 24 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005054473876953125 length of segment : 26 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 637 time to create 1 rle with old method : 0.0008726119995117188 length of segment : 25 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0007832050323486328 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00037670135498046875 length of segment : 21 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021982192993164062 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 24 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.0013575553894042969 length of segment : 37 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 672 time to create 1 rle with old method : 0.0010576248168945312 length of segment : 35 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.50469 max: 149.93203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 883 time to create 1 rle with old method : 0.0012335777282714844 length of segment : 36 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 12772 time to create 1 rle with old method : 0.014860391616821289 length of segment : 168 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001709461212158203 length of segment : 29 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00016260147094726562 length of segment : 29 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 937 time to create 1 rle with old method : 0.0013623237609863281 length of segment : 83 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00013065338134765625 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.41484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1484 time to create 1 rle with old method : 0.00194549560546875 length of segment : 42 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 2409 time to create 1 rle with old method : 0.002962827682495117 length of segment : 48 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006210803985595703 length of segment : 38 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005631446838378906 length of segment : 26 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00020384788513183594 length of segment : 10 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1515 time to create 1 rle with old method : 0.0018489360809326172 length of segment : 53 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1415 time to create 1 rle with old method : 0.001814126968383789 length of segment : 63 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 921 time to create 1 rle with old method : 0.0012295246124267578 length of segment : 91 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0010387897491455078 length of segment : 81 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 28 time to create 1 rle with old method : 0.0001201629638671875 length of segment : 7 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.000720977783203125 length of segment : 39 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 783 time to create 1 rle with old method : 0.0010378360748291016 length of segment : 37 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1150 time to create 1 rle with old method : 0.0013186931610107422 length of segment : 47 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00020599365234375 length of segment : 14 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006415843963623047 length of segment : 33 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0009202957153320312 length of segment : 81 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.18828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 5846 time to create 1 rle with old method : 0.0069522857666015625 length of segment : 121 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 634 time to create 1 rle with old method : 0.0008592605590820312 length of segment : 28 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004949569702148438 length of segment : 11 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006968975067138672 length of segment : 61 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.64922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003795623779296875 length of segment : 16 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 941 time to create 1 rle with old method : 0.0011489391326904297 length of segment : 73 time for calcul the mask position with numpy : 0.00022459030151367188 nb_pixel_total : 8280 time to create 1 rle with old method : 0.011374711990356445 length of segment : 136 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0004870891571044922 length of segment : 17 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.00045752525329589844 length of segment : 53 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0006551742553710938 length of segment : 24 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002522468566894531 length of segment : 11 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0007033348083496094 length of segment : 18 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1230 time to create 1 rle with old method : 0.0016036033630371094 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 15.00000 max: 204.00000 molded_images shape: (1, 640, 640, 3) min: -87.44219 max: 75.66484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.44219 max: 150.93594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 3264 time to create 1 rle with old method : 0.005887508392333984 length of segment : 47 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002002716064453125 length of segment : 22 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.0007364749908447266 length of segment : 31 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1549 time to create 1 rle with old method : 0.002047300338745117 length of segment : 34 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1025 time to create 1 rle with old method : 0.0014295578002929688 length of segment : 37 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1263 time to create 1 rle with old method : 0.002437591552734375 length of segment : 37 time for calcul the mask position with numpy : 0.00015020370483398438 nb_pixel_total : 6335 time to create 1 rle with old method : 0.007968425750732422 length of segment : 105 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1461 time to create 1 rle with old method : 0.001981496810913086 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.47734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008368492126464844 length of segment : 51 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.000492095947265625 length of segment : 14 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0013828277587890625 length of segment : 18 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00014901161193847656 length of segment : 13 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0008296966552734375 length of segment : 29 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.00042700767517089844 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.00859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 1897 time to create 1 rle with old method : 0.0024361610412597656 length of segment : 128 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 918 time to create 1 rle with old method : 0.0018229484558105469 length of segment : 24 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 681 time to create 1 rle with old method : 0.0010628700256347656 length of segment : 36 time for calcul the mask position with numpy : 0.0001232624053955078 nb_pixel_total : 4863 time to create 1 rle with old method : 0.005746603012084961 length of segment : 99 time for calcul the mask position with numpy : 0.0001513957977294922 nb_pixel_total : 5417 time to create 1 rle with old method : 0.006728649139404297 length of segment : 138 time for calcul the mask position with numpy : 0.00023317337036132812 nb_pixel_total : 2484 time to create 1 rle with old method : 0.0034325122833251953 length of segment : 120 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 8156 time to create 1 rle with old method : 0.009749650955200195 length of segment : 153 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0006687641143798828 length of segment : 22 time for calcul the mask position with numpy : 0.0002319812774658203 nb_pixel_total : 5686 time to create 1 rle with old method : 0.007555961608886719 length of segment : 224 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 747 time to create 1 rle with old method : 0.0010144710540771484 length of segment : 35 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1426 time to create 1 rle with old method : 0.0026352405548095703 length of segment : 43 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1356 time to create 1 rle with old method : 0.0017697811126708984 length of segment : 40 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.40078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1015 time to create 1 rle with old method : 0.0013110637664794922 length of segment : 52 time for calcul the mask position with numpy : 0.0001518726348876953 nb_pixel_total : 4451 time to create 1 rle with old method : 0.005969524383544922 length of segment : 305 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 1654 time to create 1 rle with old method : 0.002064228057861328 length of segment : 40 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1631 time to create 1 rle with old method : 0.002099752426147461 length of segment : 40 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0008792877197265625 length of segment : 27 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1742 time to create 1 rle with old method : 0.002183198928833008 length of segment : 56 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1592 time to create 1 rle with old method : 0.002141714096069336 length of segment : 81 time for calcul the mask position with numpy : 0.0002334117889404297 nb_pixel_total : 2549 time to create 1 rle with old method : 0.0032355785369873047 length of segment : 144 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 999 time to create 1 rle with old method : 0.00140380859375 length of segment : 106 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 2892 time to create 1 rle with old method : 0.00350189208984375 length of segment : 146 time for calcul the mask position with numpy : 0.00024247169494628906 nb_pixel_total : 2955 time to create 1 rle with old method : 0.0038423538208007812 length of segment : 177 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 198.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 71.19609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009355545043945312 nb_pixel_total : 106546 time to create 1 rle with old method : 0.11689162254333496 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.99453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 3625 time to create 1 rle with old method : 0.0045490264892578125 length of segment : 59 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 2034 time to create 1 rle with old method : 0.00278472900390625 length of segment : 60 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 2237 time to create 1 rle with old method : 0.002939939498901367 length of segment : 101 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 930 time to create 1 rle with old method : 0.0012233257293701172 length of segment : 34 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 859 time to create 1 rle with old method : 0.0011560916900634766 length of segment : 48 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1939 time to create 1 rle with old method : 0.002470731735229492 length of segment : 71 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008587837219238281 length of segment : 44 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.0010776519775390625 length of segment : 63 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 1610 time to create 1 rle with old method : 0.0030829906463623047 length of segment : 56 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.000598907470703125 length of segment : 27 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 2110 time to create 1 rle with old method : 0.0026688575744628906 length of segment : 74 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0004239082336425781 length of segment : 24 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.000408172607421875 length of segment : 25 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 548 time to create 1 rle with old method : 0.0008373260498046875 length of segment : 36 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0008738040924072266 length of segment : 25 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00043702125549316406 length of segment : 18 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004303455352783203 length of segment : 34 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.00045990943908691406 length of segment : 18 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003829002380371094 length of segment : 20 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003104209899902344 length of segment : 15 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003943443298339844 length of segment : 23 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.00038313865661621094 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 62 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0005276203155517578 length of segment : 27 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0017142295837402344 length of segment : 41 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005638599395751953 length of segment : 23 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.00045013427734375 length of segment : 23 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0006406307220458984 length of segment : 30 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00038623809814453125 length of segment : 16 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.00014972686767578125 length of segment : 15 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 2194 time to create 1 rle with old method : 0.0026395320892333984 length of segment : 45 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00029754638671875 length of segment : 19 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004646778106689453 length of segment : 21 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.0006895065307617188 length of segment : 24 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.000667572021484375 length of segment : 28 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0004515647888183594 length of segment : 18 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004413127899169922 length of segment : 19 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0012867450714111328 length of segment : 46 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004584789276123047 length of segment : 31 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004355907440185547 length of segment : 25 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0007741451263427734 length of segment : 46 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005600452423095703 length of segment : 33 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002505779266357422 length of segment : 17 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00010991096496582031 length of segment : 15 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002090930938720703 length of segment : 19 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1632 time to create 1 rle with old method : 0.0019352436065673828 length of segment : 91 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.00046372413635253906 length of segment : 19 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 977 time to create 1 rle with old method : 0.0012845993041992188 length of segment : 35 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.000209808349609375 length of segment : 16 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005536079406738281 length of segment : 24 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00017380714416503906 length of segment : 16 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 16 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002448558807373047 length of segment : 17 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0007984638214111328 length of segment : 45 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004138946533203125 length of segment : 39 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.00018334388732910156 length of segment : 19 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006563663482666016 length of segment : 24 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 3130 time to create 1 rle with old method : 0.004430294036865234 length of segment : 83 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.000530242919921875 length of segment : 28 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002701282501220703 length of segment : 17 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005311965942382812 length of segment : 26 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00016880035400390625 length of segment : 15 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002696514129638672 length of segment : 8 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002243518829345703 length of segment : 20 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00017714500427246094 length of segment : 12 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 921 time to create 1 rle with old method : 0.0011286735534667969 length of segment : 39 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003437995910644531 length of segment : 16 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00020384788513183594 length of segment : 24 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 901 time to create 1 rle with old method : 0.001117706298828125 length of segment : 38 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1242 time to create 1 rle with old method : 0.0015408992767333984 length of segment : 40 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 23 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0012466907501220703 length of segment : 39 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0003402233123779297 length of segment : 14 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 913 time to create 1 rle with old method : 0.0012195110321044922 length of segment : 36 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1285 time to create 1 rle with old method : 0.0016231536865234375 length of segment : 40 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004706382751464844 length of segment : 38 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 951 time to create 1 rle with old method : 0.0012607574462890625 length of segment : 35 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 671 time to create 1 rle with old method : 0.0008695125579833984 length of segment : 25 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005598068237304688 length of segment : 29 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 842 time to create 1 rle with old method : 0.001529693603515625 length of segment : 34 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 895 time to create 1 rle with old method : 0.0012035369873046875 length of segment : 36 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.000705718994140625 length of segment : 43 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004210472106933594 length of segment : 16 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1588 time to create 1 rle with old method : 0.001954793930053711 length of segment : 59 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.00023102760314941406 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.94766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1362 time to create 1 rle with old method : 0.0017805099487304688 length of segment : 58 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00042629241943359375 length of segment : 20 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00026416778564453125 length of segment : 27 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00022935867309570312 length of segment : 8 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003960132598876953 length of segment : 32 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.00033283233642578125 length of segment : 17 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006847381591796875 length of segment : 24 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0003743171691894531 length of segment : 38 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 253.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 131.66250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 16 time to create 1 rle with old method : 5.793571472167969e-05 length of segment : 4 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0008683204650878906 length of segment : 72 Detection mask done ! Trying to reset tf kernel 4016319 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3282 tf kernel not reseted sub process len(results) : 329 len(list_Values) 329 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 329 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4475 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 329 chid ids of type : 4228 Number RLEs to save : 15389 save missing photos in datou_result : time spend for datou_step_exec : 23.732558012008667 time spend to save output : 1.6387619972229004 total time spend for step 1 : 25.371320009231567 step2:brightness Sat Feb 15 06:20:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739596829_4015661_1337667941_d773be8a1303d628393087c99b8c557b.jpg treat image : temp/1739596829_4015661_1337667938_610ce6d927c4a73e3e2e292cfb2386a7.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.012644529342651367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.011747360229492188 save missing photos in datou_result : time spend for datou_step_exec : 0.5115737915039062 time spend to save output : 0.029415607452392578 total time spend for step 2 : 0.5409893989562988 step3:blur_detection Sat Feb 15 06:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739596829_4015661_1337667941_d773be8a1303d628393087c99b8c557b.jpg resize: (1080, 1920) 1337667941 -7.75073210072074 treat image : temp/1739596829_4015661_1337667938_610ce6d927c4a73e3e2e292cfb2386a7.jpg resize: (1080, 1920) 1337667938 -7.760113290762162 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.013546228408813477 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.014127492904663086 save missing photos in datou_result : time spend for datou_step_exec : 2.0310423374176025 time spend to save output : 0.031977176666259766 total time spend for step 3 : 2.0630195140838623 step4:rle_unique_nms_with_priority Sat Feb 15 06:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 329 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 162 nb_hashtags : 8 time to prepare the origin masks : 1.106215000152588 time for calcul the mask position with numpy : 0.11461019515991211 nb_pixel_total : 1791928 time to create 1 rle with new method : 0.16927027702331543 time for calcul the mask position with numpy : 0.00831747055053711 nb_pixel_total : 865 time to create 1 rle with old method : 0.0009717941284179688 time for calcul the mask position with numpy : 0.00792837142944336 nb_pixel_total : 663 time to create 1 rle with old method : 0.0007781982421875 time for calcul the mask position with numpy : 0.008063316345214844 nb_pixel_total : 11 time to create 1 rle with old method : 2.002716064453125e-05 time for calcul the mask position with numpy : 0.007949352264404297 nb_pixel_total : 25 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.008171319961547852 nb_pixel_total : 63 time to create 1 rle with old method : 9.298324584960938e-05 time for calcul the mask position with numpy : 0.00821828842163086 nb_pixel_total : 47 time to create 1 rle with old method : 5.555152893066406e-05 time for calcul the mask position with numpy : 0.007975578308105469 nb_pixel_total : 938 time to create 1 rle with old method : 0.0009620189666748047 time for calcul the mask position with numpy : 0.007975339889526367 nb_pixel_total : 808 time to create 1 rle with old method : 0.0009222030639648438 time for calcul the mask position with numpy : 0.008044719696044922 nb_pixel_total : 80 time to create 1 rle with old method : 0.00013637542724609375 time for calcul the mask position with numpy : 0.008137226104736328 nb_pixel_total : 898 time to create 1 rle with old method : 0.0010569095611572266 time for calcul the mask position with numpy : 0.007699012756347656 nb_pixel_total : 38 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.00955963134765625 nb_pixel_total : 2122 time to create 1 rle with old method : 0.0022809505462646484 time for calcul the mask position with numpy : 0.00853109359741211 nb_pixel_total : 1238 time to create 1 rle with old method : 0.0014231204986572266 time for calcul the mask position with numpy : 0.008089303970336914 nb_pixel_total : 23 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.008302688598632812 nb_pixel_total : 15325 time to create 1 rle with old method : 0.01627182960510254 time for calcul the mask position with numpy : 0.007956266403198242 nb_pixel_total : 2097 time to create 1 rle with old method : 0.00251007080078125 time for calcul the mask position with numpy : 0.008043289184570312 nb_pixel_total : 915 time to create 1 rle with old method : 0.000980377197265625 time for calcul the mask position with numpy : 0.008057117462158203 nb_pixel_total : 244 time to create 1 rle with old method : 0.00028967857360839844 time for calcul the mask position with numpy : 0.008083343505859375 nb_pixel_total : 395 time to create 1 rle with old method : 0.0004394054412841797 time for calcul the mask position with numpy : 0.008146286010742188 nb_pixel_total : 118 time to create 1 rle with old method : 0.00014495849609375 time for calcul the mask position with numpy : 0.008167266845703125 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003895759582519531 time for calcul the mask position with numpy : 0.008052587509155273 nb_pixel_total : 238 time to create 1 rle with old method : 0.0002963542938232422 time for calcul the mask position with numpy : 0.007935285568237305 nb_pixel_total : 239 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.008001089096069336 nb_pixel_total : 58 time to create 1 rle with old method : 9.846687316894531e-05 time for calcul the mask position with numpy : 0.008150577545166016 nb_pixel_total : 408 time to create 1 rle with old method : 0.00046825408935546875 time for calcul the mask position with numpy : 0.008061885833740234 nb_pixel_total : 1414 time to create 1 rle with old method : 0.0015125274658203125 time for calcul the mask position with numpy : 0.007848262786865234 nb_pixel_total : 738 time to create 1 rle with old method : 0.0009207725524902344 time for calcul the mask position with numpy : 0.00809621810913086 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003886222839355469 time for calcul the mask position with numpy : 0.007942438125610352 nb_pixel_total : 927 time to create 1 rle with old method : 0.0009646415710449219 time for calcul the mask position with numpy : 0.008000373840332031 nb_pixel_total : 526 time to create 1 rle with old method : 0.0005860328674316406 time for calcul the mask position with numpy : 0.007947683334350586 nb_pixel_total : 877 time to create 1 rle with old method : 0.000988006591796875 time for calcul the mask position with numpy : 0.008083105087280273 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001537799835205078 time for calcul the mask position with numpy : 0.00797128677368164 nb_pixel_total : 6779 time to create 1 rle with old method : 0.007399559020996094 time for calcul the mask position with numpy : 0.007832765579223633 nb_pixel_total : 99 time to create 1 rle with old method : 0.00012874603271484375 time for calcul the mask position with numpy : 0.007845878601074219 nb_pixel_total : 8664 time to create 1 rle with old method : 0.009553194046020508 time for calcul the mask position with numpy : 0.007910013198852539 nb_pixel_total : 2725 time to create 1 rle with old method : 0.002894163131713867 time for calcul the mask position with numpy : 0.007937908172607422 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005133152008056641 time for calcul the mask position with numpy : 0.008189678192138672 nb_pixel_total : 7215 time to create 1 rle with old method : 0.007853269577026367 time for calcul the mask position with numpy : 0.00792241096496582 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005600452423095703 time for calcul the mask position with numpy : 0.007835865020751953 nb_pixel_total : 2757 time to create 1 rle with old method : 0.003139019012451172 time for calcul the mask position with numpy : 0.007711172103881836 nb_pixel_total : 8 time to create 1 rle with old method : 1.5497207641601562e-05 time for calcul the mask position with numpy : 0.00803685188293457 nb_pixel_total : 712 time to create 1 rle with old method : 0.0008127689361572266 time for calcul the mask position with numpy : 0.00833749771118164 nb_pixel_total : 741 time to create 1 rle with old method : 0.0008533000946044922 time for calcul the mask position with numpy : 0.008323192596435547 nb_pixel_total : 861 time to create 1 rle with old method : 0.0009961128234863281 time for calcul the mask position with numpy : 0.008441448211669922 nb_pixel_total : 781 time to create 1 rle with old method : 0.000989675521850586 time for calcul the mask position with numpy : 0.00838017463684082 nb_pixel_total : 1276 time to create 1 rle with old method : 0.002075672149658203 time for calcul the mask position with numpy : 0.010529518127441406 nb_pixel_total : 29087 time to create 1 rle with old method : 0.03610801696777344 time for calcul the mask position with numpy : 0.00887608528137207 nb_pixel_total : 1662 time to create 1 rle with old method : 0.002036571502685547 time for calcul the mask position with numpy : 0.008084297180175781 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002791881561279297 time for calcul the mask position with numpy : 0.008301258087158203 nb_pixel_total : 542 time to create 1 rle with old method : 0.0006604194641113281 time for calcul the mask position with numpy : 0.00860142707824707 nb_pixel_total : 5455 time to create 1 rle with old method : 0.006916522979736328 time for calcul the mask position with numpy : 0.008001327514648438 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.008301496505737305 nb_pixel_total : 685 time to create 1 rle with old method : 0.0008945465087890625 time for calcul the mask position with numpy : 0.008361101150512695 nb_pixel_total : 7819 time to create 1 rle with old method : 0.00954127311706543 time for calcul the mask position with numpy : 0.00820469856262207 nb_pixel_total : 3615 time to create 1 rle with old method : 0.004613399505615234 time for calcul the mask position with numpy : 0.008029699325561523 nb_pixel_total : 597 time to create 1 rle with old method : 0.0006520748138427734 time for calcul the mask position with numpy : 0.008069038391113281 nb_pixel_total : 143 time to create 1 rle with old method : 0.00019478797912597656 time for calcul the mask position with numpy : 0.00850224494934082 nb_pixel_total : 4 time to create 1 rle with old method : 3.6716461181640625e-05 time for calcul the mask position with numpy : 0.00825190544128418 nb_pixel_total : 1608 time to create 1 rle with old method : 0.0018939971923828125 time for calcul the mask position with numpy : 0.007959604263305664 nb_pixel_total : 88 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.008003950119018555 nb_pixel_total : 231 time to create 1 rle with old method : 0.000247955322265625 time for calcul the mask position with numpy : 0.00783681869506836 nb_pixel_total : 2667 time to create 1 rle with old method : 0.002933502197265625 time for calcul the mask position with numpy : 0.008002519607543945 nb_pixel_total : 925 time to create 1 rle with old method : 0.0011870861053466797 time for calcul the mask position with numpy : 0.008441448211669922 nb_pixel_total : 70 time to create 1 rle with old method : 0.0001583099365234375 time for calcul the mask position with numpy : 0.007939338684082031 nb_pixel_total : 1530 time to create 1 rle with old method : 0.0016672611236572266 time for calcul the mask position with numpy : 0.007867574691772461 nb_pixel_total : 1451 time to create 1 rle with old method : 0.0018725395202636719 time for calcul the mask position with numpy : 0.007868289947509766 nb_pixel_total : 37 time to create 1 rle with old method : 7.128715515136719e-05 time for calcul the mask position with numpy : 0.007962465286254883 nb_pixel_total : 211 time to create 1 rle with old method : 0.00030303001403808594 time for calcul the mask position with numpy : 0.00820159912109375 nb_pixel_total : 1062 time to create 1 rle with old method : 0.0011920928955078125 time for calcul the mask position with numpy : 0.008442401885986328 nb_pixel_total : 879 time to create 1 rle with old method : 0.0010457038879394531 time for calcul the mask position with numpy : 0.008100509643554688 nb_pixel_total : 135 time to create 1 rle with old method : 0.0001468658447265625 time for calcul the mask position with numpy : 0.008127450942993164 nb_pixel_total : 163 time to create 1 rle with old method : 0.00018143653869628906 time for calcul the mask position with numpy : 0.008180379867553711 nb_pixel_total : 13 time to create 1 rle with old method : 4.57763671875e-05 time for calcul the mask position with numpy : 0.007937192916870117 nb_pixel_total : 305 time to create 1 rle with old method : 0.00034737586975097656 time for calcul the mask position with numpy : 0.008054494857788086 nb_pixel_total : 619 time to create 1 rle with old method : 0.0006859302520751953 time for calcul the mask position with numpy : 0.00890040397644043 nb_pixel_total : 106263 time to create 1 rle with old method : 0.11413049697875977 time for calcul the mask position with numpy : 0.007981538772583008 nb_pixel_total : 1758 time to create 1 rle with old method : 0.001867532730102539 time for calcul the mask position with numpy : 0.008408069610595703 nb_pixel_total : 3673 time to create 1 rle with old method : 0.0043599605560302734 time for calcul the mask position with numpy : 0.008331298828125 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003495216369628906 time for calcul the mask position with numpy : 0.00863337516784668 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002455711364746094 time for calcul the mask position with numpy : 0.008322715759277344 nb_pixel_total : 177 time to create 1 rle with old method : 0.00021266937255859375 time for calcul the mask position with numpy : 0.007852792739868164 nb_pixel_total : 264 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.008107185363769531 nb_pixel_total : 140 time to create 1 rle with old method : 0.00017976760864257812 time for calcul the mask position with numpy : 0.008068561553955078 nb_pixel_total : 931 time to create 1 rle with old method : 0.001035928726196289 time for calcul the mask position with numpy : 0.008071184158325195 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005276203155517578 time for calcul the mask position with numpy : 0.007990837097167969 nb_pixel_total : 276 time to create 1 rle with old method : 0.00032329559326171875 time for calcul the mask position with numpy : 0.00827646255493164 nb_pixel_total : 1538 time to create 1 rle with old method : 0.0018343925476074219 time for calcul the mask position with numpy : 0.008681774139404297 nb_pixel_total : 211 time to create 1 rle with old method : 0.000263214111328125 time for calcul the mask position with numpy : 0.008273124694824219 nb_pixel_total : 156 time to create 1 rle with old method : 0.0001983642578125 time for calcul the mask position with numpy : 0.008442401885986328 nb_pixel_total : 2400 time to create 1 rle with old method : 0.0028166770935058594 time for calcul the mask position with numpy : 0.008274316787719727 nb_pixel_total : 8 time to create 1 rle with old method : 2.8133392333984375e-05 time for calcul the mask position with numpy : 0.008143424987792969 nb_pixel_total : 77 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.008392095565795898 nb_pixel_total : 133 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.008127450942993164 nb_pixel_total : 519 time to create 1 rle with old method : 0.0005807876586914062 time for calcul the mask position with numpy : 0.008063554763793945 nb_pixel_total : 387 time to create 1 rle with old method : 0.0003991127014160156 time for calcul the mask position with numpy : 0.008246898651123047 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005393028259277344 time for calcul the mask position with numpy : 0.008142232894897461 nb_pixel_total : 40 time to create 1 rle with old method : 7.152557373046875e-05 time for calcul the mask position with numpy : 0.008147716522216797 nb_pixel_total : 597 time to create 1 rle with old method : 0.0006737709045410156 time for calcul the mask position with numpy : 0.010064363479614258 nb_pixel_total : 260 time to create 1 rle with old method : 0.0002982616424560547 time for calcul the mask position with numpy : 0.008174657821655273 nb_pixel_total : 898 time to create 1 rle with old method : 0.0010998249053955078 time for calcul the mask position with numpy : 0.008480310440063477 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005011558532714844 time for calcul the mask position with numpy : 0.008355140686035156 nb_pixel_total : 1340 time to create 1 rle with old method : 0.0015106201171875 time for calcul the mask position with numpy : 0.008129119873046875 nb_pixel_total : 1931 time to create 1 rle with old method : 0.002210378646850586 time for calcul the mask position with numpy : 0.008252143859863281 nb_pixel_total : 22 time to create 1 rle with old method : 6.008148193359375e-05 time for calcul the mask position with numpy : 0.008169412612915039 nb_pixel_total : 685 time to create 1 rle with old method : 0.0007560253143310547 time for calcul the mask position with numpy : 0.008504867553710938 nb_pixel_total : 62 time to create 1 rle with old method : 9.059906005859375e-05 time for calcul the mask position with numpy : 0.008376359939575195 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009090900421142578 time for calcul the mask position with numpy : 0.008160591125488281 nb_pixel_total : 913 time to create 1 rle with old method : 0.0010671615600585938 time for calcul the mask position with numpy : 0.008187055587768555 nb_pixel_total : 73 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.008331775665283203 nb_pixel_total : 8 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.008271455764770508 nb_pixel_total : 308 time to create 1 rle with old method : 0.00034618377685546875 time for calcul the mask position with numpy : 0.008156776428222656 nb_pixel_total : 182 time to create 1 rle with old method : 0.00022721290588378906 time for calcul the mask position with numpy : 0.008279085159301758 nb_pixel_total : 220 time to create 1 rle with old method : 0.00036025047302246094 time for calcul the mask position with numpy : 0.008219480514526367 nb_pixel_total : 317 time to create 1 rle with old method : 0.0003693103790283203 time for calcul the mask position with numpy : 0.008215904235839844 nb_pixel_total : 93 time to create 1 rle with old method : 0.00014162063598632812 time for calcul the mask position with numpy : 0.008254528045654297 nb_pixel_total : 15 time to create 1 rle with old method : 4.553794860839844e-05 time for calcul the mask position with numpy : 0.008130311965942383 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008206367492675781 time for calcul the mask position with numpy : 0.008298397064208984 nb_pixel_total : 1762 time to create 1 rle with old method : 0.001909017562866211 time for calcul the mask position with numpy : 0.009001016616821289 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.00821232795715332 nb_pixel_total : 527 time to create 1 rle with old method : 0.0005991458892822266 time for calcul the mask position with numpy : 0.008170366287231445 nb_pixel_total : 218 time to create 1 rle with old method : 0.00026035308837890625 time for calcul the mask position with numpy : 0.008155345916748047 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003101825714111328 time for calcul the mask position with numpy : 0.00800633430480957 nb_pixel_total : 192 time to create 1 rle with old method : 0.00022077560424804688 time for calcul the mask position with numpy : 0.008186817169189453 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002105236053466797 time for calcul the mask position with numpy : 0.007895231246948242 nb_pixel_total : 339 time to create 1 rle with old method : 0.00039124488830566406 time for calcul the mask position with numpy : 0.008002042770385742 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004169940948486328 time for calcul the mask position with numpy : 0.007913827896118164 nb_pixel_total : 84 time to create 1 rle with old method : 0.00010609626770019531 time for calcul the mask position with numpy : 0.008484601974487305 nb_pixel_total : 634 time to create 1 rle with old method : 0.0006926059722900391 time for calcul the mask position with numpy : 0.008275032043457031 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002129077911376953 time for calcul the mask position with numpy : 0.008129358291625977 nb_pixel_total : 761 time to create 1 rle with old method : 0.0008797645568847656 time for calcul the mask position with numpy : 0.008273601531982422 nb_pixel_total : 177 time to create 1 rle with old method : 0.0003917217254638672 time for calcul the mask position with numpy : 0.012778282165527344 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.009678363800048828 nb_pixel_total : 649 time to create 1 rle with old method : 0.0007011890411376953 time for calcul the mask position with numpy : 0.008121490478515625 nb_pixel_total : 3433 time to create 1 rle with old method : 0.004074811935424805 time for calcul the mask position with numpy : 0.010965347290039062 nb_pixel_total : 337 time to create 1 rle with old method : 0.0006248950958251953 time for calcul the mask position with numpy : 0.01088261604309082 nb_pixel_total : 36 time to create 1 rle with old method : 0.00012803077697753906 time for calcul the mask position with numpy : 0.010716676712036133 nb_pixel_total : 1683 time to create 1 rle with old method : 0.0030858516693115234 time for calcul the mask position with numpy : 0.010739326477050781 nb_pixel_total : 329 time to create 1 rle with old method : 0.0006453990936279297 time for calcul the mask position with numpy : 0.011197090148925781 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003848075866699219 time for calcul the mask position with numpy : 0.010847091674804688 nb_pixel_total : 150 time to create 1 rle with old method : 0.0003058910369873047 time for calcul the mask position with numpy : 0.011049985885620117 nb_pixel_total : 329 time to create 1 rle with old method : 0.0006632804870605469 time for calcul the mask position with numpy : 0.013570070266723633 nb_pixel_total : 322 time to create 1 rle with old method : 0.0006811618804931641 time for calcul the mask position with numpy : 0.010816335678100586 nb_pixel_total : 520 time to create 1 rle with old method : 0.0009279251098632812 time for calcul the mask position with numpy : 0.009284019470214844 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003752708435058594 time for calcul the mask position with numpy : 0.008468389511108398 nb_pixel_total : 234 time to create 1 rle with old method : 0.00028586387634277344 time for calcul the mask position with numpy : 0.008425235748291016 nb_pixel_total : 510 time to create 1 rle with old method : 0.0005903244018554688 time for calcul the mask position with numpy : 0.00842142105102539 nb_pixel_total : 48 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.00843954086303711 nb_pixel_total : 955 time to create 1 rle with old method : 0.001134634017944336 time for calcul the mask position with numpy : 0.008440256118774414 nb_pixel_total : 51 time to create 1 rle with old method : 0.00015735626220703125 time for calcul the mask position with numpy : 0.008455276489257812 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0015270709991455078 time for calcul the mask position with numpy : 0.008569478988647461 nb_pixel_total : 106 time to create 1 rle with old method : 0.00014853477478027344 time for calcul the mask position with numpy : 0.008447647094726562 nb_pixel_total : 25 time to create 1 rle with old method : 0.00010418891906738281 time for calcul the mask position with numpy : 0.008302450180053711 nb_pixel_total : 2215 time to create 1 rle with old method : 0.0027124881744384766 time for calcul the mask position with numpy : 0.008442163467407227 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004703998565673828 time for calcul the mask position with numpy : 0.00839996337890625 nb_pixel_total : 672 time to create 1 rle with old method : 0.0008416175842285156 time for calcul the mask position with numpy : 0.008266210556030273 nb_pixel_total : 317 time to create 1 rle with old method : 0.00038886070251464844 time for calcul the mask position with numpy : 0.008192777633666992 nb_pixel_total : 394 time to create 1 rle with old method : 0.0004661083221435547 time for calcul the mask position with numpy : 0.008235692977905273 nb_pixel_total : 6 time to create 1 rle with old method : 3.838539123535156e-05 time for calcul the mask position with numpy : 0.008013725280761719 nb_pixel_total : 542 time to create 1 rle with old method : 0.0005841255187988281 time for calcul the mask position with numpy : 0.008105754852294922 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004527568817138672 time for calcul the mask position with numpy : 0.00813746452331543 nb_pixel_total : 355 time to create 1 rle with old method : 0.00040531158447265625 time for calcul the mask position with numpy : 0.00797128677368164 nb_pixel_total : 226 time to create 1 rle with old method : 0.00025343894958496094 create new chi : 1.9866859912872314 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006272792816162109 batch 1 Loaded 163 chid ids of type : 4230 Number RLEs to save : 14397 TO DO : save crop sub photo not yet done ! save time : 1.2794008255004883 nb_obj : 167 nb_hashtags : 8 time to prepare the origin masks : 2.552766799926758 time for calcul the mask position with numpy : 0.06737780570983887 nb_pixel_total : 1815238 time to create 1 rle with new method : 0.09265279769897461 time for calcul the mask position with numpy : 0.0063555240631103516 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006101131439208984 time for calcul the mask position with numpy : 0.010489940643310547 nb_pixel_total : 883 time to create 1 rle with old method : 0.001046895980834961 time for calcul the mask position with numpy : 0.009586334228515625 nb_pixel_total : 59 time to create 1 rle with old method : 8.082389831542969e-05 time for calcul the mask position with numpy : 0.005776643753051758 nb_pixel_total : 13 time to create 1 rle with old method : 4.100799560546875e-05 time for calcul the mask position with numpy : 0.0057544708251953125 nb_pixel_total : 1484 time to create 1 rle with old method : 0.0016474723815917969 time for calcul the mask position with numpy : 0.005807399749755859 nb_pixel_total : 6 time to create 1 rle with old method : 3.0994415283203125e-05 time for calcul the mask position with numpy : 0.005661487579345703 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001201629638671875 time for calcul the mask position with numpy : 0.005890846252441406 nb_pixel_total : 937 time to create 1 rle with old method : 0.001127481460571289 time for calcul the mask position with numpy : 0.0058362483978271484 nb_pixel_total : 136 time to create 1 rle with old method : 0.00016689300537109375 time for calcul the mask position with numpy : 0.005806446075439453 nb_pixel_total : 2409 time to create 1 rle with old method : 0.002588510513305664 time for calcul the mask position with numpy : 0.005893707275390625 nb_pixel_total : 28 time to create 1 rle with old method : 5.7220458984375e-05 time for calcul the mask position with numpy : 0.005945682525634766 nb_pixel_total : 117 time to create 1 rle with old method : 0.00015854835510253906 time for calcul the mask position with numpy : 0.0060274600982666016 nb_pixel_total : 12772 time to create 1 rle with old method : 0.013644933700561523 time for calcul the mask position with numpy : 0.005903482437133789 nb_pixel_total : 889 time to create 1 rle with old method : 0.0010037422180175781 time for calcul the mask position with numpy : 0.0058977603912353516 nb_pixel_total : 342 time to create 1 rle with old method : 0.00036144256591796875 time for calcul the mask position with numpy : 0.005921602249145508 nb_pixel_total : 783 time to create 1 rle with old method : 0.0009303092956542969 time for calcul the mask position with numpy : 0.005702018737792969 nb_pixel_total : 239 time to create 1 rle with old method : 0.0002868175506591797 time for calcul the mask position with numpy : 0.0059967041015625 nb_pixel_total : 73 time to create 1 rle with old method : 0.00011014938354492188 time for calcul the mask position with numpy : 0.005900144577026367 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004696846008300781 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003457069396972656 time for calcul the mask position with numpy : 0.005969524383544922 nb_pixel_total : 1150 time to create 1 rle with old method : 0.0012748241424560547 time for calcul the mask position with numpy : 0.0061490535736083984 nb_pixel_total : 634 time to create 1 rle with old method : 0.0007586479187011719 time for calcul the mask position with numpy : 0.00593113899230957 nb_pixel_total : 220 time to create 1 rle with old method : 0.00024318695068359375 time for calcul the mask position with numpy : 0.005976676940917969 nb_pixel_total : 1515 time to create 1 rle with old method : 0.0017838478088378906 time for calcul the mask position with numpy : 0.005977630615234375 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004980564117431641 time for calcul the mask position with numpy : 0.006087779998779297 nb_pixel_total : 30 time to create 1 rle with old method : 0.0001373291015625 time for calcul the mask position with numpy : 0.0059545040130615234 nb_pixel_total : 921 time to create 1 rle with old method : 0.0010180473327636719 time for calcul the mask position with numpy : 0.005823373794555664 nb_pixel_total : 760 time to create 1 rle with old method : 0.0008838176727294922 time for calcul the mask position with numpy : 0.0057218074798583984 nb_pixel_total : 40 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.005665302276611328 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006496906280517578 time for calcul the mask position with numpy : 0.0069353580474853516 nb_pixel_total : 5846 time to create 1 rle with old method : 0.00624847412109375 time for calcul the mask position with numpy : 0.00909566879272461 nb_pixel_total : 8280 time to create 1 rle with old method : 0.0084991455078125 time for calcul the mask position with numpy : 0.008974313735961914 nb_pixel_total : 142 time to create 1 rle with old method : 0.00018906593322753906 time for calcul the mask position with numpy : 0.009285211563110352 nb_pixel_total : 1230 time to create 1 rle with old method : 0.0013613700866699219 time for calcul the mask position with numpy : 0.009206295013427734 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005450248718261719 time for calcul the mask position with numpy : 0.010229349136352539 nb_pixel_total : 2759 time to create 1 rle with old method : 0.0031213760375976562 time for calcul the mask position with numpy : 0.009821414947509766 nb_pixel_total : 5417 time to create 1 rle with old method : 0.006098031997680664 time for calcul the mask position with numpy : 0.010071516036987305 nb_pixel_total : 3428 time to create 1 rle with old method : 0.003819704055786133 time for calcul the mask position with numpy : 0.009404897689819336 nb_pixel_total : 2484 time to create 1 rle with old method : 0.0028450489044189453 time for calcul the mask position with numpy : 0.00967550277709961 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009052753448486328 time for calcul the mask position with numpy : 0.009795904159545898 nb_pixel_total : 747 time to create 1 rle with old method : 0.0008542537689208984 time for calcul the mask position with numpy : 0.009509086608886719 nb_pixel_total : 818 time to create 1 rle with old method : 0.0010149478912353516 time for calcul the mask position with numpy : 0.009072303771972656 nb_pixel_total : 1426 time to create 1 rle with old method : 0.0015170574188232422 time for calcul the mask position with numpy : 0.0057964324951171875 nb_pixel_total : 29 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.005827426910400391 nb_pixel_total : 23 time to create 1 rle with old method : 8.654594421386719e-05 time for calcul the mask position with numpy : 0.0058438777923583984 nb_pixel_total : 1654 time to create 1 rle with old method : 0.0018284320831298828 time for calcul the mask position with numpy : 0.0057849884033203125 nb_pixel_total : 1015 time to create 1 rle with old method : 0.0010650157928466797 time for calcul the mask position with numpy : 0.0059795379638671875 nb_pixel_total : 6335 time to create 1 rle with old method : 0.006592988967895508 time for calcul the mask position with numpy : 0.005841732025146484 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007002353668212891 time for calcul the mask position with numpy : 0.005789041519165039 nb_pixel_total : 999 time to create 1 rle with old method : 0.0011191368103027344 time for calcul the mask position with numpy : 0.0056993961334228516 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002684593200683594 time for calcul the mask position with numpy : 0.005732297897338867 nb_pixel_total : 1897 time to create 1 rle with old method : 0.0021238327026367188 time for calcul the mask position with numpy : 0.0057375431060791016 nb_pixel_total : 332 time to create 1 rle with old method : 0.0003478527069091797 time for calcul the mask position with numpy : 0.00568079948425293 nb_pixel_total : 550 time to create 1 rle with old method : 0.0006601810455322266 time for calcul the mask position with numpy : 0.006276130676269531 nb_pixel_total : 2549 time to create 1 rle with old method : 0.0027043819427490234 time for calcul the mask position with numpy : 0.005543947219848633 nb_pixel_total : 616 time to create 1 rle with old method : 0.0006656646728515625 time for calcul the mask position with numpy : 0.005457878112792969 nb_pixel_total : 4451 time to create 1 rle with old method : 0.004522085189819336 time for calcul the mask position with numpy : 0.005744457244873047 nb_pixel_total : 4863 time to create 1 rle with old method : 0.0051116943359375 time for calcul the mask position with numpy : 0.005730867385864258 nb_pixel_total : 1742 time to create 1 rle with old method : 0.0018534660339355469 time for calcul the mask position with numpy : 0.0057795047760009766 nb_pixel_total : 83 time to create 1 rle with old method : 0.00011897087097167969 time for calcul the mask position with numpy : 0.005727291107177734 nb_pixel_total : 528 time to create 1 rle with old method : 0.0005714893341064453 time for calcul the mask position with numpy : 0.0057070255279541016 nb_pixel_total : 3264 time to create 1 rle with old method : 0.003855466842651367 time for calcul the mask position with numpy : 0.006021261215209961 nb_pixel_total : 681 time to create 1 rle with old method : 0.0008528232574462891 time for calcul the mask position with numpy : 0.005784034729003906 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0018053054809570312 time for calcul the mask position with numpy : 0.005911827087402344 nb_pixel_total : 1549 time to create 1 rle with old method : 0.0017445087432861328 time for calcul the mask position with numpy : 0.005845069885253906 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003364086151123047 time for calcul the mask position with numpy : 0.005934476852416992 nb_pixel_total : 1025 time to create 1 rle with old method : 0.0010864734649658203 time for calcul the mask position with numpy : 0.006010293960571289 nb_pixel_total : 918 time to create 1 rle with old method : 0.0010378360748291016 time for calcul the mask position with numpy : 0.0058765411376953125 nb_pixel_total : 27 time to create 1 rle with old method : 5.14984130859375e-05 time for calcul the mask position with numpy : 0.005963325500488281 nb_pixel_total : 132 time to create 1 rle with old method : 0.00016760826110839844 time for calcul the mask position with numpy : 0.0059814453125 nb_pixel_total : 224 time to create 1 rle with old method : 0.00028252601623535156 time for calcul the mask position with numpy : 0.005827188491821289 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003082752227783203 time for calcul the mask position with numpy : 0.006819963455200195 nb_pixel_total : 106546 time to create 1 rle with old method : 0.11249589920043945 time for calcul the mask position with numpy : 0.006300926208496094 nb_pixel_total : 3625 time to create 1 rle with old method : 0.004262208938598633 time for calcul the mask position with numpy : 0.006178140640258789 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007226467132568359 time for calcul the mask position with numpy : 0.006204128265380859 nb_pixel_total : 1939 time to create 1 rle with old method : 0.003215789794921875 time for calcul the mask position with numpy : 0.006167411804199219 nb_pixel_total : 645 time to create 1 rle with old method : 0.0008678436279296875 time for calcul the mask position with numpy : 0.006772518157958984 nb_pixel_total : 279 time to create 1 rle with old method : 0.0005304813385009766 time for calcul the mask position with numpy : 0.00733637809753418 nb_pixel_total : 13 time to create 1 rle with old method : 6.67572021484375e-05 time for calcul the mask position with numpy : 0.006834506988525391 nb_pixel_total : 211 time to create 1 rle with old method : 0.00027060508728027344 time for calcul the mask position with numpy : 0.0062067508697509766 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002548694610595703 time for calcul the mask position with numpy : 0.006081581115722656 nb_pixel_total : 276 time to create 1 rle with old method : 0.00033402442932128906 time for calcul the mask position with numpy : 0.006262063980102539 nb_pixel_total : 35 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.006350278854370117 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003502368927001953 time for calcul the mask position with numpy : 0.0060634613037109375 nb_pixel_total : 930 time to create 1 rle with old method : 0.0011150836944580078 time for calcul the mask position with numpy : 0.0059583187103271484 nb_pixel_total : 977 time to create 1 rle with old method : 0.001077890396118164 time for calcul the mask position with numpy : 0.006146430969238281 nb_pixel_total : 12 time to create 1 rle with old method : 5.793571472167969e-05 time for calcul the mask position with numpy : 0.0060024261474609375 nb_pixel_total : 284 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.00595402717590332 nb_pixel_total : 253 time to create 1 rle with old method : 0.00028133392333984375 time for calcul the mask position with numpy : 0.0058863162994384766 nb_pixel_total : 150 time to create 1 rle with old method : 0.00019216537475585938 time for calcul the mask position with numpy : 0.006033420562744141 nb_pixel_total : 110 time to create 1 rle with old method : 0.00015544891357421875 time for calcul the mask position with numpy : 0.005814313888549805 nb_pixel_total : 2110 time to create 1 rle with old method : 0.002375364303588867 time for calcul the mask position with numpy : 0.006086587905883789 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001690387725830078 time for calcul the mask position with numpy : 0.0059452056884765625 nb_pixel_total : 935 time to create 1 rle with old method : 0.0011148452758789062 time for calcul the mask position with numpy : 0.0063703060150146484 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005564689636230469 time for calcul the mask position with numpy : 0.0059795379638671875 nb_pixel_total : 394 time to create 1 rle with old method : 0.0004818439483642578 time for calcul the mask position with numpy : 0.0058062076568603516 nb_pixel_total : 671 time to create 1 rle with old method : 0.0007882118225097656 time for calcul the mask position with numpy : 0.005969047546386719 nb_pixel_total : 270 time to create 1 rle with old method : 0.000301361083984375 time for calcul the mask position with numpy : 0.005827665328979492 nb_pixel_total : 333 time to create 1 rle with old method : 0.00041222572326660156 time for calcul the mask position with numpy : 0.00568842887878418 nb_pixel_total : 22 time to create 1 rle with old method : 5.650520324707031e-05 time for calcul the mask position with numpy : 0.006103515625 nb_pixel_total : 2034 time to create 1 rle with old method : 0.002421140670776367 time for calcul the mask position with numpy : 0.0059587955474853516 nb_pixel_total : 859 time to create 1 rle with old method : 0.0010230541229248047 time for calcul the mask position with numpy : 0.0059490203857421875 nb_pixel_total : 1301 time to create 1 rle with old method : 0.00152587890625 time for calcul the mask position with numpy : 0.005800962448120117 nb_pixel_total : 91 time to create 1 rle with old method : 0.00012540817260742188 time for calcul the mask position with numpy : 0.005835056304931641 nb_pixel_total : 1586 time to create 1 rle with old method : 0.0019190311431884766 time for calcul the mask position with numpy : 0.006052255630493164 nb_pixel_total : 65 time to create 1 rle with old method : 9.465217590332031e-05 time for calcul the mask position with numpy : 0.006148338317871094 nb_pixel_total : 330 time to create 1 rle with old method : 0.00040221214294433594 time for calcul the mask position with numpy : 0.006262540817260742 nb_pixel_total : 106 time to create 1 rle with old method : 0.00013828277587890625 time for calcul the mask position with numpy : 0.006077289581298828 nb_pixel_total : 913 time to create 1 rle with old method : 0.001077890396118164 time for calcul the mask position with numpy : 0.006421327590942383 nb_pixel_total : 654 time to create 1 rle with old method : 0.0009245872497558594 time for calcul the mask position with numpy : 0.007181644439697266 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005109310150146484 time for calcul the mask position with numpy : 0.006134033203125 nb_pixel_total : 73 time to create 1 rle with old method : 0.00010538101196289062 time for calcul the mask position with numpy : 0.006025791168212891 nb_pixel_total : 9 time to create 1 rle with old method : 3.7670135498046875e-05 time for calcul the mask position with numpy : 0.00630497932434082 nb_pixel_total : 17 time to create 1 rle with old method : 4.1484832763671875e-05 time for calcul the mask position with numpy : 0.006278276443481445 nb_pixel_total : 2 time to create 1 rle with old method : 2.2172927856445312e-05 time for calcul the mask position with numpy : 0.006003618240356445 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003693103790283203 time for calcul the mask position with numpy : 0.006814479827880859 nb_pixel_total : 159 time to create 1 rle with old method : 0.00020885467529296875 time for calcul the mask position with numpy : 0.006073713302612305 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003407001495361328 time for calcul the mask position with numpy : 0.006055355072021484 nb_pixel_total : 863 time to create 1 rle with old method : 0.0010645389556884766 time for calcul the mask position with numpy : 0.0062408447265625 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003724098205566406 time for calcul the mask position with numpy : 0.006304740905761719 nb_pixel_total : 1610 time to create 1 rle with old method : 0.0019106864929199219 time for calcul the mask position with numpy : 0.006063699722290039 nb_pixel_total : 921 time to create 1 rle with old method : 0.0010881423950195312 time for calcul the mask position with numpy : 0.006406307220458984 nb_pixel_total : 3 time to create 1 rle with old method : 2.288818359375e-05 time for calcul the mask position with numpy : 0.00659942626953125 nb_pixel_total : 11 time to create 1 rle with old method : 5.459785461425781e-05 time for calcul the mask position with numpy : 0.0064220428466796875 nb_pixel_total : 2237 time to create 1 rle with old method : 0.002637624740600586 time for calcul the mask position with numpy : 0.0062770843505859375 nb_pixel_total : 115 time to create 1 rle with old method : 0.0001518726348876953 time for calcul the mask position with numpy : 0.006122112274169922 nb_pixel_total : 106 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.00609588623046875 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.006041765213012695 nb_pixel_total : 522 time to create 1 rle with old method : 0.0006380081176757812 time for calcul the mask position with numpy : 0.005816936492919922 nb_pixel_total : 12 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.005984306335449219 nb_pixel_total : 195 time to create 1 rle with old method : 0.00024962425231933594 time for calcul the mask position with numpy : 0.006123542785644531 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003192424774169922 time for calcul the mask position with numpy : 0.006170034408569336 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002231597900390625 time for calcul the mask position with numpy : 0.00609135627746582 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002281665802001953 time for calcul the mask position with numpy : 0.006243467330932617 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004220008850097656 time for calcul the mask position with numpy : 0.006092071533203125 nb_pixel_total : 314 time to create 1 rle with old method : 0.00038313865661621094 time for calcul the mask position with numpy : 0.006148099899291992 nb_pixel_total : 653 time to create 1 rle with old method : 0.0006937980651855469 time for calcul the mask position with numpy : 0.006804466247558594 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004096031188964844 time for calcul the mask position with numpy : 0.007259845733642578 nb_pixel_total : 794 time to create 1 rle with old method : 0.0010669231414794922 time for calcul the mask position with numpy : 0.0059850215911865234 nb_pixel_total : 164 time to create 1 rle with old method : 0.00020384788513183594 time for calcul the mask position with numpy : 0.005986213684082031 nb_pixel_total : 1632 time to create 1 rle with old method : 0.001998424530029297 time for calcul the mask position with numpy : 0.00626373291015625 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004131793975830078 time for calcul the mask position with numpy : 0.006777048110961914 nb_pixel_total : 3130 time to create 1 rle with old method : 0.003515005111694336 time for calcul the mask position with numpy : 0.005930423736572266 nb_pixel_total : 273 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.0059092044830322266 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002200603485107422 time for calcul the mask position with numpy : 0.006032705307006836 nb_pixel_total : 16 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.0057370662689208984 nb_pixel_total : 164 time to create 1 rle with old method : 0.00021028518676757812 time for calcul the mask position with numpy : 0.006026268005371094 nb_pixel_total : 1362 time to create 1 rle with old method : 0.0015568733215332031 time for calcul the mask position with numpy : 0.006144523620605469 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004487037658691406 time for calcul the mask position with numpy : 0.006209611892700195 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006241798400878906 time for calcul the mask position with numpy : 0.0061147212982177734 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004642009735107422 time for calcul the mask position with numpy : 0.005895137786865234 nb_pixel_total : 1242 time to create 1 rle with old method : 0.0013279914855957031 time for calcul the mask position with numpy : 0.006122589111328125 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001437664031982422 time for calcul the mask position with numpy : 0.006024599075317383 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001552104949951172 time for calcul the mask position with numpy : 0.005971670150756836 nb_pixel_total : 383 time to create 1 rle with old method : 0.00040459632873535156 time for calcul the mask position with numpy : 0.005837202072143555 nb_pixel_total : 2194 time to create 1 rle with old method : 0.0025587081909179688 time for calcul the mask position with numpy : 0.0060923099517822266 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003714561462402344 time for calcul the mask position with numpy : 0.006084442138671875 nb_pixel_total : 403 time to create 1 rle with old method : 0.00047588348388671875 time for calcul the mask position with numpy : 0.006200075149536133 nb_pixel_total : 82 time to create 1 rle with old method : 0.00014781951904296875 time for calcul the mask position with numpy : 0.006315469741821289 nb_pixel_total : 495 time to create 1 rle with old method : 0.0005650520324707031 time for calcul the mask position with numpy : 0.006695270538330078 nb_pixel_total : 181 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.005980730056762695 nb_pixel_total : 419 time to create 1 rle with old method : 0.00048661231994628906 time for calcul the mask position with numpy : 0.008304834365844727 nb_pixel_total : 586 time to create 1 rle with old method : 0.0007433891296386719 time for calcul the mask position with numpy : 0.008338451385498047 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005354881286621094 time for calcul the mask position with numpy : 0.008104324340820312 nb_pixel_total : 208 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.007981061935424805 nb_pixel_total : 7 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.008394956588745117 nb_pixel_total : 141 time to create 1 rle with old method : 0.0001621246337890625 create new chi : 1.5321297645568848 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0017423629760742188 batch 1 Loaded 168 chid ids of type : 4230 Number RLEs to save : 14662 TO DO : save crop sub photo not yet done ! save time : 1.1794719696044922 map_output_result : {1337667941: (0.0, 'Should be the crop_list due to order', 0.0), 1337667938: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337667941, 1337667938] Looping around the photos to save general results len do output : 2 /1337667941.Didn't retrieve data . /1337667938.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667941', None, None, None, None, None, '2588617') ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667938', None, None, None, None, None, '2588617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012393712997436523 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.112380743026733 time spend to save output : 0.012619972229003906 total time spend for step 4 : 10.125000715255737 step5:crop_condition Sat Feb 15 06:21:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 331 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 102 About to insert : list_path_to_insert length 102 new photo from crops ! About to upload 102 photos upload in portfolio : 4869462 init cache_photo without model_param we have 102 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739596870_4015661 we have uploaded 102 photos in the portfolio 4869462 time of upload the photos Elapsed time : 27.312482595443726 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 4869462 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739596898_4015661 we have uploaded 33 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.674317598342896 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739596907_4015661 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.4439585208892822 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 44 About to insert : list_path_to_insert length 44 new photo from crops ! About to upload 44 photos upload in portfolio : 4869462 init cache_photo without model_param we have 44 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739596911_4015661 we have uploaded 44 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.48912787437439 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739596923_4015661 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6250221729278564 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337667941, 1337667938] Looping around the photos to save general results len do output : 194 /1337828327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337828532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667941', None, None, None, None, None, '2588617') ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667938', None, None, None, None, None, '2588617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 584 time used for this insertion : 0.04129981994628906 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.98784279823303 time spend to save output : 0.04819059371948242 total time spend for step 5 : 58.036033391952515 step6:thcl Sat Feb 15 06:22:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.005357503890991211 time to convert the images to numpy array : 0.040723323822021484 time to import caffe and check if the image exist : 0.011669635772705078 time to convert the images to numpy array : 0.05899214744567871 time to import caffe and check if the image exist : 0.015456199645996094 time to convert the images to numpy array : 0.061760663986206055 time to import caffe and check if the image exist : 0.021758317947387695 time to convert the images to numpy array : 0.05515170097351074 time to import caffe and check if the image exist : 0.0177762508392334 time to convert the images to numpy array : 0.0617823600769043 time to import caffe and check if the image exist : 0.016073226928710938 time to convert the images to numpy array : 0.0647740364074707 time to import caffe and check if the image exist : 0.016782045364379883 time to convert the images to numpy array : 0.06514739990234375 time to import caffe and check if the image exist : 0.023328065872192383 time to convert the images to numpy array : 0.05914640426635742 time to import caffe and check if the image exist : 0.016019105911254883 time to convert the images to numpy array : 0.06964445114135742 time to import caffe and check if the image exist : 0.024339675903320312 time to convert the images to numpy array : 0.06034994125366211 total time to convert the images to numpy array : 0.3321845531463623 list photo_ids error: [] list photo_ids correct : [1337828519, 1337828520, 1337828521, 1337828522, 1337828523, 1337828524, 1337828525, 1337828526, 1337828527, 1337828528, 1337828529, 1337828530, 1337828531, 1337828532, 1337828347, 1337828348, 1337828349, 1337828350, 1337828351, 1337828352, 1337828353, 1337828354, 1337828355, 1337828356, 1337828357, 1337828358, 1337828359, 1337828360, 1337828361, 1337828362, 1337828363, 1337828364, 1337828365, 1337828366, 1337828408, 1337828409, 1337828410, 1337828411, 1337828412, 1337828413, 1337828414, 1337828415, 1337828416, 1337828417, 1337828418, 1337828419, 1337828420, 1337828421, 1337828422, 1337828423, 1337828424, 1337828425, 1337828426, 1337828427, 1337828499, 1337828500, 1337828501, 1337828502, 1337828503, 1337828504, 1337828505, 1337828506, 1337828507, 1337828508, 1337828509, 1337828510, 1337828511, 1337828512, 1337828513, 1337828514, 1337828515, 1337828516, 1337828517, 1337828518, 1337828367, 1337828368, 1337828369, 1337828370, 1337828371, 1337828372, 1337828373, 1337828374, 1337828375, 1337828376, 1337828377, 1337828378, 1337828379, 1337828381, 1337828382, 1337828383, 1337828384, 1337828385, 1337828386, 1337828387, 1337828428, 1337828429, 1337828433, 1337828434, 1337828435, 1337828436, 1337828437, 1337828438, 1337828439, 1337828440, 1337828441, 1337828442, 1337828443, 1337828444, 1337828445, 1337828446, 1337828447, 1337828448, 1337828449, 1337828450, 1337828388, 1337828389, 1337828390, 1337828391, 1337828392, 1337828393, 1337828394, 1337828395, 1337828396, 1337828397, 1337828398, 1337828399, 1337828400, 1337828401, 1337828402, 1337828403, 1337828404, 1337828405, 1337828406, 1337828407, 1337828474, 1337828475, 1337828476, 1337828477, 1337828478, 1337828479, 1337828480, 1337828481, 1337828482, 1337828487, 1337828488, 1337828489, 1337828490, 1337828491, 1337828492, 1337828494, 1337828495, 1337828496, 1337828497, 1337828498, 1337828327, 1337828328, 1337828329, 1337828330, 1337828331, 1337828332, 1337828333, 1337828334, 1337828335, 1337828336, 1337828337, 1337828338, 1337828339, 1337828340, 1337828341, 1337828342, 1337828343, 1337828344, 1337828345, 1337828346, 1337828451, 1337828452, 1337828454, 1337828455, 1337828456, 1337828457, 1337828458, 1337828459, 1337828460, 1337828461, 1337828462, 1337828463, 1337828464, 1337828465, 1337828466, 1337828468, 1337828469, 1337828470, 1337828471, 1337828472] number of photos to traite : 194 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4696 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4477 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.9089202880859375 time used to do the prediction : 0.9005296230316162 save descriptor for thcl : 3237 time to traite the descriptors : 1.142977237701416 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1337828519 To insert : 1337828520 To insert : 1337828521 To insert : 1337828522 To insert : 1337828523 To insert : 1337828524 To insert : 1337828525 To insert : 1337828526 To insert : 1337828527 To insert : 1337828528 To insert : 1337828529 To insert : 1337828530 To insert : 1337828531 To insert : 1337828532 To insert : 1337828347 To insert : 1337828348 To insert : 1337828349 To insert : 1337828350 To insert : 1337828351 To insert : 1337828352 To insert : 1337828353 To insert : 1337828354 To insert : 1337828355 To insert : 1337828356 To insert : 1337828357 To insert : 1337828358 To insert : 1337828359 To insert : 1337828360 To insert : 1337828361 To insert : 1337828362 To insert : 1337828363 To insert : 1337828364 To insert : 1337828365 To insert : 1337828366 To insert : 1337828408 To insert : 1337828409 To insert : 1337828410 To insert : 1337828411 To insert : 1337828412 To insert : 1337828413 To insert : 1337828414 To insert : 1337828415 To insert : 1337828416 To insert : 1337828417 To insert : 1337828418 To insert : 1337828419 To insert : 1337828420 To insert : 1337828421 To insert : 1337828422 To insert : 1337828423 To insert : 1337828424 To insert : 1337828425 To insert : 1337828426 To insert : 1337828427 To insert : 1337828499 To insert : 1337828500 To insert : 1337828501 To insert : 1337828502 To insert : 1337828503 To insert : 1337828504 To insert : 1337828505 To insert : 1337828506 To insert : 1337828507 To insert : 1337828508 To insert : 1337828509 To insert : 1337828510 To insert : 1337828511 To insert : 1337828512 To insert : 1337828513 To insert : 1337828514 To insert : 1337828515 To insert : 1337828516 To insert : 1337828517 To insert : 1337828518 To insert : 1337828367 To insert : 1337828368 To insert : 1337828369 To insert : 1337828370 To insert : 1337828371 To insert : 1337828372 To insert : 1337828373 To insert : 1337828374 To insert : 1337828375 To insert : 1337828376 To insert : 1337828377 To insert : 1337828378 To insert : 1337828379 To insert : 1337828381 To insert : 1337828382 To insert : 1337828383 To insert : 1337828384 To insert : 1337828385 To insert : 1337828386 To insert : 1337828387 To insert : 1337828428 To insert : 1337828429 To insert : 1337828433 To insert : 1337828434 To insert : 1337828435 To insert : 1337828436 To insert : 1337828437 To insert : 1337828438 To insert : 1337828439 To insert : 1337828440 To insert : 1337828441 To insert : 1337828442 To insert : 1337828443 To insert : 1337828444 To insert : 1337828445 To insert : 1337828446 To insert : 1337828447 To insert : 1337828448 To insert : 1337828449 To insert : 1337828450 To insert : 1337828388 To insert : 1337828389 To insert : 1337828390 To insert : 1337828391 To insert : 1337828392 To insert : 1337828393 To insert : 1337828394 To insert : 1337828395 To insert : 1337828396 To insert : 1337828397 To insert : 1337828398 To insert : 1337828399 To insert : 1337828400 To insert : 1337828401 To insert : 1337828402 To insert : 1337828403 To insert : 1337828404 To insert : 1337828405 To insert : 1337828406 To insert : 1337828407 To insert : 1337828474 To insert : 1337828475 To insert : 1337828476 To insert : 1337828477 To insert : 1337828478 To insert : 1337828479 To insert : 1337828480 To insert : 1337828481 To insert : 1337828482 To insert : 1337828487 To insert : 1337828488 To insert : 1337828489 To insert : 1337828490 To insert : 1337828491 To insert : 1337828492 To insert : 1337828494 To insert : 1337828495 To insert : 1337828496 To insert : 1337828497 To insert : 1337828498 To insert : 1337828327 To insert : 1337828328 To insert : 1337828329 To insert : 1337828330 To insert : 1337828331 To insert : 1337828332 To insert : 1337828333 To insert : 1337828334 To insert : 1337828335 To insert : 1337828336 To insert : 1337828337 To insert : 1337828338 To insert : 1337828339 To insert : 1337828340 To insert : 1337828341 To insert : 1337828342 To insert : 1337828343 To insert : 1337828344 To insert : 1337828345 To insert : 1337828346 To insert : 1337828451 To insert : 1337828452 To insert : 1337828454 To insert : 1337828455 To insert : 1337828456 To insert : 1337828457 To insert : 1337828458 To insert : 1337828459 To insert : 1337828460 To insert : 1337828461 To insert : 1337828462 To insert : 1337828463 To insert : 1337828464 To insert : 1337828465 To insert : 1337828466 To insert : 1337828468 To insert : 1337828469 To insert : 1337828470 To insert : 1337828471 To insert : 1337828472 time to insert the descriptors : 36.8901093006134 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 304 time used for this insertion : 0.029465675354003906 save missing photos in datou_result : time spend for datou_step_exec : 44.22863960266113 time spend to save output : 0.07675957679748535 total time spend for step 6 : 44.30539917945862 step7:ventilate_hashtags_in_portfolio Sat Feb 15 06:22:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20567474 get user id for portfolio 20567474 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567474 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Carton','PET_fonce','autre','pet_clair','Film_plastique','PET_clair','PEHD','papier','pehd','environnement','pet_fonce','metal','mal_croppe','flou','refus','carton','Papier','Tetrapak')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567474 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Carton','PET_fonce','autre','pet_clair','Film_plastique','PET_clair','PEHD','papier','pehd','environnement','pet_fonce','metal','mal_croppe','flou','refus','carton','Papier','Tetrapak')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567474 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Carton','PET_fonce','autre','pet_clair','Film_plastique','PET_clair','PEHD','papier','pehd','environnement','pet_fonce','metal','mal_croppe','flou','refus','carton','Papier','Tetrapak')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567474 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Carton','PET_fonce','autre','pet_clair','Film_plastique','PET_clair','PEHD','papier','pehd','environnement','pet_fonce','metal','mal_croppe','flou','refus','carton','Papier','Tetrapak')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20583601,20583596,20583588,20583591,20583590,20583594,20583602,20583595,20583597,20583598,20583599,20583600,20583603?tags=carton,pet_fonce,autre,pet_clair,film_plastique,pehd,papier,environnement,metal,mal_croppe,flou,refus,tetrapak&datou_id_consolidate=4235&port_consolidate=20567474 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337667941, 1337667938] Looping around the photos to save general results len do output : 1 /20567474. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667941', None, None, None, None, None, '2588617') ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667938', None, None, None, None, None, '2588617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.02376413345336914 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.6232128143310547 time spend to save output : 0.02402639389038086 total time spend for step 7 : 3.6472392082214355 step8:final Sat Feb 15 06:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337667941: ('0.204046268666926',), 1337667938: ('0.204046268666926',)} new output for save of step final : {1337667941: ('0.204046268666926',), 1337667938: ('0.204046268666926',)} [1337667941, 1337667938] Looping around the photos to save general results len do output : 2 /1337667941.Didn't retrieve data . /1337667938.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667941', None, None, None, None, None, '2588617') ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667938', None, None, None, None, None, '2588617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01621270179748535 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13188481330871582 time spend to save output : 0.01642751693725586 total time spend for step 8 : 0.14831233024597168 step9:velours_tree Sat Feb 15 06:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20583601,20583596,20583588,20583591,20583590,20583594,20583602,20583595,20583597,20583598,20583599,20583600,20583603 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583601 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583596 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583588 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583591 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583590 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583594 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583602 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583595 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583597 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583598 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583599 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583600 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20583603 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 194 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [1 2 2 5 3 3 5 3 0 1 3 0 0 3 0 0 2 3 1 1 0 1 2 2 0 2 4 4 3 1 0 2 2 5 1 4 4 4 1 4 2 2 5 1 1 1 4 2 2 1 1 2 5 3 1 5 3 5 3 0 0 3 0 5 0 2 2 3 4 2 4 2 0 0 2 4 4 3 0 0 2 2 5 0 2 4 4 1 2 5 2 1 0 1 4 1 1 1 2 1 1 0 0 5 0 2 0 1 2 5 2 0 1 0 5 5 0 0 3 0 1 2 1 5 1 2 1 0 0 2 0 5 2 5 2 1 1 5 2 2 0 1 5 0 2 2 0 3 5 1 2 0 5 2 1 5 0 2 2 4 4 4 4 4 4 1 2 5 1 0 1 1 0 1 5 2 2 0 5 1 2 4 4 4 4 1 2 0 1 1 1 0 1 4] Elapsed time: 0.0267484188079834 graph_id used : 78825 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20583601,20583596,20583588,20583591,20583590,20583594,20583602,20583595,20583597,20583598,20583599,20583600,20583603?tags=carton,pet_fonce,autre,pet_clair,film_plastique,pehd,papier,environnement,metal,mal_croppe,flou,refus,tetrapak&datou_id_consolidate=4235&port_consolidate=20567474&tree_id=78825 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1337667941, 1337667938] Looping around the photos to save general results len do output : 1 /20567474Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667941', None, None, None, None, None, '2588617') ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667938', None, None, None, None, None, '2588617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.02012467384338379 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.014379739761353 time spend to save output : 0.020394086837768555 total time spend for step 9 : 17.03477382659912 step10:send_mail_cod Sat Feb 15 06:23:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf 20583583 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205835831739596991 20583578 imagette205835781739596992 20583570 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205835701739596992 20583573 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205835731739596993 20583572 imagette205835721739596993 20583576 change filename to text .imagette205835761739596993 20583584 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205835841739596993 20583579 imagette205835791739596994 20583580 imagette205835801739596994 20583581 imagette205835811739596994 20583582 imagette205835821739596994 20583585 imagette205835851739596994 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20567474 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20583601,20583596,20583588,20583591,20583590,20583594,20583602,20583595,20583597,20583598,20583599,20583600,20583603?tags=carton,pet_fonce,autre,pet_clair,film_plastique,pehd,papier,environnement,metal,mal_croppe,flou,refus,tetrapak&datou_id_consolidate=4235&port_consolidate=20567474&tree_id=78825 your option no_mail is active, we will not send the real mail to your client args[1337667941] : ((1337667941, -7.75073210072074, 492609224), (1337667941, -0.49683288215308713, 501862349), '0.204046268666926') apple ((1337667941, -7.75073210072074, 492609224), (1337667941, -0.49683288215308713, 501862349), '0.204046268666926') We are sending mail with results at cod@fotonower.com args[1337667938] : ((1337667938, -7.760113290762162, 492609224), (1337667938, -0.51681711185177, 501862349), '0.204046268666926') apple ((1337667938, -7.760113290762162, 492609224), (1337667938, -0.51681711185177, 501862349), '0.204046268666926') We are sending mail with results at cod@fotonower.com refus_total : 0.204046268666926 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20567474 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20567474','results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf','pdf','','0.15','0.204046268666926') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337667941, 1337667938] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667941', None, None, None, None, None, '2588617') ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667938', None, None, None, None, None, '2588617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.015316247940063477 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.2730677127838135 time spend to save output : 0.015457630157470703 total time spend for step 10 : 4.288525342941284 step11:split_time_score Sat Feb 15 06:23:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14022025 20567474 Nombre de photos uploadées : 2 / 23040 (0%) 14022025 20567474 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 14022025 20567474 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00019097328186035156 elapsed_time : insert_dashboard_record_day_entry 0.02498006820678711 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14080265003567735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20557267_14-02-2025_13_16_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20557267 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20557267 AND mptpi.`type`=4230 To do Qualite : 0.16283505865355488 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20557268_14-02-2025_13_06_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20557268 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20557268 AND mptpi.`type`=4230 To do Qualite : 0.12385820099779768 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20578763_15-02-2025_00_23_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20578763 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20578763 AND mptpi.`type`=4230 To do Qualite : 0.17080943635979126 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561437_14-02-2025_16_47_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561437 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561437 AND mptpi.`type`=4230 To do Qualite : 0.15705737530364391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561438_14-02-2025_16_22_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561438 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561438 AND mptpi.`type`=4230 To do Qualite : 0.24123338678301143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561439_14-02-2025_16_36_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561439 AND mptpi.`type`=4230 To do Qualite : 0.2278315065084019 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561440_14-02-2025_15_49_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561440 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561440 AND mptpi.`type`=4230 To do Qualite : 0.21292784892651612 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20577017_14-02-2025_22_03_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577017 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577017 AND mptpi.`type`=4230 To do Qualite : 0.21228317775297423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20565004_14-02-2025_17_33_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565004 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20565004 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565005 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565006 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565007 order by id desc limit 1 Qualite : 0.2534233030896306 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568568_15-02-2025_05_13_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568568 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568568 AND mptpi.`type`=4230 To do Qualite : 0.2588671757087973 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568570_15-02-2025_05_39_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568570 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568570 AND mptpi.`type`=4230 To do Qualite : 0.25108773598537126 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568571_15-02-2025_04_03_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568571 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568571 AND mptpi.`type`=4230 To do Qualite : 0.20697733701802679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568572_15-02-2025_04_38_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568572 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568572 AND mptpi.`type`=4230 To do Qualite : 0.21802253677162223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568575_15-02-2025_02_47_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568575 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568575 AND mptpi.`type`=4230 To do Qualite : 0.2522388465777581 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568587_15-02-2025_02_33_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568587 AND mptpi.`type`=4230 To do Qualite : 0.25095045419947665 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568601_15-02-2025_01_56_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568601 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568601 AND mptpi.`type`=4230 To do Qualite : 0.2392819042405134 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568602_15-02-2025_03_43_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568602 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568602 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567453 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567454 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567456 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567459 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567460 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567461 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567463 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567464 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567465 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567466 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567467 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567468 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567469 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567470 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567471 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567472 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567473 order by id desc limit 1 Qualite : 0.204046268666926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567474 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567474 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567475 order by id desc limit 1 Qualite : 0.21982992715830277 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567476_15-02-2025_06_17_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567476 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567476 AND mptpi.`type`=4230 To do Qualite : 0.30472788576123255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567477_15-02-2025_05_47_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567477 AND mptpi.`type`=4230 To do Qualite : 0.23699891677009535 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567478_14-02-2025_18_34_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567478 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567478 AND mptpi.`type`=4230 To do Qualite : 0.2659324169831625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567479_14-02-2025_18_20_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567479 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567479 AND mptpi.`type`=4230 To do Qualite : 0.23264297907652698 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567480_14-02-2025_18_23_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567480 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567480 AND mptpi.`type`=4230 To do Qualite : 0.2402551151372868 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568604_15-02-2025_00_48_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568604 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568604 AND mptpi.`type`=4230 To do Qualite : 0.22023519577147693 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568605_14-02-2025_23_48_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568605 AND mptpi.`type`=4230 To do Qualite : 0.26055813790983423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568606_15-02-2025_00_34_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568606 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568606 AND mptpi.`type`=4230 To do Qualite : 0.25440762275141415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568607 AND mptpi.`type`=4230 To do Qualite : 0.23908227128633877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568608_14-02-2025_20_21_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568608 AND mptpi.`type`=4230 To do Qualite : 0.25379507447780547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568609_14-02-2025_18_47_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568609 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568609 AND mptpi.`type`=4230 To do Qualite : 0.255508684248806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568610_14-02-2025_19_35_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568610 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568610 AND mptpi.`type`=4230 To do Qualite : 0.24818222150458366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568611_14-02-2025_20_34_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568611 AND mptpi.`type`=4230 To do Qualite : 0.2428419785256863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568612_14-02-2025_18_37_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568612 AND mptpi.`type`=4230 To do Qualite : 0.2477337637088999 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20571465_14-02-2025_19_47_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20571465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20571465 AND mptpi.`type`=4230 To do Qualite : 0.23064257970638882 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20576591_14-02-2025_22_45_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20576591 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20576591 AND mptpi.`type`=4230 To do Qualite : 0.21982307840160847 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20576592_14-02-2025_23_29_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20576592 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20576592 AND mptpi.`type`=4230 To do Qualite : 0.21935584026591903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20575968_14-02-2025_23_32_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20575968 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20575968 AND mptpi.`type`=4230 To do Qualite : 0.20981345687102668 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20575969_14-02-2025_21_19_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20575969 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20575969 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14022025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337667941, 1337667938] Looping around the photos to save general results len do output : 1 /20567474Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667941', None, None, None, None, None, '2588617') ('4234', None, None, None, None, None, None, None, '2588617') ('4234', '20567474', '1337667938', None, None, None, None, None, '2588617') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.015537738800048828 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.5944983959198 time spend to save output : 0.015710115432739258 total time spend for step 11 : 23.61020851135254 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 35.91user 24.05system 3:13.25elapsed 31%CPU (0avgtext+0avgdata 3145624maxresident)k 19288inputs+13720outputs (263major+2725402minor)pagefaults 0swaps