python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2260602 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2620556'] with mtr_portfolio_ids : ['20889800'] and first list_photo_ids : [] new path : /proc/2260602/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.6468448638916016 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Feb 28 01:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5304 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-28 01:20:33.828172: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-28 01:20:33.859379: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-28 01:20:33.862069: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5948000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-28 01:20:33.862139: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-28 01:20:33.868338: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-28 01:20:34.116707: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3ebc8710 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-28 01:20:34.116796: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-28 01:20:34.118413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 01:20:34.119200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 01:20:34.123594: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 01:20:34.132887: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 01:20:34.133564: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 01:20:34.148034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 01:20:34.152661: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 01:20:34.182239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 01:20:34.184277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 01:20:34.184475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 01:20:34.185464: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 01:20:34.185490: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 01:20:34.185503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 01:20:34.187165: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4843 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-28 01:20:34.548875: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 01:20:34.548960: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 01:20:34.548977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 01:20:34.548993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 01:20:34.549007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 01:20:34.549022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 01:20:34.549037: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 01:20:34.549051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 01:20:34.550047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 01:20:34.551046: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 01:20:34.551097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 01:20:34.551112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 01:20:34.551126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 01:20:34.551140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 01:20:34.551154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 01:20:34.551167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 01:20:34.551181: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 01:20:34.552142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 01:20:34.552171: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 01:20:34.552180: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 01:20:34.552188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 01:20:34.553199: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4843 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-28 01:20:44.124541: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 01:20:44.338982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 01:20:46.177888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:46.178603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:46.179259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:46.967082: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-28 01:20:47.037552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.037641: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.038456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.038478: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.044996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.045023: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.045745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.045761: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.128566: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.128630: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.133560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.133644: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.142843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.142969: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.144400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.144498: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.188197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.188283: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 188.27MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.191087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.191114: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 188.27MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 01:20:47.193993: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.196915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.209514: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.212288: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.213032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.213760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.220578: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.220622: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-28 01:20:47.225200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.225929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.235103: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.235848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.236584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.240027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.240839: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 01:20:47.241578: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.43047 max: 145.87344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 913 time to create 1 rle with old method : 0.0017669200897216797 length of segment : 36 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0013127326965332031 length of segment : 52 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0014386177062988281 length of segment : 31 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0005776882171630859 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.96172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.0016481876373291016 length of segment : 42 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.0013399124145507812 length of segment : 38 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 2458 time to create 1 rle with old method : 0.003342866897583008 length of segment : 48 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 2739 time to create 1 rle with old method : 0.0037348270416259766 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.98125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 3509 time to create 1 rle with old method : 0.004529714584350586 length of segment : 143 time for calcul the mask position with numpy : 0.00013780593872070312 nb_pixel_total : 1793 time to create 1 rle with old method : 0.0025703907012939453 length of segment : 27 time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 4295 time to create 1 rle with old method : 0.005948066711425781 length of segment : 64 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 979 time to create 1 rle with old method : 0.001499176025390625 length of segment : 27 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005679130554199219 length of segment : 17 time for calcul the mask position with numpy : 0.0001373291015625 nb_pixel_total : 2726 time to create 1 rle with old method : 0.0038874149322509766 length of segment : 88 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.29375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.000888824462890625 length of segment : 26 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0008161067962646484 length of segment : 34 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.14687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0010526180267333984 length of segment : 18 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 1369 time to create 1 rle with old method : 0.0025043487548828125 length of segment : 45 time for calcul the mask position with numpy : 9.822845458984375e-05 nb_pixel_total : 1143 time to create 1 rle with old method : 0.0020613670349121094 length of segment : 111 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -100.80156 max: 67.68984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.66094 max: 148.45937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.00023889541625976562 length of segment : 17 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002529621124267578 length of segment : 21 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.00014543533325195312 length of segment : 10 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006916522979736328 length of segment : 23 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002827644348144531 length of segment : 26 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.39141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0007548332214355469 length of segment : 30 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 693 time to create 1 rle with old method : 0.001443624496459961 length of segment : 21 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0004703998565673828 length of segment : 13 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0013704299926757812 length of segment : 35 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0003752708435058594 length of segment : 8 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0009069442749023438 length of segment : 23 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0005891323089599609 length of segment : 33 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0005092620849609375 length of segment : 16 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.0015063285827636719 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.52422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 2001 time to create 1 rle with old method : 0.0026264190673828125 length of segment : 171 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1152 time to create 1 rle with old method : 0.0015141963958740234 length of segment : 36 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00039315223693847656 length of segment : 19 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 22 time to create 1 rle with old method : 5.936622619628906e-05 length of segment : 6 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0018508434295654297 length of segment : 42 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1267 time to create 1 rle with old method : 0.0019278526306152344 length of segment : 45 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.0010671615600585938 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.77578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.00046324729919433594 length of segment : 20 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1726 time to create 1 rle with old method : 0.002373218536376953 length of segment : 83 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 4296 time to create 1 rle with old method : 0.005675077438354492 length of segment : 190 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1037 time to create 1 rle with old method : 0.0014598369598388672 length of segment : 83 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00016260147094726562 length of segment : 7 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.000499725341796875 length of segment : 29 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 903 time to create 1 rle with old method : 0.001340627670288086 length of segment : 103 time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 5065 time to create 1 rle with old method : 0.006482839584350586 length of segment : 216 time for calcul the mask position with numpy : 0.00019884109497070312 nb_pixel_total : 5375 time to create 1 rle with old method : 0.006983757019042969 length of segment : 219 Processing 1 images image shape: (280, 400, 3) min: 10.00000 max: 181.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 64.50234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009677410125732422 nb_pixel_total : 106032 time to create 1 rle with old method : 0.12316775321960449 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.50234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0007271766662597656 length of segment : 29 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00019073486328125 length of segment : 8 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0017828941345214844 length of segment : 64 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0008206367492675781 length of segment : 28 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1226 time to create 1 rle with old method : 0.001661062240600586 length of segment : 53 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 3515 time to create 1 rle with old method : 0.004805564880371094 length of segment : 68 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003070831298828125 length of segment : 23 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002434253692626953 length of segment : 16 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003104209899902344 length of segment : 11 time for calcul the mask position with numpy : 0.00047278404235839844 nb_pixel_total : 34671 time to create 1 rle with old method : 0.040926456451416016 length of segment : 218 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.00042748451232910156 length of segment : 23 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 3423 time to create 1 rle with old method : 0.004670619964599609 length of segment : 68 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 2247 time to create 1 rle with old method : 0.0037446022033691406 length of segment : 59 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004572868347167969 length of segment : 23 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003452301025390625 length of segment : 21 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 20 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1205 time to create 1 rle with old method : 0.0017175674438476562 length of segment : 79 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.58047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 29 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.003099203109741211 length of segment : 25 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006895065307617188 length of segment : 30 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 2829 time to create 1 rle with old method : 0.003846883773803711 length of segment : 61 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00020074844360351562 length of segment : 8 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005655288696289062 length of segment : 20 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003790855407714844 length of segment : 23 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1429 time to create 1 rle with old method : 0.001959085464477539 length of segment : 45 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006759166717529297 length of segment : 27 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 962 time to create 1 rle with old method : 0.0018112659454345703 length of segment : 48 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006117820739746094 length of segment : 16 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0018639564514160156 length of segment : 53 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007696151733398438 length of segment : 30 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0004684925079345703 length of segment : 15 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001933574676513672 length of segment : 11 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00049591064453125 length of segment : 23 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.0005185604095458984 length of segment : 26 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004248619079589844 length of segment : 16 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001766681671142578 length of segment : 9 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0009388923645019531 length of segment : 33 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0006015300750732422 length of segment : 21 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00041031837463378906 length of segment : 27 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00026345252990722656 length of segment : 9 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0003962516784667969 length of segment : 19 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0005257129669189453 length of segment : 17 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0010933876037597656 length of segment : 26 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005817413330078125 length of segment : 25 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 11 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0006575584411621094 length of segment : 17 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0007891654968261719 length of segment : 27 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.18203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002601146697998047 length of segment : 9 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005702972412109375 length of segment : 19 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 2148 time to create 1 rle with old method : 0.002986907958984375 length of segment : 67 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004055500030517578 length of segment : 21 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0005414485931396484 length of segment : 26 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0006060600280761719 length of segment : 20 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0007321834564208984 length of segment : 35 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 14 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002899169921875 length of segment : 24 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0006875991821289062 length of segment : 24 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00045871734619140625 length of segment : 36 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005986690521240234 length of segment : 30 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 8053 time to create 1 rle with old method : 0.010392427444458008 length of segment : 120 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 61 time to create 1 rle with old method : 0.00025844573974609375 length of segment : 21 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 95 time to create 1 rle with old method : 0.0002779960632324219 length of segment : 29 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0005502700805664062 length of segment : 26 time for calcul the mask position with numpy : 0.0003018379211425781 nb_pixel_total : 7710 time to create 1 rle with old method : 0.013157129287719727 length of segment : 123 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.001043558120727539 length of segment : 93 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 20 time to create 1 rle with old method : 8.106231689453125e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.94609 max: 145.74062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0008339881896972656 length of segment : 51 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.001264333724975586 length of segment : 30 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00027179718017578125 length of segment : 25 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.0011882781982421875 length of segment : 31 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1729 time to create 1 rle with old method : 0.0024385452270507812 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.36406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 37 time to create 1 rle with old method : 8.535385131835938e-05 length of segment : 7 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 2450 time to create 1 rle with old method : 0.003197193145751953 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.50469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0023300647735595703 length of segment : 24 time for calcul the mask position with numpy : 0.00013828277587890625 nb_pixel_total : 1690 time to create 1 rle with old method : 0.005589008331298828 length of segment : 23 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 4917 time to create 1 rle with old method : 0.014707326889038086 length of segment : 119 time for calcul the mask position with numpy : 0.0002613067626953125 nb_pixel_total : 5494 time to create 1 rle with old method : 0.007613658905029297 length of segment : 115 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.91484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0010890960693359375 length of segment : 26 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 603 time to create 1 rle with old method : 0.0012621879577636719 length of segment : 65 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0009176731109619141 length of segment : 34 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1434 time to create 1 rle with old method : 0.0025708675384521484 length of segment : 42 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0010733604431152344 length of segment : 18 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0014078617095947266 length of segment : 81 time for calcul the mask position with numpy : 0.0006296634674072266 nb_pixel_total : 49846 time to create 1 rle with old method : 0.05824851989746094 length of segment : 212 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 184.00000 molded_images shape: (1, 640, 640, 3) min: -97.83281 max: 68.56484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.32109 max: 150.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.0003139972686767578 length of segment : 15 time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 7902 time to create 1 rle with old method : 0.01090550422668457 length of segment : 110 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00023818016052246094 length of segment : 20 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 2759 time to create 1 rle with old method : 0.0036077499389648438 length of segment : 50 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002295970916748047 length of segment : 24 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00012922286987304688 length of segment : 9 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.62969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0011034011840820312 length of segment : 20 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0009045600891113281 length of segment : 37 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004379749298095703 length of segment : 18 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.000247955322265625 length of segment : 8 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0007185935974121094 length of segment : 14 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0008983612060546875 length of segment : 26 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004987716674804688 length of segment : 17 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0005736351013183594 length of segment : 32 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0004923343658447266 length of segment : 23 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0025124549865722656 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.77813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 1850 time to create 1 rle with old method : 0.0023086071014404297 length of segment : 128 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00025653839111328125 length of segment : 17 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 1170 time to create 1 rle with old method : 0.0014815330505371094 length of segment : 37 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00016927719116210938 length of segment : 7 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1351 time to create 1 rle with old method : 0.0021123886108398438 length of segment : 44 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 25 time to create 1 rle with old method : 6.389617919921875e-05 length of segment : 6 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1436 time to create 1 rle with old method : 0.0019240379333496094 length of segment : 46 length of segment : 0 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.0010447502136230469 length of segment : 39 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0005047321319580078 length of segment : 20 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1802 time to create 1 rle with old method : 0.0024156570434570312 length of segment : 86 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 835 time to create 1 rle with old method : 0.0011556148529052734 length of segment : 34 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.000148773193359375 length of segment : 6 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 851 time to create 1 rle with old method : 0.0012073516845703125 length of segment : 69 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0006530284881591797 length of segment : 24 time for calcul the mask position with numpy : 0.0002288818359375 nb_pixel_total : 4395 time to create 1 rle with old method : 0.005633115768432617 length of segment : 199 time for calcul the mask position with numpy : 0.0002562999725341797 nb_pixel_total : 5221 time to create 1 rle with old method : 0.0065577030181884766 length of segment : 220 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 181.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 62.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010275840759277344 nb_pixel_total : 106318 time to create 1 rle with old method : 0.133497953414917 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.51406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00019431114196777344 length of segment : 8 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 2936 time to create 1 rle with old method : 0.004273176193237305 length of segment : 47 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 975 time to create 1 rle with old method : 0.0017523765563964844 length of segment : 50 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1349 time to create 1 rle with old method : 0.0020678043365478516 length of segment : 67 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0006361007690429688 length of segment : 27 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 2698 time to create 1 rle with old method : 0.003623485565185547 length of segment : 86 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.001020193099975586 length of segment : 41 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0019042491912841797 length of segment : 54 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003478527069091797 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 1576 time to create 1 rle with old method : 0.0019037723541259766 length of segment : 46 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.000614166259765625 length of segment : 25 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0007660388946533203 length of segment : 31 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005757808685302734 length of segment : 23 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006277561187744141 length of segment : 28 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001990795135498047 length of segment : 11 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.00034332275390625 length of segment : 21 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004992485046386719 length of segment : 19 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 2888 time to create 1 rle with old method : 0.004059791564941406 length of segment : 62 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.0002200603485107422 length of segment : 8 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005869865417480469 length of segment : 32 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003948211669921875 length of segment : 17 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0007801055908203125 length of segment : 29 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006155967712402344 length of segment : 27 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0006656646728515625 length of segment : 16 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 769 time to create 1 rle with old method : 0.0013740062713623047 length of segment : 47 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015783309936523438 length of segment : 12 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003294944763183594 length of segment : 16 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0007450580596923828 length of segment : 25 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 691 time to create 1 rle with old method : 0.0011887550354003906 length of segment : 43 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00021195411682128906 length of segment : 10 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0007772445678710938 length of segment : 33 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0012357234954833984 length of segment : 36 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.00037550926208496094 length of segment : 16 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003917217254638672 length of segment : 14 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0008013248443603516 length of segment : 27 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0009062290191650391 length of segment : 27 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.85781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0004131793975830078 length of segment : 20 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00026702880859375 length of segment : 9 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 2920 time to create 1 rle with old method : 0.004201650619506836 length of segment : 59 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0007464885711669922 length of segment : 36 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005221366882324219 length of segment : 19 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001938343048095703 length of segment : 31 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003960132598876953 length of segment : 26 time for calcul the mask position with numpy : 0.0001842975616455078 nb_pixel_total : 7234 time to create 1 rle with old method : 0.009964704513549805 length of segment : 120 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.00040078163146972656 length of segment : 14 time for calcul the mask position with numpy : 0.00016617774963378906 nb_pixel_total : 7676 time to create 1 rle with old method : 0.011125326156616211 length of segment : 140 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003986358642578125 length of segment : 25 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 47 time to create 1 rle with old method : 0.00010156631469726562 length of segment : 12 time for calcul the mask position with numpy : 0.00014066696166992188 nb_pixel_total : 3017 time to create 1 rle with old method : 0.005246400833129883 length of segment : 71 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0006721019744873047 length of segment : 79 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.43047 max: 145.87344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 913 time to create 1 rle with old method : 0.001332998275756836 length of segment : 36 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0010595321655273438 length of segment : 52 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0011038780212402344 length of segment : 31 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002880096435546875 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.96172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.0013933181762695312 length of segment : 42 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 956 time to create 1 rle with old method : 0.001977205276489258 length of segment : 38 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 2459 time to create 1 rle with old method : 0.0036041736602783203 length of segment : 48 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 2741 time to create 1 rle with old method : 0.003850698471069336 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.98125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 953 time to create 1 rle with old method : 0.0017244815826416016 length of segment : 26 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1839 time to create 1 rle with old method : 0.003789663314819336 length of segment : 28 time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 4310 time to create 1 rle with old method : 0.007572650909423828 length of segment : 64 time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 5073 time to create 1 rle with old method : 0.007449150085449219 length of segment : 118 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.29375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0011284351348876953 length of segment : 26 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0008623600006103516 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.14687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0009486675262451172 length of segment : 18 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1506 time to create 1 rle with old method : 0.0022995471954345703 length of segment : 49 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 1174 time to create 1 rle with old method : 0.002068758010864258 length of segment : 115 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -100.80156 max: 67.68984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.66094 max: 148.45937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00020456314086914062 length of segment : 12 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00026702880859375 length of segment : 21 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.00015163421630859375 length of segment : 10 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0015456676483154297 length of segment : 23 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0003159046173095703 length of segment : 26 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.000324249267578125 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.39141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0006861686706542969 length of segment : 30 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 704 time to create 1 rle with old method : 0.0012581348419189453 length of segment : 22 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00041866302490234375 length of segment : 13 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0012142658233642578 length of segment : 35 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0003142356872558594 length of segment : 8 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0004353523254394531 length of segment : 23 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0005342960357666016 length of segment : 33 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0004398822784423828 length of segment : 16 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.0014159679412841797 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.52422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 2006 time to create 1 rle with old method : 0.003309488296508789 length of segment : 171 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0014510154724121094 length of segment : 36 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003693103790283203 length of segment : 19 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 22 time to create 1 rle with old method : 5.841255187988281e-05 length of segment : 6 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0016934871673583984 length of segment : 42 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1267 time to create 1 rle with old method : 0.0017728805541992188 length of segment : 45 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.0009655952453613281 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.77578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0005896091461181641 length of segment : 20 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 1729 time to create 1 rle with old method : 0.0034096240997314453 length of segment : 83 time for calcul the mask position with numpy : 0.0002446174621582031 nb_pixel_total : 4334 time to create 1 rle with old method : 0.007283449172973633 length of segment : 191 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 1037 time to create 1 rle with old method : 0.001882314682006836 length of segment : 83 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 903 time to create 1 rle with old method : 0.0017440319061279297 length of segment : 103 time for calcul the mask position with numpy : 0.00037980079650878906 nb_pixel_total : 4843 time to create 1 rle with old method : 0.00903463363647461 length of segment : 212 time for calcul the mask position with numpy : 0.00017690658569335938 nb_pixel_total : 5436 time to create 1 rle with old method : 0.006986141204833984 length of segment : 220 Processing 1 images image shape: (280, 400, 3) min: 10.00000 max: 181.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 64.50234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0011816024780273438 nb_pixel_total : 106031 time to create 1 rle with old method : 0.16772866249084473 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.50234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.00086212158203125 length of segment : 29 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00024271011352539062 length of segment : 8 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0021338462829589844 length of segment : 64 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0007917881011962891 length of segment : 27 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1226 time to create 1 rle with old method : 0.0017390251159667969 length of segment : 53 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 3514 time to create 1 rle with old method : 0.004585981369018555 length of segment : 68 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.000301361083984375 length of segment : 23 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.00023865699768066406 length of segment : 16 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003223419189453125 length of segment : 11 time for calcul the mask position with numpy : 0.00047779083251953125 nb_pixel_total : 34646 time to create 1 rle with old method : 0.0430607795715332 length of segment : 218 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.000415802001953125 length of segment : 23 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 3422 time to create 1 rle with old method : 0.004474163055419922 length of segment : 68 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 2251 time to create 1 rle with old method : 0.002910614013671875 length of segment : 60 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0006928443908691406 length of segment : 23 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0005180835723876953 length of segment : 21 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003681182861328125 length of segment : 20 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1247 time to create 1 rle with old method : 0.0017466545104980469 length of segment : 80 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.58047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 29 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0006439685821533203 length of segment : 25 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0007109642028808594 length of segment : 30 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001823902130126953 length of segment : 8 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005543231964111328 length of segment : 20 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003838539123535156 length of segment : 23 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0018961429595947266 length of segment : 45 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006473064422607422 length of segment : 27 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 2843 time to create 1 rle with old method : 0.0037064552307128906 length of segment : 61 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 949 time to create 1 rle with old method : 0.001443624496459961 length of segment : 47 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005924701690673828 length of segment : 16 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007939338684082031 length of segment : 30 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00038051605224609375 length of segment : 15 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 1111 time to create 1 rle with old method : 0.0016205310821533203 length of segment : 56 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00018596649169921875 length of segment : 11 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004899501800537109 length of segment : 23 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.00042057037353515625 length of segment : 26 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00017952919006347656 length of segment : 8 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004112720489501953 length of segment : 16 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0006840229034423828 length of segment : 33 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004851818084716797 length of segment : 21 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002903938293457031 length of segment : 27 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00017905235290527344 length of segment : 9 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00029206275939941406 length of segment : 19 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0005002021789550781 length of segment : 17 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 25 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0007815361022949219 length of segment : 26 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.00031948089599609375 length of segment : 11 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004470348358154297 length of segment : 17 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0007951259613037109 length of segment : 27 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.18203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00035452842712402344 length of segment : 9 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0007114410400390625 length of segment : 19 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 2146 time to create 1 rle with old method : 0.003446340560913086 length of segment : 67 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004119873046875 length of segment : 26 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004451274871826172 length of segment : 20 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003962516784667969 length of segment : 20 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0007231235504150391 length of segment : 34 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002791881561279297 length of segment : 14 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002810955047607422 length of segment : 24 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0006897449493408203 length of segment : 24 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00046753883361816406 length of segment : 36 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0007922649383544922 length of segment : 30 time for calcul the mask position with numpy : 0.00011682510375976562 nb_pixel_total : 163 time to create 1 rle with old method : 0.0003457069396972656 length of segment : 28 time for calcul the mask position with numpy : 0.0001876354217529297 nb_pixel_total : 8061 time to create 1 rle with old method : 0.012906551361083984 length of segment : 120 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0002932548522949219 length of segment : 26 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0005578994750976562 length of segment : 26 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 7734 time to create 1 rle with old method : 0.01240396499633789 length of segment : 122 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0007383823394775391 length of segment : 94 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 20 time to create 1 rle with old method : 5.602836608886719e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.94609 max: 145.74062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0008063316345214844 length of segment : 51 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0012314319610595703 length of segment : 30 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00024247169494628906 length of segment : 25 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.0011374950408935547 length of segment : 31 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1728 time to create 1 rle with old method : 0.0024826526641845703 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.36406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 37 time to create 1 rle with old method : 0.00018334388732910156 length of segment : 7 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 2449 time to create 1 rle with old method : 0.004082918167114258 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.50469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0018534660339355469 length of segment : 24 time for calcul the mask position with numpy : 0.00010132789611816406 nb_pixel_total : 4936 time to create 1 rle with old method : 0.007939338684082031 length of segment : 120 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 1741 time to create 1 rle with old method : 0.003149747848510742 length of segment : 23 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 2311 time to create 1 rle with old method : 0.004381418228149414 length of segment : 31 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 5551 time to create 1 rle with old method : 0.008655548095703125 length of segment : 112 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.91484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0007803440093994141 length of segment : 26 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006492137908935547 length of segment : 34 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007579326629638672 length of segment : 60 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0024788379669189453 length of segment : 42 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0007290840148925781 length of segment : 18 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0009884834289550781 length of segment : 81 time for calcul the mask position with numpy : 0.0004906654357910156 nb_pixel_total : 49841 time to create 1 rle with old method : 0.08106112480163574 length of segment : 213 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 184.00000 molded_images shape: (1, 640, 640, 3) min: -97.83281 max: 68.56484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.32109 max: 150.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.0002872943878173828 length of segment : 15 time for calcul the mask position with numpy : 0.0001697540283203125 nb_pixel_total : 7899 time to create 1 rle with old method : 0.011059999465942383 length of segment : 110 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00023889541625976562 length of segment : 20 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 2759 time to create 1 rle with old method : 0.0039098262786865234 length of segment : 50 time for calcul the mask position with numpy : 0.00010037422180175781 nb_pixel_total : 165 time to create 1 rle with old method : 0.0007336139678955078 length of segment : 24 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.0001571178436279297 length of segment : 9 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.62969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0010962486267089844 length of segment : 21 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0009524822235107422 length of segment : 38 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.00046539306640625 length of segment : 18 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00025844573974609375 length of segment : 8 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00032639503479003906 length of segment : 14 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0008044242858886719 length of segment : 26 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0005571842193603516 length of segment : 17 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0005164146423339844 length of segment : 32 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00044608116149902344 length of segment : 23 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 1297 time to create 1 rle with old method : 0.002502918243408203 length of segment : 41 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.77813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1850 time to create 1 rle with old method : 0.0023963451385498047 length of segment : 128 time for calcul the mask position with numpy : 0.00010228157043457031 nb_pixel_total : 166 time to create 1 rle with old method : 0.0005710124969482422 length of segment : 17 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1170 time to create 1 rle with old method : 0.0020618438720703125 length of segment : 37 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.0002262592315673828 length of segment : 7 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1352 time to create 1 rle with old method : 0.0020215511322021484 length of segment : 44 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 25 time to create 1 rle with old method : 6.794929504394531e-05 length of segment : 6 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0019860267639160156 length of segment : 46 length of segment : 0 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.0010683536529541016 length of segment : 39 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.00066375732421875 length of segment : 20 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1802 time to create 1 rle with old method : 0.0032830238342285156 length of segment : 86 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.0015861988067626953 length of segment : 34 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.0001430511474609375 length of segment : 6 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0011854171752929688 length of segment : 69 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0006406307220458984 length of segment : 24 time for calcul the mask position with numpy : 0.00019788742065429688 nb_pixel_total : 4397 time to create 1 rle with old method : 0.0056455135345458984 length of segment : 199 time for calcul the mask position with numpy : 0.00022220611572265625 nb_pixel_total : 5240 time to create 1 rle with old method : 0.006657600402832031 length of segment : 219 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 181.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 62.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009932518005371094 nb_pixel_total : 106310 time to create 1 rle with old method : 0.14605498313903809 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.51406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00018525123596191406 length of segment : 8 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 2935 time to create 1 rle with old method : 0.0037534236907958984 length of segment : 47 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 975 time to create 1 rle with old method : 0.0015590190887451172 length of segment : 50 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1349 time to create 1 rle with old method : 0.001791238784790039 length of segment : 67 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0006151199340820312 length of segment : 27 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 2698 time to create 1 rle with old method : 0.003626108169555664 length of segment : 86 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 697 time to create 1 rle with old method : 0.0014166831970214844 length of segment : 41 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0028171539306640625 length of segment : 54 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1576 time to create 1 rle with old method : 0.002098560333251953 length of segment : 46 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0006258487701416016 length of segment : 25 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007145404815673828 length of segment : 31 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005824565887451172 length of segment : 23 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006265640258789062 length of segment : 28 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001952648162841797 length of segment : 11 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003609657287597656 length of segment : 21 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004868507385253906 length of segment : 19 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2887 time to create 1 rle with old method : 0.004151821136474609 length of segment : 62 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.0001926422119140625 length of segment : 8 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006196498870849609 length of segment : 32 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004150867462158203 length of segment : 17 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0007603168487548828 length of segment : 29 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006122589111328125 length of segment : 27 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005970001220703125 length of segment : 16 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.0012938976287841797 length of segment : 47 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00016307830810546875 length of segment : 12 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003390312194824219 length of segment : 16 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0007021427154541016 length of segment : 25 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 697 time to create 1 rle with old method : 0.0011589527130126953 length of segment : 44 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00018405914306640625 length of segment : 10 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006616115570068359 length of segment : 33 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0008835792541503906 length of segment : 36 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003612041473388672 length of segment : 16 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00042510032653808594 length of segment : 14 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0008184909820556641 length of segment : 27 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.0009856224060058594 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.85781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003972053527832031 length of segment : 20 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00026106834411621094 length of segment : 9 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 2968 time to create 1 rle with old method : 0.003966331481933594 length of segment : 59 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006709098815917969 length of segment : 36 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.000469207763671875 length of segment : 19 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00015091896057128906 length of segment : 27 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003809928894042969 length of segment : 26 time for calcul the mask position with numpy : 0.00015234947204589844 nb_pixel_total : 7242 time to create 1 rle with old method : 0.00975346565246582 length of segment : 120 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003733634948730469 length of segment : 14 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 7727 time to create 1 rle with old method : 0.010044336318969727 length of segment : 139 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 25 time for calcul the mask position with numpy : 2.6941299438476562e-05 nb_pixel_total : 47 time to create 1 rle with old method : 9.131431579589844e-05 length of segment : 12 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 3256 time to create 1 rle with old method : 0.004176616668701172 length of segment : 70 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0006308555603027344 length of segment : 79 Detection mask done ! Trying to reset tf kernel 2261346 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4111 tf kernel not reseted sub process len(results) : 433 len(list_Values) 433 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 433 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 433 chid ids of type : 4228 Number RLEs to save : 19076 save missing photos in datou_result : time spend for datou_step_exec : 33.84489440917969 time spend to save output : 2.5976479053497314 total time spend for step 1 : 36.44254231452942 step2:brightness Fri Feb 28 01:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740702029_2260602_1339960882_923a94af34ff56fcf983b2f3c05b4dc7.jpg treat image : temp/1740702029_2260602_1339960880_0adac5eac55930c8793b2e815f8d600a.jpg treat image : temp/1740702029_2260602_1339960799_0c3188208052b28be96722452ff9874c.jpg treat image : temp/1740702029_2260602_1339960797_a84e6f98512573fc999185f85d741309.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.01190185546875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.045124053955078125 save missing photos in datou_result : time spend for datou_step_exec : 0.9730801582336426 time spend to save output : 0.06165432929992676 total time spend for step 2 : 1.0347344875335693 step3:blur_detection Fri Feb 28 01:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740702029_2260602_1339960882_923a94af34ff56fcf983b2f3c05b4dc7.jpg resize: (1080, 1920) 1339960882 -7.760405464309785 treat image : temp/1740702029_2260602_1339960880_0adac5eac55930c8793b2e815f8d600a.jpg resize: (1080, 1920) 1339960880 -7.753955803727409 treat image : temp/1740702029_2260602_1339960799_0c3188208052b28be96722452ff9874c.jpg resize: (1080, 1920) 1339960799 -7.760405464309785 treat image : temp/1740702029_2260602_1339960797_a84e6f98512573fc999185f85d741309.jpg resize: (1080, 1920) 1339960797 -7.753955803727409 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.01333475112915039 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.012129068374633789 save missing photos in datou_result : time spend for datou_step_exec : 4.670790195465088 time spend to save output : 0.030268430709838867 total time spend for step 3 : 4.701058626174927 step4:rle_unique_nms_with_priority Fri Feb 28 01:21:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 433 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 116 nb_hashtags : 7 time to prepare the origin masks : 1.1236951351165771 time for calcul the mask position with numpy : 0.2857532501220703 nb_pixel_total : 1855333 time to create 1 rle with new method : 0.09822487831115723 time for calcul the mask position with numpy : 0.008358478546142578 nb_pixel_total : 2726 time to create 1 rle with old method : 0.0032279491424560547 time for calcul the mask position with numpy : 0.008319377899169922 nb_pixel_total : 1143 time to create 1 rle with old method : 0.0013284683227539062 time for calcul the mask position with numpy : 0.008362054824829102 nb_pixel_total : 105 time to create 1 rle with old method : 0.00017690658569335938 time for calcul the mask position with numpy : 0.008037090301513672 nb_pixel_total : 862 time to create 1 rle with old method : 0.0009887218475341797 time for calcul the mask position with numpy : 0.008234977722167969 nb_pixel_total : 38 time to create 1 rle with old method : 5.6743621826171875e-05 time for calcul the mask position with numpy : 0.008356809616088867 nb_pixel_total : 913 time to create 1 rle with old method : 0.0012104511260986328 time for calcul the mask position with numpy : 0.008326530456542969 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008044242858886719 time for calcul the mask position with numpy : 0.008405208587646484 nb_pixel_total : 4295 time to create 1 rle with old method : 0.005102634429931641 time for calcul the mask position with numpy : 0.008281230926513672 nb_pixel_total : 39 time to create 1 rle with old method : 9.274482727050781e-05 time for calcul the mask position with numpy : 0.008195638656616211 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004839897155761719 time for calcul the mask position with numpy : 0.008842945098876953 nb_pixel_total : 2458 time to create 1 rle with old method : 0.0028307437896728516 time for calcul the mask position with numpy : 0.008269548416137695 nb_pixel_total : 979 time to create 1 rle with old method : 0.0012166500091552734 time for calcul the mask position with numpy : 0.008211851119995117 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005805492401123047 time for calcul the mask position with numpy : 0.008341789245605469 nb_pixel_total : 18 time to create 1 rle with old method : 0.0001068115234375 time for calcul the mask position with numpy : 0.00859832763671875 nb_pixel_total : 1793 time to create 1 rle with old method : 0.002753734588623047 time for calcul the mask position with numpy : 0.008340835571289062 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006148815155029297 time for calcul the mask position with numpy : 0.00818181037902832 nb_pixel_total : 3509 time to create 1 rle with old method : 0.003966093063354492 time for calcul the mask position with numpy : 0.008221149444580078 nb_pixel_total : 1369 time to create 1 rle with old method : 0.0016062259674072266 time for calcul the mask position with numpy : 0.008247613906860352 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006046295166015625 time for calcul the mask position with numpy : 0.008341073989868164 nb_pixel_total : 752 time to create 1 rle with old method : 0.0009567737579345703 time for calcul the mask position with numpy : 0.008170843124389648 nb_pixel_total : 763 time to create 1 rle with old method : 0.0009205341339111328 time for calcul the mask position with numpy : 0.00831460952758789 nb_pixel_total : 183 time to create 1 rle with old method : 0.00021219253540039062 time for calcul the mask position with numpy : 0.008213996887207031 nb_pixel_total : 27 time to create 1 rle with old method : 4.315376281738281e-05 time for calcul the mask position with numpy : 0.008140087127685547 nb_pixel_total : 693 time to create 1 rle with old method : 0.0008146762847900391 time for calcul the mask position with numpy : 0.008842945098876953 nb_pixel_total : 1152 time to create 1 rle with old method : 0.0013470649719238281 time for calcul the mask position with numpy : 0.008352041244506836 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003173351287841797 time for calcul the mask position with numpy : 0.00843048095703125 nb_pixel_total : 344 time to create 1 rle with old method : 0.00040912628173828125 time for calcul the mask position with numpy : 0.008389949798583984 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003948211669921875 time for calcul the mask position with numpy : 0.008363008499145508 nb_pixel_total : 655 time to create 1 rle with old method : 0.0008244514465332031 time for calcul the mask position with numpy : 0.008302688598632812 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0013947486877441406 time for calcul the mask position with numpy : 0.008489131927490234 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005309581756591797 time for calcul the mask position with numpy : 0.008435249328613281 nb_pixel_total : 4273 time to create 1 rle with old method : 0.0051538944244384766 time for calcul the mask position with numpy : 0.008678436279296875 nb_pixel_total : 2001 time to create 1 rle with old method : 0.003466367721557617 time for calcul the mask position with numpy : 0.009653091430664062 nb_pixel_total : 220 time to create 1 rle with old method : 0.0004143714904785156 time for calcul the mask position with numpy : 0.009640932083129883 nb_pixel_total : 1037 time to create 1 rle with old method : 0.0017881393432617188 time for calcul the mask position with numpy : 0.009655952453613281 nb_pixel_total : 348 time to create 1 rle with old method : 0.0006022453308105469 time for calcul the mask position with numpy : 0.009733438491821289 nb_pixel_total : 22 time to create 1 rle with old method : 5.626678466796875e-05 time for calcul the mask position with numpy : 0.009725570678710938 nb_pixel_total : 79 time to create 1 rle with old method : 0.00015854835510253906 time for calcul the mask position with numpy : 0.009666204452514648 nb_pixel_total : 84 time to create 1 rle with old method : 0.00022530555725097656 time for calcul the mask position with numpy : 0.009679079055786133 nb_pixel_total : 1218 time to create 1 rle with old method : 0.002104520797729492 time for calcul the mask position with numpy : 0.008969545364379883 nb_pixel_total : 1726 time to create 1 rle with old method : 0.002056121826171875 time for calcul the mask position with numpy : 0.00869894027709961 nb_pixel_total : 75 time to create 1 rle with old method : 0.0001266002655029297 time for calcul the mask position with numpy : 0.00854349136352539 nb_pixel_total : 204 time to create 1 rle with old method : 0.00031113624572753906 time for calcul the mask position with numpy : 0.008378744125366211 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001914501190185547 time for calcul the mask position with numpy : 0.008231401443481445 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005791187286376953 time for calcul the mask position with numpy : 0.008552789688110352 nb_pixel_total : 309 time to create 1 rle with old method : 0.0003509521484375 time for calcul the mask position with numpy : 0.008438825607299805 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002868175506591797 time for calcul the mask position with numpy : 0.008296728134155273 nb_pixel_total : 140 time to create 1 rle with old method : 0.00018739700317382812 time for calcul the mask position with numpy : 0.008180618286132812 nb_pixel_total : 214 time to create 1 rle with old method : 0.00030112266540527344 time for calcul the mask position with numpy : 0.008208990097045898 nb_pixel_total : 163 time to create 1 rle with old method : 0.00021910667419433594 time for calcul the mask position with numpy : 0.008794546127319336 nb_pixel_total : 106032 time to create 1 rle with old method : 0.1253645420074463 time for calcul the mask position with numpy : 0.008850812911987305 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006353855133056641 time for calcul the mask position with numpy : 0.008646249771118164 nb_pixel_total : 186 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.008634805679321289 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003113746643066406 time for calcul the mask position with numpy : 0.008840560913085938 nb_pixel_total : 34568 time to create 1 rle with old method : 0.0399625301361084 time for calcul the mask position with numpy : 0.008749723434448242 nb_pixel_total : 182 time to create 1 rle with old method : 0.00028324127197265625 time for calcul the mask position with numpy : 0.008521318435668945 nb_pixel_total : 1429 time to create 1 rle with old method : 0.001779317855834961 time for calcul the mask position with numpy : 0.008464813232421875 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001347064971923828 time for calcul the mask position with numpy : 0.008417844772338867 nb_pixel_total : 1226 time to create 1 rle with old method : 0.0014328956604003906 time for calcul the mask position with numpy : 0.008341312408447266 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004096031188964844 time for calcul the mask position with numpy : 0.008364439010620117 nb_pixel_total : 42 time to create 1 rle with old method : 8.726119995117188e-05 time for calcul the mask position with numpy : 0.008510828018188477 nb_pixel_total : 288 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.00999903678894043 nb_pixel_total : 11 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.008259773254394531 nb_pixel_total : 190 time to create 1 rle with old method : 0.00025725364685058594 time for calcul the mask position with numpy : 0.008455514907836914 nb_pixel_total : 143 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.008514165878295898 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004906654357910156 time for calcul the mask position with numpy : 0.008684396743774414 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005819797515869141 time for calcul the mask position with numpy : 0.0084381103515625 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005853176116943359 time for calcul the mask position with numpy : 0.008539438247680664 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005998611450195312 time for calcul the mask position with numpy : 0.008507966995239258 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003314018249511719 time for calcul the mask position with numpy : 0.008397102355957031 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004956722259521484 time for calcul the mask position with numpy : 0.00848841667175293 nb_pixel_total : 5 time to create 1 rle with old method : 2.6941299438476562e-05 time for calcul the mask position with numpy : 0.008532524108886719 nb_pixel_total : 962 time to create 1 rle with old method : 0.0012183189392089844 time for calcul the mask position with numpy : 0.008469820022583008 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.00846409797668457 nb_pixel_total : 1105 time to create 1 rle with old method : 0.0013327598571777344 time for calcul the mask position with numpy : 0.008463382720947266 nb_pixel_total : 44 time to create 1 rle with old method : 6.914138793945312e-05 time for calcul the mask position with numpy : 0.008435487747192383 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006375312805175781 time for calcul the mask position with numpy : 0.00838613510131836 nb_pixel_total : 95 time to create 1 rle with old method : 0.00013399124145507812 time for calcul the mask position with numpy : 0.008400678634643555 nb_pixel_total : 465 time to create 1 rle with old method : 0.0005645751953125 time for calcul the mask position with numpy : 0.009737968444824219 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006284713745117188 time for calcul the mask position with numpy : 0.008455753326416016 nb_pixel_total : 92 time to create 1 rle with old method : 0.00012493133544921875 time for calcul the mask position with numpy : 0.008430242538452148 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001361370086669922 time for calcul the mask position with numpy : 0.008384943008422852 nb_pixel_total : 296 time to create 1 rle with old method : 0.00037550926208496094 time for calcul the mask position with numpy : 0.008443593978881836 nb_pixel_total : 202 time to create 1 rle with old method : 0.00025534629821777344 time for calcul the mask position with numpy : 0.0085296630859375 nb_pixel_total : 48 time to create 1 rle with old method : 0.00013208389282226562 time for calcul the mask position with numpy : 0.008557796478271484 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.008690834045410156 nb_pixel_total : 3515 time to create 1 rle with old method : 0.004572868347167969 time for calcul the mask position with numpy : 0.008542060852050781 nb_pixel_total : 2148 time to create 1 rle with old method : 0.0026803016662597656 time for calcul the mask position with numpy : 0.008474111557006836 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004534721374511719 time for calcul the mask position with numpy : 0.008472681045532227 nb_pixel_total : 293 time to create 1 rle with old method : 0.0003726482391357422 time for calcul the mask position with numpy : 0.008583307266235352 nb_pixel_total : 12 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.00844717025756836 nb_pixel_total : 249 time to create 1 rle with old method : 0.00032782554626464844 time for calcul the mask position with numpy : 0.008454561233520508 nb_pixel_total : 162 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.008449316024780273 nb_pixel_total : 61 time to create 1 rle with old method : 9.679794311523438e-05 time for calcul the mask position with numpy : 0.008424997329711914 nb_pixel_total : 18 time to create 1 rle with old method : 5.53131103515625e-05 time for calcul the mask position with numpy : 0.009507179260253906 nb_pixel_total : 542 time to create 1 rle with old method : 0.0009632110595703125 time for calcul the mask position with numpy : 0.009002923965454102 nb_pixel_total : 55 time to create 1 rle with old method : 0.0001571178436279297 time for calcul the mask position with numpy : 0.008846044540405273 nb_pixel_total : 197 time to create 1 rle with old method : 0.00027108192443847656 time for calcul the mask position with numpy : 0.009198665618896484 nb_pixel_total : 165 time to create 1 rle with old method : 0.00022101402282714844 time for calcul the mask position with numpy : 0.010489940643310547 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006368160247802734 time for calcul the mask position with numpy : 0.00854349136352539 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0016620159149169922 time for calcul the mask position with numpy : 0.008733749389648438 nb_pixel_total : 2829 time to create 1 rle with old method : 0.003452301025390625 time for calcul the mask position with numpy : 0.008467912673950195 nb_pixel_total : 20 time to create 1 rle with old method : 4.0531158447265625e-05 time for calcul the mask position with numpy : 0.008491754531860352 nb_pixel_total : 8053 time to create 1 rle with old method : 0.009590625762939453 time for calcul the mask position with numpy : 0.008458137512207031 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003712177276611328 time for calcul the mask position with numpy : 0.008387088775634766 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006983280181884766 time for calcul the mask position with numpy : 0.008584022521972656 nb_pixel_total : 110 time to create 1 rle with old method : 0.00016355514526367188 time for calcul the mask position with numpy : 0.008877754211425781 nb_pixel_total : 158 time to create 1 rle with old method : 0.00034689903259277344 time for calcul the mask position with numpy : 0.008604764938354492 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003559589385986328 time for calcul the mask position with numpy : 0.00855255126953125 nb_pixel_total : 96 time to create 1 rle with old method : 0.00013899803161621094 time for calcul the mask position with numpy : 0.008642435073852539 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002906322479248047 time for calcul the mask position with numpy : 0.008570194244384766 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003299713134765625 time for calcul the mask position with numpy : 0.008716583251953125 nb_pixel_total : 93 time to create 1 rle with old method : 0.00019788742065429688 time for calcul the mask position with numpy : 0.008450031280517578 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003311634063720703 time for calcul the mask position with numpy : 0.00895833969116211 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004820823669433594 time for calcul the mask position with numpy : 0.008664369583129883 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002956390380859375 create new chi : 1.6616787910461426 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.010914087295532227 batch 1 Loaded 117 chid ids of type : 4230 Number RLEs to save : 9558 TO DO : save crop sub photo not yet done ! save time : 1.2091803550720215 nb_obj : 101 nb_hashtags : 7 time to prepare the origin masks : 2.460082530975342 time for calcul the mask position with numpy : 0.04438376426696777 nb_pixel_total : 1831799 time to create 1 rle with new method : 0.07822203636169434 time for calcul the mask position with numpy : 0.007801532745361328 nb_pixel_total : 542 time to create 1 rle with old method : 0.0009176731109619141 time for calcul the mask position with numpy : 0.007986783981323242 nb_pixel_total : 23 time to create 1 rle with old method : 5.6743621826171875e-05 time for calcul the mask position with numpy : 0.008285999298095703 nb_pixel_total : 873 time to create 1 rle with old method : 0.0012989044189453125 time for calcul the mask position with numpy : 0.008492231369018555 nb_pixel_total : 1729 time to create 1 rle with old method : 0.0024695396423339844 time for calcul the mask position with numpy : 0.008272409439086914 nb_pixel_total : 26 time to create 1 rle with old method : 0.00013017654418945312 time for calcul the mask position with numpy : 0.008371114730834961 nb_pixel_total : 2450 time to create 1 rle with old method : 0.0034809112548828125 time for calcul the mask position with numpy : 0.00844264030456543 nb_pixel_total : 37 time to create 1 rle with old method : 7.557868957519531e-05 time for calcul the mask position with numpy : 0.008525609970092773 nb_pixel_total : 739 time to create 1 rle with old method : 0.0011472702026367188 time for calcul the mask position with numpy : 0.008880853652954102 nb_pixel_total : 49846 time to create 1 rle with old method : 0.07247209548950195 time for calcul the mask position with numpy : 0.007610797882080078 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0014967918395996094 time for calcul the mask position with numpy : 0.00791025161743164 nb_pixel_total : 472 time to create 1 rle with old method : 0.000743865966796875 time for calcul the mask position with numpy : 0.007679462432861328 nb_pixel_total : 1690 time to create 1 rle with old method : 0.002470731735229492 time for calcul the mask position with numpy : 0.007881402969360352 nb_pixel_total : 412 time to create 1 rle with old method : 0.0006568431854248047 time for calcul the mask position with numpy : 0.008110523223876953 nb_pixel_total : 789 time to create 1 rle with old method : 0.0012459754943847656 time for calcul the mask position with numpy : 0.013287544250488281 nb_pixel_total : 4917 time to create 1 rle with old method : 0.00685882568359375 time for calcul the mask position with numpy : 0.012360811233520508 nb_pixel_total : 603 time to create 1 rle with old method : 0.0010607242584228516 time for calcul the mask position with numpy : 0.01421499252319336 nb_pixel_total : 1434 time to create 1 rle with old method : 0.00301361083984375 time for calcul the mask position with numpy : 0.01170492172241211 nb_pixel_total : 468 time to create 1 rle with old method : 0.0009844303131103516 time for calcul the mask position with numpy : 0.014014005661010742 nb_pixel_total : 1300 time to create 1 rle with old method : 0.002595663070678711 time for calcul the mask position with numpy : 0.013096332550048828 nb_pixel_total : 825 time to create 1 rle with old method : 0.001725912094116211 time for calcul the mask position with numpy : 0.016083240509033203 nb_pixel_total : 165 time to create 1 rle with old method : 0.00030684471130371094 time for calcul the mask position with numpy : 0.013039827346801758 nb_pixel_total : 644 time to create 1 rle with old method : 0.0010256767272949219 time for calcul the mask position with numpy : 0.0132904052734375 nb_pixel_total : 64 time to create 1 rle with old method : 9.918212890625e-05 time for calcul the mask position with numpy : 0.008619070053100586 nb_pixel_total : 1170 time to create 1 rle with old method : 0.0019371509552001953 time for calcul the mask position with numpy : 0.009014129638671875 nb_pixel_total : 278 time to create 1 rle with old method : 0.0005545616149902344 time for calcul the mask position with numpy : 0.009186744689941406 nb_pixel_total : 7902 time to create 1 rle with old method : 0.013294219970703125 time for calcul the mask position with numpy : 0.009601831436157227 nb_pixel_total : 166 time to create 1 rle with old method : 0.00030350685119628906 time for calcul the mask position with numpy : 0.008921623229980469 nb_pixel_total : 835 time to create 1 rle with old method : 0.0012888908386230469 time for calcul the mask position with numpy : 0.00896453857421875 nb_pixel_total : 317 time to create 1 rle with old method : 0.0005602836608886719 time for calcul the mask position with numpy : 0.015198945999145508 nb_pixel_total : 899 time to create 1 rle with old method : 0.0017294883728027344 time for calcul the mask position with numpy : 0.014401674270629883 nb_pixel_total : 4391 time to create 1 rle with old method : 0.007488250732421875 time for calcul the mask position with numpy : 0.012404680252075195 nb_pixel_total : 484 time to create 1 rle with old method : 0.0008797645568847656 time for calcul the mask position with numpy : 0.011739492416381836 nb_pixel_total : 851 time to create 1 rle with old method : 0.0014078617095947266 time for calcul the mask position with numpy : 0.009770631790161133 nb_pixel_total : 1850 time to create 1 rle with old method : 0.002832174301147461 time for calcul the mask position with numpy : 0.008847236633300781 nb_pixel_total : 378 time to create 1 rle with old method : 0.000598907470703125 time for calcul the mask position with numpy : 0.008039474487304688 nb_pixel_total : 586 time to create 1 rle with old method : 0.0009038448333740234 time for calcul the mask position with numpy : 0.007914543151855469 nb_pixel_total : 25 time to create 1 rle with old method : 5.555152893066406e-05 time for calcul the mask position with numpy : 0.007701396942138672 nb_pixel_total : 66 time to create 1 rle with old method : 0.00011301040649414062 time for calcul the mask position with numpy : 0.008639812469482422 nb_pixel_total : 2759 time to create 1 rle with old method : 0.004424571990966797 time for calcul the mask position with numpy : 0.008520126342773438 nb_pixel_total : 94 time to create 1 rle with old method : 0.0002849102020263672 time for calcul the mask position with numpy : 0.008409500122070312 nb_pixel_total : 1351 time to create 1 rle with old method : 0.002001523971557617 time for calcul the mask position with numpy : 0.007941246032714844 nb_pixel_total : 1802 time to create 1 rle with old method : 0.0027265548706054688 time for calcul the mask position with numpy : 0.007998943328857422 nb_pixel_total : 196 time to create 1 rle with old method : 0.00031828880310058594 time for calcul the mask position with numpy : 0.008596181869506836 nb_pixel_total : 82 time to create 1 rle with old method : 0.00016164779663085938 time for calcul the mask position with numpy : 0.008273601531982422 nb_pixel_total : 131 time to create 1 rle with old method : 0.0002143383026123047 time for calcul the mask position with numpy : 0.007904529571533203 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004305839538574219 time for calcul the mask position with numpy : 0.008067846298217773 nb_pixel_total : 278 time to create 1 rle with old method : 0.00043129920959472656 time for calcul the mask position with numpy : 0.008387327194213867 nb_pixel_total : 138 time to create 1 rle with old method : 0.00024127960205078125 time for calcul the mask position with numpy : 0.008874893188476562 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003592967987060547 time for calcul the mask position with numpy : 0.00833439826965332 nb_pixel_total : 162 time to create 1 rle with old method : 0.00025200843811035156 time for calcul the mask position with numpy : 0.009118080139160156 nb_pixel_total : 106318 time to create 1 rle with old method : 0.13144278526306152 time for calcul the mask position with numpy : 0.0068171024322509766 nb_pixel_total : 366 time to create 1 rle with old method : 0.000492095947265625 time for calcul the mask position with numpy : 0.00693058967590332 nb_pixel_total : 269 time to create 1 rle with old method : 0.000385284423828125 time for calcul the mask position with numpy : 0.007373332977294922 nb_pixel_total : 1576 time to create 1 rle with old method : 0.0019421577453613281 time for calcul the mask position with numpy : 0.0074901580810546875 nb_pixel_total : 95 time to create 1 rle with old method : 0.00014352798461914062 time for calcul the mask position with numpy : 0.010181665420532227 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006623268127441406 time for calcul the mask position with numpy : 0.0079345703125 nb_pixel_total : 1281 time to create 1 rle with old method : 0.001577615737915039 time for calcul the mask position with numpy : 0.008788824081420898 nb_pixel_total : 22 time to create 1 rle with old method : 9.489059448242188e-05 time for calcul the mask position with numpy : 0.0075054168701171875 nb_pixel_total : 216 time to create 1 rle with old method : 0.000286102294921875 time for calcul the mask position with numpy : 0.006942272186279297 nb_pixel_total : 7 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.0068738460540771484 nb_pixel_total : 405 time to create 1 rle with old method : 0.00049591064453125 time for calcul the mask position with numpy : 0.006968975067138672 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005342960357666016 time for calcul the mask position with numpy : 0.0068073272705078125 nb_pixel_total : 699 time to create 1 rle with old method : 0.0008463859558105469 time for calcul the mask position with numpy : 0.006885528564453125 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005173683166503906 time for calcul the mask position with numpy : 0.006934642791748047 nb_pixel_total : 198 time to create 1 rle with old method : 0.00031304359436035156 time for calcul the mask position with numpy : 0.007719993591308594 nb_pixel_total : 768 time to create 1 rle with old method : 0.0012097358703613281 time for calcul the mask position with numpy : 0.00750732421875 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005979537963867188 time for calcul the mask position with numpy : 0.007778644561767578 nb_pixel_total : 2936 time to create 1 rle with old method : 0.004108905792236328 time for calcul the mask position with numpy : 0.008660078048706055 nb_pixel_total : 159 time to create 1 rle with old method : 0.00026035308837890625 time for calcul the mask position with numpy : 0.007563352584838867 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005533695220947266 time for calcul the mask position with numpy : 0.007998466491699219 nb_pixel_total : 493 time to create 1 rle with old method : 0.0007343292236328125 time for calcul the mask position with numpy : 0.009470701217651367 nb_pixel_total : 468 time to create 1 rle with old method : 0.000675201416015625 time for calcul the mask position with numpy : 0.007830142974853516 nb_pixel_total : 107 time to create 1 rle with old method : 0.00018334388732910156 time for calcul the mask position with numpy : 0.008533477783203125 nb_pixel_total : 53 time to create 1 rle with old method : 0.00016617774963378906 time for calcul the mask position with numpy : 0.008143901824951172 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003578662872314453 time for calcul the mask position with numpy : 0.007569074630737305 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004744529724121094 time for calcul the mask position with numpy : 0.007036685943603516 nb_pixel_total : 284 time to create 1 rle with old method : 0.0005247592926025391 time for calcul the mask position with numpy : 0.007238864898681641 nb_pixel_total : 2698 time to create 1 rle with old method : 0.003669261932373047 time for calcul the mask position with numpy : 0.008925676345825195 nb_pixel_total : 2920 time to create 1 rle with old method : 0.004131317138671875 time for calcul the mask position with numpy : 0.008269548416137695 nb_pixel_total : 47 time to create 1 rle with old method : 0.00010728836059570312 time for calcul the mask position with numpy : 0.00804448127746582 nb_pixel_total : 48 time to create 1 rle with old method : 0.0001385211944580078 time for calcul the mask position with numpy : 0.008179903030395508 nb_pixel_total : 576 time to create 1 rle with old method : 0.0009005069732666016 time for calcul the mask position with numpy : 0.00806879997253418 nb_pixel_total : 265 time to create 1 rle with old method : 0.0004341602325439453 time for calcul the mask position with numpy : 0.007408857345581055 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003311634063720703 time for calcul the mask position with numpy : 0.007693052291870117 nb_pixel_total : 488 time to create 1 rle with old method : 0.0008039474487304688 time for calcul the mask position with numpy : 0.007955551147460938 nb_pixel_total : 1349 time to create 1 rle with old method : 0.0020487308502197266 time for calcul the mask position with numpy : 0.008771657943725586 nb_pixel_total : 2888 time to create 1 rle with old method : 0.004145383834838867 time for calcul the mask position with numpy : 0.0077173709869384766 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001742839813232422 time for calcul the mask position with numpy : 0.007955074310302734 nb_pixel_total : 666 time to create 1 rle with old method : 0.0010924339294433594 time for calcul the mask position with numpy : 0.008359432220458984 nb_pixel_total : 7234 time to create 1 rle with old method : 0.011027097702026367 time for calcul the mask position with numpy : 0.007894277572631836 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005123615264892578 time for calcul the mask position with numpy : 0.007702827453613281 nb_pixel_total : 545 time to create 1 rle with old method : 0.0008347034454345703 time for calcul the mask position with numpy : 0.0074579715728759766 nb_pixel_total : 90 time to create 1 rle with old method : 0.00016927719116210938 time for calcul the mask position with numpy : 0.007432699203491211 nb_pixel_total : 975 time to create 1 rle with old method : 0.0015044212341308594 time for calcul the mask position with numpy : 0.007519721984863281 nb_pixel_total : 607 time to create 1 rle with old method : 0.0008318424224853516 time for calcul the mask position with numpy : 0.007400989532470703 nb_pixel_total : 116 time to create 1 rle with old method : 0.00017261505126953125 time for calcul the mask position with numpy : 0.007616996765136719 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003809928894042969 time for calcul the mask position with numpy : 0.007678508758544922 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003581047058105469 time for calcul the mask position with numpy : 0.007666349411010742 nb_pixel_total : 274 time to create 1 rle with old method : 0.0004477500915527344 time for calcul the mask position with numpy : 0.008007287979125977 nb_pixel_total : 405 time to create 1 rle with old method : 0.0006086826324462891 time for calcul the mask position with numpy : 0.0075109004974365234 nb_pixel_total : 152 time to create 1 rle with old method : 0.000232696533203125 create new chi : 1.3471972942352295 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0017044544219970703 batch 1 Loaded 102 chid ids of type : 4230 Number RLEs to save : 9142 TO DO : save crop sub photo not yet done ! save time : 0.6241059303283691 nb_obj : 112 nb_hashtags : 7 time to prepare the origin masks : 1.4925825595855713 time for calcul the mask position with numpy : 0.39482927322387695 nb_pixel_total : 1856715 time to create 1 rle with new method : 0.18694519996643066 time for calcul the mask position with numpy : 0.007256269454956055 nb_pixel_total : 1174 time to create 1 rle with old method : 0.0017757415771484375 time for calcul the mask position with numpy : 0.01151275634765625 nb_pixel_total : 106 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.006937980651855469 nb_pixel_total : 862 time to create 1 rle with old method : 0.001211404800415039 time for calcul the mask position with numpy : 0.006806135177612305 nb_pixel_total : 38 time to create 1 rle with old method : 6.914138793945312e-05 time for calcul the mask position with numpy : 0.006371736526489258 nb_pixel_total : 913 time to create 1 rle with old method : 0.0011909008026123047 time for calcul the mask position with numpy : 0.006378650665283203 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008273124694824219 time for calcul the mask position with numpy : 0.006513833999633789 nb_pixel_total : 4310 time to create 1 rle with old method : 0.0052700042724609375 time for calcul the mask position with numpy : 0.006247282028198242 nb_pixel_total : 39 time to create 1 rle with old method : 0.00010371208190917969 time for calcul the mask position with numpy : 0.006350517272949219 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004794597625732422 time for calcul the mask position with numpy : 0.006330251693725586 nb_pixel_total : 2459 time to create 1 rle with old method : 0.0030603408813476562 time for calcul the mask position with numpy : 0.00658416748046875 nb_pixel_total : 953 time to create 1 rle with old method : 0.0012197494506835938 time for calcul the mask position with numpy : 0.006491184234619141 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006070137023925781 time for calcul the mask position with numpy : 0.00787663459777832 nb_pixel_total : 1839 time to create 1 rle with old method : 0.0028429031372070312 time for calcul the mask position with numpy : 0.006525993347167969 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006363391876220703 time for calcul the mask position with numpy : 0.006229400634765625 nb_pixel_total : 5073 time to create 1 rle with old method : 0.0067636966705322266 time for calcul the mask position with numpy : 0.0075969696044921875 nb_pixel_total : 1506 time to create 1 rle with old method : 0.001909494400024414 time for calcul the mask position with numpy : 0.006474971771240234 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006647109985351562 time for calcul the mask position with numpy : 0.00630497932434082 nb_pixel_total : 752 time to create 1 rle with old method : 0.0009868144989013672 time for calcul the mask position with numpy : 0.006368875503540039 nb_pixel_total : 763 time to create 1 rle with old method : 0.0009381771087646484 time for calcul the mask position with numpy : 0.006365776062011719 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002167224884033203 time for calcul the mask position with numpy : 0.006662845611572266 nb_pixel_total : 27 time to create 1 rle with old method : 6.151199340820312e-05 time for calcul the mask position with numpy : 0.0062410831451416016 nb_pixel_total : 704 time to create 1 rle with old method : 0.0008831024169921875 time for calcul the mask position with numpy : 0.0064046382904052734 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0013828277587890625 time for calcul the mask position with numpy : 0.006613016128540039 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003333091735839844 time for calcul the mask position with numpy : 0.006189584732055664 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004074573516845703 time for calcul the mask position with numpy : 0.006658792495727539 nb_pixel_total : 655 time to create 1 rle with old method : 0.0008265972137451172 time for calcul the mask position with numpy : 0.006444215774536133 nb_pixel_total : 811 time to create 1 rle with old method : 0.0010211467742919922 time for calcul the mask position with numpy : 0.006335735321044922 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008184909820556641 time for calcul the mask position with numpy : 0.006290435791015625 nb_pixel_total : 4312 time to create 1 rle with old method : 0.005084037780761719 time for calcul the mask position with numpy : 0.006618976593017578 nb_pixel_total : 2006 time to create 1 rle with old method : 0.0025587081909179688 time for calcul the mask position with numpy : 0.00677800178527832 nb_pixel_total : 221 time to create 1 rle with old method : 0.00030922889709472656 time for calcul the mask position with numpy : 0.006403207778930664 nb_pixel_total : 1037 time to create 1 rle with old method : 0.0012860298156738281 time for calcul the mask position with numpy : 0.006527900695800781 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004448890686035156 time for calcul the mask position with numpy : 0.00639653205871582 nb_pixel_total : 22 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.006389617919921875 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001690387725830078 time for calcul the mask position with numpy : 0.006560564041137695 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0014567375183105469 time for calcul the mask position with numpy : 0.006459951400756836 nb_pixel_total : 1729 time to create 1 rle with old method : 0.002032756805419922 time for calcul the mask position with numpy : 0.006338357925415039 nb_pixel_total : 75 time to create 1 rle with old method : 0.00010585784912109375 time for calcul the mask position with numpy : 0.006624937057495117 nb_pixel_total : 204 time to create 1 rle with old method : 0.0004086494445800781 time for calcul the mask position with numpy : 0.006659030914306641 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001983642578125 time for calcul the mask position with numpy : 0.006273508071899414 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005848407745361328 time for calcul the mask position with numpy : 0.006924629211425781 nb_pixel_total : 309 time to create 1 rle with old method : 0.0003838539123535156 time for calcul the mask position with numpy : 0.006955623626708984 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003006458282470703 time for calcul the mask position with numpy : 0.006575584411621094 nb_pixel_total : 101 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.007569551467895508 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003685951232910156 time for calcul the mask position with numpy : 0.007058143615722656 nb_pixel_total : 164 time to create 1 rle with old method : 0.00029921531677246094 time for calcul the mask position with numpy : 0.007433891296386719 nb_pixel_total : 106031 time to create 1 rle with old method : 0.15232348442077637 time for calcul the mask position with numpy : 0.006253242492675781 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006167888641357422 time for calcul the mask position with numpy : 0.006064414978027344 nb_pixel_total : 186 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.006209850311279297 nb_pixel_total : 245 time to create 1 rle with old method : 0.00030159950256347656 time for calcul the mask position with numpy : 0.006318330764770508 nb_pixel_total : 34543 time to create 1 rle with old method : 0.04023027420043945 time for calcul the mask position with numpy : 0.006364107131958008 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002415180206298828 time for calcul the mask position with numpy : 0.006163597106933594 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0017671585083007812 time for calcul the mask position with numpy : 0.009801387786865234 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001456737518310547 time for calcul the mask position with numpy : 0.010137081146240234 nb_pixel_total : 1226 time to create 1 rle with old method : 0.0014710426330566406 time for calcul the mask position with numpy : 0.010077238082885742 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004010200500488281 time for calcul the mask position with numpy : 0.009972095489501953 nb_pixel_total : 42 time to create 1 rle with old method : 8.678436279296875e-05 time for calcul the mask position with numpy : 0.009988546371459961 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003516674041748047 time for calcul the mask position with numpy : 0.00999140739440918 nb_pixel_total : 11 time to create 1 rle with old method : 6.437301635742188e-05 time for calcul the mask position with numpy : 0.010120153427124023 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002505779266357422 time for calcul the mask position with numpy : 0.010015487670898438 nb_pixel_total : 144 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.010042905807495117 nb_pixel_total : 380 time to create 1 rle with old method : 0.00048160552978515625 time for calcul the mask position with numpy : 0.01050114631652832 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005936622619628906 time for calcul the mask position with numpy : 0.010269880294799805 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006155967712402344 time for calcul the mask position with numpy : 0.009982585906982422 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005044937133789062 time for calcul the mask position with numpy : 0.007189273834228516 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003120899200439453 time for calcul the mask position with numpy : 0.006475210189819336 nb_pixel_total : 260 time to create 1 rle with old method : 0.00039458274841308594 time for calcul the mask position with numpy : 0.006204843521118164 nb_pixel_total : 5 time to create 1 rle with old method : 2.6941299438476562e-05 time for calcul the mask position with numpy : 0.006384372711181641 nb_pixel_total : 949 time to create 1 rle with old method : 0.0011065006256103516 time for calcul the mask position with numpy : 0.006152153015136719 nb_pixel_total : 180 time to create 1 rle with old method : 0.00022912025451660156 time for calcul the mask position with numpy : 0.006464242935180664 nb_pixel_total : 1123 time to create 1 rle with old method : 0.001413106918334961 time for calcul the mask position with numpy : 0.00619196891784668 nb_pixel_total : 43 time to create 1 rle with old method : 7.009506225585938e-05 time for calcul the mask position with numpy : 0.006494760513305664 nb_pixel_total : 519 time to create 1 rle with old method : 0.0007064342498779297 time for calcul the mask position with numpy : 0.0064432621002197266 nb_pixel_total : 96 time to create 1 rle with old method : 0.00014090538024902344 time for calcul the mask position with numpy : 0.006543159484863281 nb_pixel_total : 465 time to create 1 rle with old method : 0.0005810260772705078 time for calcul the mask position with numpy : 0.006325960159301758 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005853176116943359 time for calcul the mask position with numpy : 0.006420612335205078 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001404285430908203 time for calcul the mask position with numpy : 0.00661158561706543 nb_pixel_total : 87 time to create 1 rle with old method : 0.00017023086547851562 time for calcul the mask position with numpy : 0.00686192512512207 nb_pixel_total : 296 time to create 1 rle with old method : 0.0005474090576171875 time for calcul the mask position with numpy : 0.006808280944824219 nb_pixel_total : 202 time to create 1 rle with old method : 0.000362396240234375 time for calcul the mask position with numpy : 0.006708621978759766 nb_pixel_total : 48 time to create 1 rle with old method : 0.00018215179443359375 time for calcul the mask position with numpy : 0.006802082061767578 nb_pixel_total : 278 time to create 1 rle with old method : 0.00048613548278808594 time for calcul the mask position with numpy : 0.006783008575439453 nb_pixel_total : 3514 time to create 1 rle with old method : 0.00592041015625 time for calcul the mask position with numpy : 0.006775617599487305 nb_pixel_total : 2146 time to create 1 rle with old method : 0.0036208629608154297 time for calcul the mask position with numpy : 0.006762504577636719 nb_pixel_total : 365 time to create 1 rle with old method : 0.0006375312805175781 time for calcul the mask position with numpy : 0.006872892379760742 nb_pixel_total : 17 time to create 1 rle with old method : 6.890296936035156e-05 time for calcul the mask position with numpy : 0.0067865848541259766 nb_pixel_total : 292 time to create 1 rle with old method : 0.0005071163177490234 time for calcul the mask position with numpy : 0.006847858428955078 nb_pixel_total : 249 time to create 1 rle with old method : 0.0004017353057861328 time for calcul the mask position with numpy : 0.006274223327636719 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002930164337158203 time for calcul the mask position with numpy : 0.006234169006347656 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002231597900390625 time for calcul the mask position with numpy : 0.0060689449310302734 nb_pixel_total : 18 time to create 1 rle with old method : 6.532669067382812e-05 time for calcul the mask position with numpy : 0.0061321258544921875 nb_pixel_total : 542 time to create 1 rle with old method : 0.0006411075592041016 time for calcul the mask position with numpy : 0.00606846809387207 nb_pixel_total : 55 time to create 1 rle with old method : 9.274482727050781e-05 time for calcul the mask position with numpy : 0.006175518035888672 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002601146697998047 time for calcul the mask position with numpy : 0.005914449691772461 nb_pixel_total : 167 time to create 1 rle with old method : 0.00021409988403320312 time for calcul the mask position with numpy : 0.006119966506958008 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006628036499023438 time for calcul the mask position with numpy : 0.005871295928955078 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0015976428985595703 time for calcul the mask position with numpy : 0.005942583084106445 nb_pixel_total : 2843 time to create 1 rle with old method : 0.0032775402069091797 time for calcul the mask position with numpy : 0.005964756011962891 nb_pixel_total : 20 time to create 1 rle with old method : 4.0531158447265625e-05 time for calcul the mask position with numpy : 0.006238460540771484 nb_pixel_total : 8061 time to create 1 rle with old method : 0.009199142456054688 time for calcul the mask position with numpy : 0.007910728454589844 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003333091735839844 time for calcul the mask position with numpy : 0.008335113525390625 nb_pixel_total : 547 time to create 1 rle with old method : 0.000659942626953125 time for calcul the mask position with numpy : 0.008121252059936523 nb_pixel_total : 110 time to create 1 rle with old method : 0.000133514404296875 time for calcul the mask position with numpy : 0.008434057235717773 nb_pixel_total : 161 time to create 1 rle with old method : 0.00033593177795410156 time for calcul the mask position with numpy : 0.008214235305786133 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003342628479003906 time for calcul the mask position with numpy : 0.008111238479614258 nb_pixel_total : 96 time to create 1 rle with old method : 0.00012493133544921875 time for calcul the mask position with numpy : 0.008423566818237305 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002810955047607422 time for calcul the mask position with numpy : 0.008118629455566406 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003147125244140625 time for calcul the mask position with numpy : 0.008330583572387695 nb_pixel_total : 93 time to create 1 rle with old method : 0.00013875961303710938 time for calcul the mask position with numpy : 0.008365631103515625 nb_pixel_total : 271 time to create 1 rle with old method : 0.00031948089599609375 time for calcul the mask position with numpy : 0.008428573608398438 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005030632019042969 time for calcul the mask position with numpy : 0.008205413818359375 nb_pixel_total : 153 time to create 1 rle with old method : 0.00019693374633789062 create new chi : 1.6872763633728027 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001445770263671875 batch 1 Loaded 113 chid ids of type : 4230 Number RLEs to save : 9285 TO DO : save crop sub photo not yet done ! save time : 0.6002578735351562 nb_obj : 102 nb_hashtags : 7 time to prepare the origin masks : 1.5202054977416992 time for calcul the mask position with numpy : 0.05720686912536621 nb_pixel_total : 1831029 time to create 1 rle with new method : 0.055510759353637695 time for calcul the mask position with numpy : 0.009285449981689453 nb_pixel_total : 542 time to create 1 rle with old method : 0.0014564990997314453 time for calcul the mask position with numpy : 0.010220766067504883 nb_pixel_total : 23 time to create 1 rle with old method : 0.00010251998901367188 time for calcul the mask position with numpy : 0.010499000549316406 nb_pixel_total : 873 time to create 1 rle with old method : 0.0020270347595214844 time for calcul the mask position with numpy : 0.010238170623779297 nb_pixel_total : 1728 time to create 1 rle with old method : 0.004052877426147461 time for calcul the mask position with numpy : 0.00858306884765625 nb_pixel_total : 26 time to create 1 rle with old method : 0.00012254714965820312 time for calcul the mask position with numpy : 0.009505510330200195 nb_pixel_total : 2449 time to create 1 rle with old method : 0.004580259323120117 time for calcul the mask position with numpy : 0.008893251419067383 nb_pixel_total : 37 time to create 1 rle with old method : 0.00010585784912109375 time for calcul the mask position with numpy : 0.00866842269897461 nb_pixel_total : 739 time to create 1 rle with old method : 0.001413106918334961 time for calcul the mask position with numpy : 0.010514020919799805 nb_pixel_total : 49841 time to create 1 rle with old method : 0.09192228317260742 time for calcul the mask position with numpy : 0.008495330810546875 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0019686222076416016 time for calcul the mask position with numpy : 0.008509397506713867 nb_pixel_total : 472 time to create 1 rle with old method : 0.0009913444519042969 time for calcul the mask position with numpy : 0.00816798210144043 nb_pixel_total : 594 time to create 1 rle with old method : 0.0012497901916503906 time for calcul the mask position with numpy : 0.008189916610717773 nb_pixel_total : 1741 time to create 1 rle with old method : 0.0028743743896484375 time for calcul the mask position with numpy : 0.006788492202758789 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006330013275146484 time for calcul the mask position with numpy : 0.007231950759887695 nb_pixel_total : 813 time to create 1 rle with old method : 0.0012140274047851562 time for calcul the mask position with numpy : 0.00749659538269043 nb_pixel_total : 4936 time to create 1 rle with old method : 0.006239175796508789 time for calcul the mask position with numpy : 0.008803844451904297 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006873607635498047 time for calcul the mask position with numpy : 0.007634162902832031 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0018801689147949219 time for calcul the mask position with numpy : 0.00788736343383789 nb_pixel_total : 468 time to create 1 rle with old method : 0.00077056884765625 time for calcul the mask position with numpy : 0.0074748992919921875 nb_pixel_total : 1297 time to create 1 rle with old method : 0.0015714168548583984 time for calcul the mask position with numpy : 0.0076313018798828125 nb_pixel_total : 825 time to create 1 rle with old method : 0.00106048583984375 time for calcul the mask position with numpy : 0.00802159309387207 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002543926239013672 time for calcul the mask position with numpy : 0.007911205291748047 nb_pixel_total : 645 time to create 1 rle with old method : 0.0009288787841796875 time for calcul the mask position with numpy : 0.007593631744384766 nb_pixel_total : 64 time to create 1 rle with old method : 0.00011658668518066406 time for calcul the mask position with numpy : 0.0076177120208740234 nb_pixel_total : 1170 time to create 1 rle with old method : 0.0014519691467285156 time for calcul the mask position with numpy : 0.007572650909423828 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003979206085205078 time for calcul the mask position with numpy : 0.007653951644897461 nb_pixel_total : 7899 time to create 1 rle with old method : 0.009670019149780273 time for calcul the mask position with numpy : 0.0075359344482421875 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002238750457763672 time for calcul the mask position with numpy : 0.007311582565307617 nb_pixel_total : 836 time to create 1 rle with old method : 0.0010223388671875 time for calcul the mask position with numpy : 0.00764012336730957 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004086494445800781 time for calcul the mask position with numpy : 0.007987499237060547 nb_pixel_total : 919 time to create 1 rle with old method : 0.001642465591430664 time for calcul the mask position with numpy : 0.008929967880249023 nb_pixel_total : 4393 time to create 1 rle with old method : 0.00760197639465332 time for calcul the mask position with numpy : 0.008287191390991211 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006735324859619141 time for calcul the mask position with numpy : 0.007538318634033203 nb_pixel_total : 852 time to create 1 rle with old method : 0.0012094974517822266 time for calcul the mask position with numpy : 0.007822513580322266 nb_pixel_total : 1850 time to create 1 rle with old method : 0.002400636672973633 time for calcul the mask position with numpy : 0.0077533721923828125 nb_pixel_total : 379 time to create 1 rle with old method : 0.00052642822265625 time for calcul the mask position with numpy : 0.007881402969360352 nb_pixel_total : 590 time to create 1 rle with old method : 0.0008482933044433594 time for calcul the mask position with numpy : 0.008127689361572266 nb_pixel_total : 25 time to create 1 rle with old method : 7.295608520507812e-05 time for calcul the mask position with numpy : 0.00778651237487793 nb_pixel_total : 66 time to create 1 rle with old method : 0.00010943412780761719 time for calcul the mask position with numpy : 0.008250713348388672 nb_pixel_total : 2759 time to create 1 rle with old method : 0.0036268234252929688 time for calcul the mask position with numpy : 0.008078336715698242 nb_pixel_total : 92 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.008667707443237305 nb_pixel_total : 1352 time to create 1 rle with old method : 0.0018792152404785156 time for calcul the mask position with numpy : 0.008072853088378906 nb_pixel_total : 1802 time to create 1 rle with old method : 0.002420186996459961 time for calcul the mask position with numpy : 0.00838160514831543 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002853870391845703 time for calcul the mask position with numpy : 0.008148908615112305 nb_pixel_total : 82 time to create 1 rle with old method : 0.00013875961303710938 time for calcul the mask position with numpy : 0.008919000625610352 nb_pixel_total : 131 time to create 1 rle with old method : 0.00020265579223632812 time for calcul the mask position with numpy : 0.007816314697265625 nb_pixel_total : 301 time to create 1 rle with old method : 0.00042819976806640625 time for calcul the mask position with numpy : 0.008114337921142578 nb_pixel_total : 278 time to create 1 rle with old method : 0.00040435791015625 time for calcul the mask position with numpy : 0.00814962387084961 nb_pixel_total : 138 time to create 1 rle with old method : 0.000209808349609375 time for calcul the mask position with numpy : 0.008324146270751953 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003533363342285156 time for calcul the mask position with numpy : 0.008121013641357422 nb_pixel_total : 162 time to create 1 rle with old method : 0.00024628639221191406 time for calcul the mask position with numpy : 0.008881807327270508 nb_pixel_total : 106310 time to create 1 rle with old method : 0.13648295402526855 time for calcul the mask position with numpy : 0.006564140319824219 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005483627319335938 time for calcul the mask position with numpy : 0.006353855133056641 nb_pixel_total : 269 time to create 1 rle with old method : 0.00034928321838378906 time for calcul the mask position with numpy : 0.006264209747314453 nb_pixel_total : 1576 time to create 1 rle with old method : 0.0019421577453613281 time for calcul the mask position with numpy : 0.006425142288208008 nb_pixel_total : 95 time to create 1 rle with old method : 0.00014472007751464844 time for calcul the mask position with numpy : 0.0067441463470458984 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006077289581298828 time for calcul the mask position with numpy : 0.006520509719848633 nb_pixel_total : 1260 time to create 1 rle with old method : 0.001482248306274414 time for calcul the mask position with numpy : 0.00832676887512207 nb_pixel_total : 22 time to create 1 rle with old method : 5.984306335449219e-05 time for calcul the mask position with numpy : 0.006794929504394531 nb_pixel_total : 216 time to create 1 rle with old method : 0.00027680397033691406 time for calcul the mask position with numpy : 0.006829023361206055 nb_pixel_total : 7 time to create 1 rle with old method : 4.267692565917969e-05 time for calcul the mask position with numpy : 0.006747722625732422 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005373954772949219 time for calcul the mask position with numpy : 0.006575822830200195 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005636215209960938 time for calcul the mask position with numpy : 0.006443500518798828 nb_pixel_total : 697 time to create 1 rle with old method : 0.0008933544158935547 time for calcul the mask position with numpy : 0.0065081119537353516 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005104541778564453 time for calcul the mask position with numpy : 0.006640195846557617 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002620220184326172 time for calcul the mask position with numpy : 0.007655143737792969 nb_pixel_total : 769 time to create 1 rle with old method : 0.00116729736328125 time for calcul the mask position with numpy : 0.00674748420715332 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005018711090087891 time for calcul the mask position with numpy : 0.006623744964599609 nb_pixel_total : 2935 time to create 1 rle with old method : 0.003476858139038086 time for calcul the mask position with numpy : 0.0065996646881103516 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002663135528564453 time for calcul the mask position with numpy : 0.006801605224609375 nb_pixel_total : 382 time to create 1 rle with old method : 0.0006935596466064453 time for calcul the mask position with numpy : 0.008074045181274414 nb_pixel_total : 493 time to create 1 rle with old method : 0.0009171962738037109 time for calcul the mask position with numpy : 0.008053064346313477 nb_pixel_total : 468 time to create 1 rle with old method : 0.0008969306945800781 time for calcul the mask position with numpy : 0.007668495178222656 nb_pixel_total : 107 time to create 1 rle with old method : 0.0002391338348388672 time for calcul the mask position with numpy : 0.007778167724609375 nb_pixel_total : 53 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.007837533950805664 nb_pixel_total : 231 time to create 1 rle with old method : 0.0005254745483398438 time for calcul the mask position with numpy : 0.00791311264038086 nb_pixel_total : 313 time to create 1 rle with old method : 0.0006453990936279297 time for calcul the mask position with numpy : 0.007827520370483398 nb_pixel_total : 2698 time to create 1 rle with old method : 0.005026102066040039 time for calcul the mask position with numpy : 0.007574796676635742 nb_pixel_total : 418 time to create 1 rle with old method : 0.0009324550628662109 time for calcul the mask position with numpy : 0.007718324661254883 nb_pixel_total : 2968 time to create 1 rle with old method : 0.005483388900756836 time for calcul the mask position with numpy : 0.00804591178894043 nb_pixel_total : 47 time to create 1 rle with old method : 0.00012421607971191406 time for calcul the mask position with numpy : 0.008226633071899414 nb_pixel_total : 41 time to create 1 rle with old method : 0.00013709068298339844 time for calcul the mask position with numpy : 0.008103370666503906 nb_pixel_total : 576 time to create 1 rle with old method : 0.0011615753173828125 time for calcul the mask position with numpy : 0.008693456649780273 nb_pixel_total : 261 time to create 1 rle with old method : 0.0005156993865966797 time for calcul the mask position with numpy : 0.010935544967651367 nb_pixel_total : 220 time to create 1 rle with old method : 0.0006890296936035156 time for calcul the mask position with numpy : 0.00904083251953125 nb_pixel_total : 487 time to create 1 rle with old method : 0.0010371208190917969 time for calcul the mask position with numpy : 0.009437322616577148 nb_pixel_total : 1349 time to create 1 rle with old method : 0.0024688243865966797 time for calcul the mask position with numpy : 0.008516788482666016 nb_pixel_total : 2887 time to create 1 rle with old method : 0.005620479583740234 time for calcul the mask position with numpy : 0.009104490280151367 nb_pixel_total : 696 time to create 1 rle with old method : 0.0017352104187011719 time for calcul the mask position with numpy : 0.007761240005493164 nb_pixel_total : 7242 time to create 1 rle with old method : 0.0089874267578125 time for calcul the mask position with numpy : 0.006918191909790039 nb_pixel_total : 93 time to create 1 rle with old method : 0.00013685226440429688 time for calcul the mask position with numpy : 0.007050037384033203 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005559921264648438 time for calcul the mask position with numpy : 0.007980585098266602 nb_pixel_total : 545 time to create 1 rle with old method : 0.0009403228759765625 time for calcul the mask position with numpy : 0.0072896480560302734 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001819133758544922 time for calcul the mask position with numpy : 0.007383823394775391 nb_pixel_total : 975 time to create 1 rle with old method : 0.0017731189727783203 time for calcul the mask position with numpy : 0.0073544979095458984 nb_pixel_total : 607 time to create 1 rle with old method : 0.0011260509490966797 time for calcul the mask position with numpy : 0.007688760757446289 nb_pixel_total : 116 time to create 1 rle with old method : 0.0002682209014892578 time for calcul the mask position with numpy : 0.007559776306152344 nb_pixel_total : 245 time to create 1 rle with old method : 0.00042891502380371094 time for calcul the mask position with numpy : 0.0070993900299072266 nb_pixel_total : 235 time to create 1 rle with old method : 0.0004642009735107422 time for calcul the mask position with numpy : 0.0076677799224853516 nb_pixel_total : 274 time to create 1 rle with old method : 0.0005643367767333984 time for calcul the mask position with numpy : 0.007798433303833008 nb_pixel_total : 405 time to create 1 rle with old method : 0.0008442401885986328 time for calcul the mask position with numpy : 0.007911920547485352 nb_pixel_total : 152 time to create 1 rle with old method : 0.00023245811462402344 create new chi : 1.285839319229126 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0018429756164550781 batch 1 Loaded 103 chid ids of type : 4230 Number RLEs to save : 9194 TO DO : save crop sub photo not yet done ! save time : 0.9060277938842773 map_output_result : {1339960882: (0.0, 'Should be the crop_list due to order', 0.0), 1339960880: (0.0, 'Should be the crop_list due to order', 0.0), 1339960799: (0.0, 'Should be the crop_list due to order', 0.0), 1339960797: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1339960882, 1339960880, 1339960799, 1339960797] Looping around the photos to save general results len do output : 4 /1339960882.Didn't retrieve data . /1339960880.Didn't retrieve data . /1339960799.Didn't retrieve data . /1339960797.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960882', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960880', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960799', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960797', None, None, None, None, None, '2620556') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.013624191284179688 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.47401762008667 time spend to save output : 0.013934612274169922 total time spend for step 4 : 16.48795223236084 step5:crop_condition Fri Feb 28 01:21:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 435 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 173 About to insert : list_path_to_insert length 173 new photo from crops ! About to upload 173 photos upload in portfolio : 4869462 init cache_photo without model_param we have 173 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740702091_2260602 we have uploaded 173 photos in the portfolio 4869462 time of upload the photos Elapsed time : 45.704177379608154 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 75 About to insert : list_path_to_insert length 75 new photo from crops ! About to upload 75 photos upload in portfolio : 4869462 init cache_photo without model_param we have 75 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740702138_2260602 we have uploaded 75 photos in the portfolio 4869462 time of upload the photos Elapsed time : 19.63182044029236 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740702158_2260602 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8650720119476318 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4869462 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740702159_2260602 we have uploaded 6 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.835007905960083 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 4869462 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740702161_2260602 we have uploaded 45 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.033405303955078 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1339960882, 1339960880, 1339960799, 1339960797] Looping around the photos to save general results len do output : 301 /1340025459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340025800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960882', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960880', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960799', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960797', None, None, None, None, None, '2620556') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 907 time used for this insertion : 0.0677487850189209 save_final save missing photos in datou_result : time spend for datou_step_exec : 85.38786125183105 time spend to save output : 0.07805657386779785 total time spend for step 5 : 85.46591782569885 step6:thcl Fri Feb 28 01:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.010560750961303711 time to convert the images to numpy array : 0.058907270431518555 time to import caffe and check if the image exist : 0.017538070678710938 time to convert the images to numpy array : 0.059844255447387695 time to import caffe and check if the image exist : 0.016719579696655273 time to convert the images to numpy array : 0.066986083984375 time to import caffe and check if the image exist : 0.018621206283569336 time to convert the images to numpy array : 0.06710147857666016 time to import caffe and check if the image exist : 0.023601531982421875 time to convert the images to numpy array : 0.06821131706237793 time to import caffe and check if the image exist : 0.026772260665893555 time to convert the images to numpy array : 0.06627535820007324 time to import caffe and check if the image exist : 0.019385576248168945 time to convert the images to numpy array : 0.07489657402038574 time to import caffe and check if the image exist : 0.024769067764282227 time to convert the images to numpy array : 0.07138490676879883 time to import caffe and check if the image exist : 0.01708984375 time to convert the images to numpy array : 0.07904171943664551 time to import caffe and check if the image exist : 0.020787954330444336 time to convert the images to numpy array : 0.07638406753540039 total time to convert the images to numpy array : 0.5493290424346924 list photo_ids error: [] list photo_ids correct : [1340025779, 1340025780, 1340025781, 1340025782, 1340025783, 1340025784, 1340025785, 1340025786, 1340025787, 1340025788, 1340025789, 1340025790, 1340025791, 1340025792, 1340025793, 1340025794, 1340025795, 1340025796, 1340025797, 1340025798, 1340025799, 1340025800, 1340025586, 1340025587, 1340025588, 1340025589, 1340025590, 1340025591, 1340025592, 1340025593, 1340025594, 1340025595, 1340025596, 1340025597, 1340025598, 1340025599, 1340025600, 1340025601, 1340025602, 1340025603, 1340025604, 1340025605, 1340025606, 1340025607, 1340025608, 1340025609, 1340025610, 1340025611, 1340025612, 1340025613, 1340025614, 1340025615, 1340025616, 1340025490, 1340025491, 1340025492, 1340025493, 1340025494, 1340025495, 1340025496, 1340025497, 1340025498, 1340025499, 1340025500, 1340025501, 1340025502, 1340025503, 1340025504, 1340025505, 1340025506, 1340025507, 1340025508, 1340025509, 1340025510, 1340025511, 1340025512, 1340025513, 1340025514, 1340025515, 1340025516, 1340025517, 1340025518, 1340025519, 1340025520, 1340025553, 1340025554, 1340025555, 1340025556, 1340025557, 1340025558, 1340025559, 1340025561, 1340025562, 1340025563, 1340025564, 1340025566, 1340025567, 1340025568, 1340025569, 1340025570, 1340025571, 1340025572, 1340025573, 1340025574, 1340025575, 1340025576, 1340025577, 1340025578, 1340025579, 1340025580, 1340025581, 1340025582, 1340025583, 1340025584, 1340025585, 1340025617, 1340025618, 1340025619, 1340025620, 1340025621, 1340025622, 1340025623, 1340025624, 1340025625, 1340025626, 1340025627, 1340025628, 1340025629, 1340025630, 1340025631, 1340025632, 1340025633, 1340025634, 1340025649, 1340025651, 1340025652, 1340025653, 1340025654, 1340025655, 1340025656, 1340025657, 1340025658, 1340025659, 1340025660, 1340025661, 1340025662, 1340025730, 1340025731, 1340025732, 1340025733, 1340025734, 1340025735, 1340025736, 1340025737, 1340025755, 1340025757, 1340025758, 1340025759, 1340025760, 1340025761, 1340025762, 1340025763, 1340025764, 1340025765, 1340025766, 1340025767, 1340025768, 1340025769, 1340025770, 1340025771, 1340025772, 1340025773, 1340025774, 1340025775, 1340025776, 1340025777, 1340025778, 1340025694, 1340025695, 1340025696, 1340025697, 1340025698, 1340025699, 1340025700, 1340025701, 1340025702, 1340025703, 1340025704, 1340025705, 1340025708, 1340025709, 1340025710, 1340025712, 1340025713, 1340025714, 1340025715, 1340025716, 1340025717, 1340025719, 1340025720, 1340025721, 1340025722, 1340025723, 1340025724, 1340025725, 1340025726, 1340025728, 1340025729, 1340025459, 1340025460, 1340025461, 1340025462, 1340025463, 1340025464, 1340025465, 1340025466, 1340025467, 1340025468, 1340025469, 1340025470, 1340025471, 1340025472, 1340025473, 1340025474, 1340025475, 1340025476, 1340025477, 1340025478, 1340025479, 1340025480, 1340025481, 1340025482, 1340025483, 1340025484, 1340025485, 1340025486, 1340025487, 1340025488, 1340025489, 1340025663, 1340025664, 1340025665, 1340025666, 1340025667, 1340025668, 1340025669, 1340025670, 1340025671, 1340025672, 1340025673, 1340025674, 1340025675, 1340025676, 1340025677, 1340025678, 1340025679, 1340025680, 1340025681, 1340025682, 1340025683, 1340025684, 1340025685, 1340025686, 1340025687, 1340025688, 1340025689, 1340025690, 1340025691, 1340025692, 1340025693, 1340025521, 1340025522, 1340025523, 1340025524, 1340025525, 1340025527, 1340025528, 1340025529, 1340025530, 1340025531, 1340025532, 1340025533, 1340025534, 1340025535, 1340025536, 1340025537, 1340025538, 1340025539, 1340025540, 1340025541, 1340025542, 1340025543, 1340025544, 1340025545, 1340025546, 1340025547, 1340025548, 1340025549, 1340025550, 1340025551, 1340025552] number of photos to traite : 301 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5304 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5085 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.3096957206726074 time used to do the prediction : 1.1528031826019287 save descriptor for thcl : 3237 time to traite the descriptors : 1.6626367568969727 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340025779 To insert : 1340025780 To insert : 1340025781 To insert : 1340025782 To insert : 1340025783 To insert : 1340025784 To insert : 1340025785 To insert : 1340025786 To insert : 1340025787 To insert : 1340025788 To insert : 1340025789 To insert : 1340025790 To insert : 1340025791 To insert : 1340025792 To insert : 1340025793 To insert : 1340025794 To insert : 1340025795 To insert : 1340025796 To insert : 1340025797 To insert : 1340025798 To insert : 1340025799 To insert : 1340025800 To insert : 1340025586 To insert : 1340025587 To insert : 1340025588 To insert : 1340025589 To insert : 1340025590 To insert : 1340025591 To insert : 1340025592 To insert : 1340025593 To insert : 1340025594 To insert : 1340025595 To insert : 1340025596 To insert : 1340025597 To insert : 1340025598 To insert : 1340025599 To insert : 1340025600 To insert : 1340025601 To insert : 1340025602 To insert : 1340025603 To insert : 1340025604 To insert : 1340025605 To insert : 1340025606 To insert : 1340025607 To insert : 1340025608 To insert : 1340025609 To insert : 1340025610 To insert : 1340025611 To insert : 1340025612 To insert : 1340025613 To insert : 1340025614 To insert : 1340025615 To insert : 1340025616 To insert : 1340025490 To insert : 1340025491 To insert : 1340025492 To insert : 1340025493 To insert : 1340025494 To insert : 1340025495 To insert : 1340025496 To insert : 1340025497 To insert : 1340025498 To insert : 1340025499 To insert : 1340025500 To insert : 1340025501 To insert : 1340025502 To insert : 1340025503 To insert : 1340025504 To insert : 1340025505 To insert : 1340025506 To insert : 1340025507 To insert : 1340025508 To insert : 1340025509 To insert : 1340025510 To insert : 1340025511 To insert : 1340025512 To insert : 1340025513 To insert : 1340025514 To insert : 1340025515 To insert : 1340025516 To insert : 1340025517 To insert : 1340025518 To insert : 1340025519 To insert : 1340025520 To insert : 1340025553 To insert : 1340025554 To insert : 1340025555 To insert : 1340025556 To insert : 1340025557 To insert : 1340025558 To insert : 1340025559 To insert : 1340025561 To insert : 1340025562 To insert : 1340025563 To insert : 1340025564 To insert : 1340025566 To insert : 1340025567 To insert : 1340025568 To insert : 1340025569 To insert : 1340025570 To insert : 1340025571 To insert : 1340025572 To insert : 1340025573 To insert : 1340025574 To insert : 1340025575 To insert : 1340025576 To insert : 1340025577 To insert : 1340025578 To insert : 1340025579 To insert : 1340025580 To insert : 1340025581 To insert : 1340025582 To insert : 1340025583 To insert : 1340025584 To insert : 1340025585 To insert : 1340025617 To insert : 1340025618 To insert : 1340025619 To insert : 1340025620 To insert : 1340025621 To insert : 1340025622 To insert : 1340025623 To insert : 1340025624 To insert : 1340025625 To insert : 1340025626 To insert : 1340025627 To insert : 1340025628 To insert : 1340025629 To insert : 1340025630 To insert : 1340025631 To insert : 1340025632 To insert : 1340025633 To insert : 1340025634 To insert : 1340025649 To insert : 1340025651 To insert : 1340025652 To insert : 1340025653 To insert : 1340025654 To insert : 1340025655 To insert : 1340025656 To insert : 1340025657 To insert : 1340025658 To insert : 1340025659 To insert : 1340025660 To insert : 1340025661 To insert : 1340025662 To insert : 1340025730 To insert : 1340025731 To insert : 1340025732 To insert : 1340025733 To insert : 1340025734 To insert : 1340025735 To insert : 1340025736 To insert : 1340025737 To insert : 1340025755 To insert : 1340025757 To insert : 1340025758 To insert : 1340025759 To insert : 1340025760 To insert : 1340025761 To insert : 1340025762 To insert : 1340025763 To insert : 1340025764 To insert : 1340025765 To insert : 1340025766 To insert : 1340025767 To insert : 1340025768 To insert : 1340025769 To insert : 1340025770 To insert : 1340025771 To insert : 1340025772 To insert : 1340025773 To insert : 1340025774 To insert : 1340025775 To insert : 1340025776 To insert : 1340025777 To insert : 1340025778 To insert : 1340025694 To insert : 1340025695 To insert : 1340025696 To insert : 1340025697 To insert : 1340025698 To insert : 1340025699 To insert : 1340025700 To insert : 1340025701 To insert : 1340025702 To insert : 1340025703 To insert : 1340025704 To insert : 1340025705 To insert : 1340025708 To insert : 1340025709 To insert : 1340025710 To insert : 1340025712 To insert : 1340025713 To insert : 1340025714 To insert : 1340025715 To insert : 1340025716 To insert : 1340025717 To insert : 1340025719 To insert : 1340025720 To insert : 1340025721 To insert : 1340025722 To insert : 1340025723 To insert : 1340025724 To insert : 1340025725 To insert : 1340025726 To insert : 1340025728 To insert : 1340025729 To insert : 1340025459 To insert : 1340025460 To insert : 1340025461 To insert : 1340025462 To insert : 1340025463 To insert : 1340025464 To insert : 1340025465 To insert : 1340025466 To insert : 1340025467 To insert : 1340025468 To insert : 1340025469 To insert : 1340025470 To insert : 1340025471 To insert : 1340025472 To insert : 1340025473 To insert : 1340025474 To insert : 1340025475 To insert : 1340025476 To insert : 1340025477 To insert : 1340025478 To insert : 1340025479 To insert : 1340025480 To insert : 1340025481 To insert : 1340025482 To insert : 1340025483 To insert : 1340025484 To insert : 1340025485 To insert : 1340025486 To insert : 1340025487 To insert : 1340025488 To insert : 1340025489 To insert : 1340025663 To insert : 1340025664 To insert : 1340025665 To insert : 1340025666 To insert : 1340025667 To insert : 1340025668 To insert : 1340025669 To insert : 1340025670 To insert : 1340025671 To insert : 1340025672 To insert : 1340025673 To insert : 1340025674 To insert : 1340025675 To insert : 1340025676 To insert : 1340025677 To insert : 1340025678 To insert : 1340025679 To insert : 1340025680 To insert : 1340025681 To insert : 1340025682 To insert : 1340025683 To insert : 1340025684 To insert : 1340025685 To insert : 1340025686 To insert : 1340025687 To insert : 1340025688 To insert : 1340025689 To insert : 1340025690 To insert : 1340025691 To insert : 1340025692 To insert : 1340025693 To insert : 1340025521 To insert : 1340025522 To insert : 1340025523 To insert : 1340025524 To insert : 1340025525 To insert : 1340025527 To insert : 1340025528 To insert : 1340025529 To insert : 1340025530 To insert : 1340025531 To insert : 1340025532 To insert : 1340025533 To insert : 1340025534 To insert : 1340025535 To insert : 1340025536 To insert : 1340025537 To insert : 1340025538 To insert : 1340025539 To insert : 1340025540 To insert : 1340025541 To insert : 1340025542 To insert : 1340025543 To insert : 1340025544 To insert : 1340025545 To insert : 1340025546 To insert : 1340025547 To insert : 1340025548 To insert : 1340025549 To insert : 1340025550 To insert : 1340025551 To insert : 1340025552 time to insert the descriptors : 61.804691314697266 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 442 time used for this insertion : 0.0337061882019043 save missing photos in datou_result : time spend for datou_step_exec : 70.78682899475098 time spend to save output : 0.08612918853759766 total time spend for step 6 : 70.87295818328857 step7:ventilate_hashtags_in_portfolio Fri Feb 28 01:24:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20889800 get user id for portfolio 20889800 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889800 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','refus','autre','environnement','PET_clair','Tetrapak','metal','PEHD','pet_fonce','carton','papier','PET_fonce','Carton','pehd','mal_croppe','pet_clair','Papier','Film_plastique')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889800 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','refus','autre','environnement','PET_clair','Tetrapak','metal','PEHD','pet_fonce','carton','papier','PET_fonce','Carton','pehd','mal_croppe','pet_clair','Papier','Film_plastique')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889800 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','refus','autre','environnement','PET_clair','Tetrapak','metal','PEHD','pet_fonce','carton','papier','PET_fonce','Carton','pehd','mal_croppe','pet_clair','Papier','Film_plastique')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889800 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','refus','autre','environnement','PET_clair','Tetrapak','metal','PEHD','pet_fonce','carton','papier','PET_fonce','Carton','pehd','mal_croppe','pet_clair','Papier','Film_plastique')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20901821,20901822,20901823,20901824,20901836,20901826,20901827,20901834,20901832,20901833,20901837,20901835,20901838?tags=flou,refus,autre,environnement,pet_clair,tetrapak,metal,pehd,pet_fonce,carton,papier,mal_croppe,film_plastique&datou_id_consolidate=4235&port_consolidate=20889800 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1339960882, 1339960880, 1339960799, 1339960797] Looping around the photos to save general results len do output : 1 /20889800. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960882', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960880', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960799', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960797', None, None, None, None, None, '2620556') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.01414799690246582 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.7342464923858643 time spend to save output : 0.014412164688110352 total time spend for step 7 : 3.7486586570739746 step8:final Fri Feb 28 01:24:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1339960882: ('0.16570148489532288',), 1339960880: ('0.16570148489532288',), 1339960799: ('0.16570148489532288',), 1339960797: ('0.16570148489532288',)} new output for save of step final : {1339960882: ('0.16570148489532288',), 1339960880: ('0.16570148489532288',), 1339960799: ('0.16570148489532288',), 1339960797: ('0.16570148489532288',)} [1339960882, 1339960880, 1339960799, 1339960797] Looping around the photos to save general results len do output : 4 /1339960882.Didn't retrieve data . /1339960880.Didn't retrieve data . /1339960799.Didn't retrieve data . /1339960797.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960882', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960880', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960799', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960797', None, None, None, None, None, '2620556') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012505292892456055 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12546563148498535 time spend to save output : 0.012764692306518555 total time spend for step 8 : 0.1382303237915039 step9:velours_tree Fri Feb 28 01:24:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20901821,20901822,20901823,20901824,20901836,20901826,20901827,20901834,20901832,20901833,20901837,20901835,20901838 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901821 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901822 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901823 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901824 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901836 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901826 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901827 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901834 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901832 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901833 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901837 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901835 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20901838 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 301 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 5 3 3 1 1 1 3 3 5 3 3 1 3 1 1 1 1 1 1 3 0 3 3 3 3 0 1 3 2 0 1 0 3 3 1 3 1 0 1 1 3 3 1 1 1 0 5 0 1 3 1 1 3 3 1 1 3 1 1 1 1 0 3 3 3 3 3 0 1 1 3 0 1 0 3 0 3 3 0 1 0 5 3 1 1 1 0 5 3 3 1 1 1 3 3 5 3 3 1 3 1 1 1 1 1 1 3 0 3 3 3 3 0 1 3 2 0 1 0 3 3 1 3 1 0 1 1 3 5 1 1 1 0 5 0 1 3 1 1 3 3 1 1 3 1 1 1 1 0 3 3 3 3 3 0 1 1 3 0 1 0 3 0 3 3 0 1 5 3 1 1 1 4 4 4 5 1 1 5 5 2 0 3 5 3 2 3 0 0 1 1 0 4 4 0 5 0 5 5 1 0 3 5 3 1 2 3 5 0 3 4 4 4 5 1 1 5 5 0 3 5 3 2 3 0 0 1 1 0 4 4 0 5 0 5 5 1 0 3 5 3 1 2 3 5 0 3 1 1 1 3 3 1 3 3 0 0 2 0 2 3 0 0 1 0 0 0 0 2 2 3 0 0 1 0 0 0 0 0 0 2 2 3 0 0 1 0 0 0 0 2 2 3 0 0 1 0 0 0 0] Elapsed time: 0.15115046501159668 graph_id used : 80585 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20901821,20901822,20901823,20901824,20901836,20901826,20901827,20901834,20901832,20901833,20901837,20901835,20901838?tags=flou,refus,autre,environnement,pet_clair,tetrapak,metal,pehd,pet_fonce,carton,papier,mal_croppe,film_plastique&datou_id_consolidate=4235&port_consolidate=20889800&tree_id=80585 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1339960882, 1339960880, 1339960799, 1339960797] Looping around the photos to save general results len do output : 1 /20889800Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960882', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960880', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960799', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960797', None, None, None, None, None, '2620556') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.01355290412902832 save_final save missing photos in datou_result : time spend for datou_step_exec : 22.195152521133423 time spend to save output : 0.013812065124511719 total time spend for step 9 : 22.208964586257935 step10:send_mail_cod Fri Feb 28 01:24:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20889800_28-02-2025_01_24_31.pdf 20901803 imagette209018031740702271 20901804 imagette209018041740702271 20901805 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209018051740702271 20901818 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209018181740702271 20901808 imagette209018081740702272 20901809 change filename to text .change filename to text .imagette209018091740702272 20901816 imagette209018161740702272 20901814 imagette209018141740702272 20901815 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209018151740702272 20901819 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209018191740702273 20901817 imagette209018171740702274 20901820 imagette209018201740702274 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20889800 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20901821,20901822,20901823,20901824,20901836,20901826,20901827,20901834,20901832,20901833,20901837,20901835,20901838?tags=flou,refus,autre,environnement,pet_clair,tetrapak,metal,pehd,pet_fonce,carton,papier,mal_croppe,film_plastique&datou_id_consolidate=4235&port_consolidate=20889800&tree_id=80585 your option no_mail is active, we will not send the real mail to your client args[1339960882] : ((1339960882, -7.760405464309785, 492609224), (1339960882, -0.44395485959815956, 496442774), '0.16570148489532288') We are sending mail with results at cod@fotonower.com args[1339960880] : ((1339960880, -7.753955803727409, 492609224), (1339960880, -0.43677523486336506, 496442774), '0.16570148489532288') We are sending mail with results at cod@fotonower.com args[1339960799] : ((1339960799, -7.760405464309785, 492609224), (1339960799, -0.44395485959815956, 496442774), '0.16570148489532288') We are sending mail with results at cod@fotonower.com args[1339960797] : ((1339960797, -7.753955803727409, 492609224), (1339960797, -0.43677523486336506, 496442774), '0.16570148489532288') We are sending mail with results at cod@fotonower.com refus_total : 0.16570148489532288 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20889800 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889800_28-02-2025_01_24_31.pdf results_Qualipapia_P20889800_28-02-2025_01_24_31.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889800_28-02-2025_01_24_31.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20889800','results_Qualipapia_P20889800_28-02-2025_01_24_31.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889800_28-02-2025_01_24_31.pdf','pdf','','0.16','0.16570148489532288') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1339960882, 1339960880, 1339960799, 1339960797] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960882', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960880', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960799', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960797', None, None, None, None, None, '2620556') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.014854907989501953 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.219754934310913 time spend to save output : 0.015042543411254883 total time spend for step 10 : 4.234797477722168 step11:split_time_score Fri Feb 28 01:24:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27022025 20889800 Nombre de photos uploadées : 4 / 23040 (0%) 27022025 20889800 Nombre de photos taguées (types de déchets): 4 / 4 (100%) 27022025 20889800 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.0002853870391845703 elapsed_time : insert_dashboard_record_day_entry 0.029007673263549805 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.19685402815434147 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880914_27-02-2025_15_47_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880914 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880914 AND mptpi.`type`=4230 To do Qualite : 0.21152497949138183 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880915_27-02-2025_15_54_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880915 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880915 AND mptpi.`type`=4230 To do Qualite : 0.18979229772842968 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880916_27-02-2025_16_14_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880916 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880916 AND mptpi.`type`=4230 To do Qualite : 0.22691391007392073 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880917_27-02-2025_16_18_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880917 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880917 AND mptpi.`type`=4230 To do Qualite : 0.2513147479157829 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880918_27-02-2025_16_24_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880918 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880918 AND mptpi.`type`=4230 To do Qualite : 0.25009736379758823 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880919_27-02-2025_15_47_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880919 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880919 AND mptpi.`type`=4230 To do Qualite : 0.11007267109192401 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880920_27-02-2025_14_46_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880920 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880920 AND mptpi.`type`=4230 To do Qualite : 0.19961527896716455 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880921_27-02-2025_12_49_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880921 AND mptpi.`type`=4230 To do Qualite : 0.2407666415285407 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20881153_27-02-2025_13_22_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20881153 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20881153 AND mptpi.`type`=4230 To do Qualite : 0.16957394556367378 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20881154_27-02-2025_13_19_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20881154 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20881154 AND mptpi.`type`=4230 To do Qualite : 0.1847201060328798 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20881155_27-02-2025_15_46_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20881155 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20881155 AND mptpi.`type`=4230 To do Qualite : 0.22728245879244777 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20881447_27-02-2025_13_47_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20881447 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20881447 AND mptpi.`type`=4230 To do Qualite : 0.17626552099815018 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885729_27-02-2025_20_58_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885729 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885729 AND mptpi.`type`=4230 To do Qualite : 0.2226373081351226 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885731_27-02-2025_21_03_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885731 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885731 AND mptpi.`type`=4230 To do Qualite : 0.2160402578335216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885733_27-02-2025_21_07_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885733 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885733 AND mptpi.`type`=4230 To do Qualite : 0.2150972751637293 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885735_27-02-2025_17_48_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885735 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885735 AND mptpi.`type`=4230 To do Qualite : 0.21161213433613119 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885737_27-02-2025_21_27_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885737 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885737 AND mptpi.`type`=4230 To do Qualite : 0.19207157935691652 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885739_27-02-2025_16_47_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885739 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885739 AND mptpi.`type`=4230 To do Qualite : 0.1820895488940009 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885740_27-02-2025_17_33_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885740 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885740 AND mptpi.`type`=4230 To do Qualite : 0.1987515355230658 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888085_27-02-2025_22_47_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888085 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888085 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888086 order by id desc limit 1 Qualite : 0.16646903302631547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888087_27-02-2025_22_57_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888087 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888087 AND mptpi.`type`=4230 To do Qualite : 0.21162826992937084 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888088_27-02-2025_18_40_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888088 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888088 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888339 order by id desc limit 1 Qualite : 0.22637596140207053 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888340_27-02-2025_23_57_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888340 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888340 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888341 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888342 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888343 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888344 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888345 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888346 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888347 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888348 order by id desc limit 1 Qualite : 0.16811916136619814 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888349_27-02-2025_18_47_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888349 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888349 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888709 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888710 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888711 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888712 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888713 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888714 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888715 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888716 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888717 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888718 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888719 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888720 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888721 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888722 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888723 order by id desc limit 1 Qualite : 0.16981797891253236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888724_27-02-2025_19_34_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888724 AND mptpi.`type`=4230 To do Qualite : 0.17044993311570272 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888725_27-02-2025_19_22_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888725 AND mptpi.`type`=4230 To do Qualite : 0.15717663944229918 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888726_27-02-2025_19_18_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888726 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888726 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889794 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889795 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889796 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889797 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889798 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889799 order by id desc limit 1 Qualite : 0.16570148489532288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889800_28-02-2025_01_24_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889800 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889800 AND mptpi.`type`=4230 To do Qualite : 0.23774034162320024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891033_28-02-2025_00_03_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891033 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891033 AND mptpi.`type`=4230 To do Qualite : 0.23567691447106798 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891034_27-02-2025_23_35_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891034 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891034 AND mptpi.`type`=4230 To do Qualite : 0.2498587351726735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891035_27-02-2025_21_07_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891035 AND mptpi.`type`=4230 To do Qualite : 0.2473345296710318 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891036_27-02-2025_22_54_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891036 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891036 AND mptpi.`type`=4230 To do Qualite : 0.25475831753092626 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891037_27-02-2025_22_36_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891037 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891037 AND mptpi.`type`=4230 To do Qualite : 0.24580568531663002 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891038_27-02-2025_20_19_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891038 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891038 AND mptpi.`type`=4230 To do Qualite : 0.17561677212499766 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20893121_27-02-2025_21_23_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20893121 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20893121 AND mptpi.`type`=4230 To do Qualite : 0.17483690139268926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20894292_27-02-2025_21_48_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20894292 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20894292 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27022025': {'nb_upload': 4, 'nb_taggue_class': 4, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1339960882, 1339960880, 1339960799, 1339960797] Looping around the photos to save general results len do output : 1 /20889800Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960882', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960880', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960799', None, None, None, None, None, '2620556') ('4234', None, None, None, None, None, None, None, '2620556') ('4234', '20889800', '1339960797', None, None, None, None, None, '2620556') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.014224052429199219 save_final save missing photos in datou_result : time spend for datou_step_exec : 28.108097076416016 time spend to save output : 0.014419078826904297 total time spend for step 11 : 28.12251615524292 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 54.31user 34.32system 4:37.64elapsed 31%CPU (0avgtext+0avgdata 2452812maxresident)k 1891848inputs+20384outputs (7343major+2608199minor)pagefaults 0swaps