python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3070810 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 110>5 please execute split_portfolio.py -i 20891033 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2620645'] with mtr_portfolio_ids : ['20891033'] and first list_photo_ids : [] new path : /proc/3070810/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.7986690998077393 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Feb 28 05:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5083 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-28 05:20:37.481271: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-28 05:20:37.507846: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-28 05:20:37.510316: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6958000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-28 05:20:37.510432: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-28 05:20:37.519975: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-28 05:20:37.738836: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x38cb0050 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-28 05:20:37.738959: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-28 05:20:37.740822: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 05:20:37.741314: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 05:20:37.749678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 05:20:37.780719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 05:20:37.783557: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 05:20:37.855785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 05:20:37.867474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 05:20:37.971264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 05:20:37.975265: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 05:20:37.975471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 05:20:37.977085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 05:20:37.977110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 05:20:37.977123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 05:20:37.984797: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4480 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-28 05:20:38.789332: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 05:20:38.789417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 05:20:38.789438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 05:20:38.789457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 05:20:38.789474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 05:20:38.789492: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 05:20:38.789509: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 05:20:38.789527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 05:20:38.790655: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 05:20:38.791793: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 05:20:38.791831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 05:20:38.791850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 05:20:38.791873: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 05:20:38.791890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 05:20:38.791907: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 05:20:38.791924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 05:20:38.791941: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 05:20:38.793062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 05:20:38.793097: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 05:20:38.793108: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 05:20:38.793117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 05:20:38.794298: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4480 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-28 05:20:48.697322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 05:20:48.911425: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 05:20:51.048773: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:51.049443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.49G (3746444032 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:51.050129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.14G (3371799552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:51.855607: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-28 05:20:51.927040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:51.927121: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:51.928369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:51.928398: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:51.935681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:51.935724: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:51.936818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:51.936842: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:52.010579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.010648: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:52.011335: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.011360: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:52.022001: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.022055: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:52.022774: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.022798: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:52.061761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.061818: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 188.27MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:52.062617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.062637: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 188.27MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 05:20:52.063511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.064318: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.068503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.069155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.069794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.070434: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.072377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.072398: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-28 05:20:52.081685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.082341: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.091422: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.092082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.092733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.093372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.094021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 05:20:52.094660: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.88G (4162715648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.10625 max: 145.45547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.001201629638671875 length of segment : 50 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 899 time to create 1 rle with old method : 0.015269994735717773 length of segment : 42 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 951 time to create 1 rle with old method : 0.0017819404602050781 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.05547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 1504 time to create 1 rle with old method : 0.003214597702026367 length of segment : 38 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 2457 time to create 1 rle with old method : 0.0048410892486572266 length of segment : 54 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00022840499877929688 length of segment : 12 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0003840923309326172 length of segment : 31 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00040531158447265625 length of segment : 13 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 940 time to create 1 rle with old method : 0.0012462139129638672 length of segment : 45 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0009355545043945312 length of segment : 48 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0003094673156738281 length of segment : 7 Processing 1 images image shape: (400, 400, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -100.63750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0008835792541503906 length of segment : 44 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 5218 time to create 1 rle with old method : 0.0068590641021728516 length of segment : 126 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1074 time to create 1 rle with old method : 0.0014691352844238281 length of segment : 42 time for calcul the mask position with numpy : 0.00019288063049316406 nb_pixel_total : 3325 time to create 1 rle with old method : 0.004647254943847656 length of segment : 117 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 2207 time to create 1 rle with old method : 0.004184246063232422 length of segment : 43 time for calcul the mask position with numpy : 0.00016832351684570312 nb_pixel_total : 3938 time to create 1 rle with old method : 0.007260799407958984 length of segment : 39 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0025064945220947266 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.48125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0008656978607177734 length of segment : 51 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0007214546203613281 length of segment : 29 time for calcul the mask position with numpy : 9.870529174804688e-05 nb_pixel_total : 2052 time to create 1 rle with old method : 0.0037283897399902344 length of segment : 68 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 222.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 109.67031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 534 time to create 1 rle with old method : 0.0010938644409179688 length of segment : 21 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 766 time to create 1 rle with old method : 0.002248048782348633 length of segment : 54 time for calcul the mask position with numpy : 0.001588582992553711 nb_pixel_total : 52048 time to create 1 rle with old method : 0.08287191390991211 length of segment : 301 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 162.00000 molded_images shape: (1, 640, 640, 3) min: -99.47734 max: 46.56094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -117.39531 max: 135.65078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0003898143768310547 nb_pixel_total : 15047 time to create 1 rle with old method : 0.033026695251464844 length of segment : 214 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 705 time to create 1 rle with old method : 0.0022459030151367188 length of segment : 41 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0008215904235839844 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.29375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0012052059173583984 length of segment : 64 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0004951953887939453 length of segment : 20 time for calcul the mask position with numpy : 0.0002913475036621094 nb_pixel_total : 11940 time to create 1 rle with old method : 0.022332191467285156 length of segment : 130 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0013604164123535156 length of segment : 26 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0012209415435791016 length of segment : 28 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 1169 time to create 1 rle with old method : 0.002301454544067383 length of segment : 51 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 675 time to create 1 rle with old method : 0.0013432502746582031 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.41484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 2304 time to create 1 rle with old method : 0.0046427249908447266 length of segment : 149 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 844 time to create 1 rle with old method : 0.001659393310546875 length of segment : 39 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 1068 time to create 1 rle with old method : 0.002363443374633789 length of segment : 39 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 7396 time to create 1 rle with old method : 0.014606714248657227 length of segment : 207 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 1253 time to create 1 rle with old method : 0.002049684524536133 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.55703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0005154609680175781 length of segment : 19 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.00016951560974121094 length of segment : 7 time for calcul the mask position with numpy : 0.0001246929168701172 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0019059181213378906 length of segment : 139 time for calcul the mask position with numpy : 0.00013947486877441406 nb_pixel_total : 1827 time to create 1 rle with old method : 0.0024170875549316406 length of segment : 87 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0007853507995605469 length of segment : 48 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 1284 time to create 1 rle with old method : 0.001898050308227539 length of segment : 65 Processing 1 images image shape: (280, 400, 3) min: 5.00000 max: 159.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 36.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012524127960205078 nb_pixel_total : 105156 time to create 1 rle with old method : 0.12710094451904297 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.77187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 3109 time to create 1 rle with old method : 0.004099845886230469 length of segment : 49 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00023937225341796875 length of segment : 7 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0004899501800537109 length of segment : 18 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00017690658569335938 length of segment : 12 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00023984909057617188 length of segment : 11 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0015177726745605469 length of segment : 62 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.001028299331665039 length of segment : 45 time for calcul the mask position with numpy : 0.0008528232574462891 nb_pixel_total : 46735 time to create 1 rle with old method : 0.08002614974975586 length of segment : 230 time for calcul the mask position with numpy : 0.00011897087097167969 nb_pixel_total : 1209 time to create 1 rle with old method : 0.0017669200897216797 length of segment : 45 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006482601165771484 length of segment : 23 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 2128 time to create 1 rle with old method : 0.0029582977294921875 length of segment : 39 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 2648 time to create 1 rle with old method : 0.003258228302001953 length of segment : 79 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 252.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.74453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0004153251647949219 length of segment : 14 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003619194030761719 length of segment : 22 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0007510185241699219 length of segment : 23 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0003008842468261719 length of segment : 16 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0004603862762451172 length of segment : 18 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 32 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006823539733886719 length of segment : 29 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0004558563232421875 length of segment : 17 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.0007660388946533203 length of segment : 31 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0009024143218994141 length of segment : 29 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00032901763916015625 length of segment : 13 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006806850433349609 length of segment : 30 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0004482269287109375 length of segment : 15 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00045561790466308594 length of segment : 16 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0006132125854492188 length of segment : 38 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0005381107330322266 length of segment : 15 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 1380 time to create 1 rle with old method : 0.0024416446685791016 length of segment : 44 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0003428459167480469 length of segment : 16 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.007483482360839844 length of segment : 32 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.000885009765625 length of segment : 24 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 28 time to create 1 rle with old method : 0.00018095970153808594 length of segment : 11 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 2043 time to create 1 rle with old method : 0.0038623809814453125 length of segment : 30 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002741813659667969 length of segment : 27 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0006132125854492188 length of segment : 33 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0004961490631103516 length of segment : 18 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 9256 time to create 1 rle with old method : 0.012704133987426758 length of segment : 96 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0007178783416748047 length of segment : 33 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 17 time to create 1 rle with old method : 7.605552673339844e-05 length of segment : 4 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00039315223693847656 length of segment : 37 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.11797 max: 145.20156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 613 time to create 1 rle with old method : 0.0009207725524902344 length of segment : 65 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 821 time to create 1 rle with old method : 0.0014493465423583984 length of segment : 38 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.0012688636779785156 length of segment : 38 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0009725093841552734 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.71172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.0007100105285644531 length of segment : 30 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00013589859008789062 length of segment : 12 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 2737 time to create 1 rle with old method : 0.004317760467529297 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -94.77813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0003039836883544922 nb_pixel_total : 5823 time to create 1 rle with old method : 0.01048135757446289 length of segment : 100 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0016224384307861328 length of segment : 45 time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 9675 time to create 1 rle with old method : 0.017096281051635742 length of segment : 129 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.06719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005571842193603516 length of segment : 34 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00031447410583496094 length of segment : 23 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 2970 time to create 1 rle with old method : 0.004094600677490234 length of segment : 104 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0007090568542480469 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 227.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 113.29531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0008189678192138672 length of segment : 21 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0002589225769042969 length of segment : 12 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 762 time to create 1 rle with old method : 0.0011348724365234375 length of segment : 57 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 2433 time to create 1 rle with old method : 0.003899812698364258 length of segment : 74 time for calcul the mask position with numpy : 0.0005817413330078125 nb_pixel_total : 49581 time to create 1 rle with old method : 0.06080460548400879 length of segment : 245 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 172.00000 molded_images shape: (1, 640, 640, 3) min: -95.71953 max: 50.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -118.00078 max: 124.40469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00017762184143066406 length of segment : 14 time for calcul the mask position with numpy : 0.0002639293670654297 nb_pixel_total : 8507 time to create 1 rle with old method : 0.014734029769897461 length of segment : 120 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0002956390380859375 length of segment : 11 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00060272216796875 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.30156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.0002624988555908203 nb_pixel_total : 13175 time to create 1 rle with old method : 0.01656484603881836 length of segment : 127 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.000469207763671875 length of segment : 42 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1269 time to create 1 rle with old method : 0.002405405044555664 length of segment : 53 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0006754398345947266 length of segment : 22 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0009119510650634766 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.89141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 2219 time to create 1 rle with old method : 0.0032150745391845703 length of segment : 142 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 1144 time to create 1 rle with old method : 0.0016300678253173828 length of segment : 41 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0011227130889892578 length of segment : 36 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00017118453979492188 length of segment : 7 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0016865730285644531 length of segment : 43 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0016617774963378906 length of segment : 40 time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 15263 time to create 1 rle with old method : 0.018340349197387695 length of segment : 224 time for calcul the mask position with numpy : 0.00025391578674316406 nb_pixel_total : 3073 time to create 1 rle with old method : 0.00435948371887207 length of segment : 149 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0006330013275146484 length of segment : 20 time for calcul the mask position with numpy : 0.0001270771026611328 nb_pixel_total : 1114 time to create 1 rle with old method : 0.0021927356719970703 length of segment : 122 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 940 time to create 1 rle with old method : 0.0018181800842285156 length of segment : 37 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.00022220611572265625 length of segment : 7 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 1805 time to create 1 rle with old method : 0.0032567977905273438 length of segment : 84 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 1707 time to create 1 rle with old method : 0.003063678741455078 length of segment : 80 time for calcul the mask position with numpy : 0.0002810955047607422 nb_pixel_total : 4144 time to create 1 rle with old method : 0.007262229919433594 length of segment : 202 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 161.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 37.28359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013477802276611328 nb_pixel_total : 105980 time to create 1 rle with old method : 0.18219637870788574 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.70547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0004899501800537109 length of segment : 19 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 3626 time to create 1 rle with old method : 0.007724285125732422 length of segment : 87 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00024080276489257812 length of segment : 11 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0002372264862060547 length of segment : 8 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00014591217041015625 length of segment : 12 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 2961 time to create 1 rle with old method : 0.005162715911865234 length of segment : 46 time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 45851 time to create 1 rle with old method : 0.07363080978393555 length of segment : 289 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 3081 time to create 1 rle with old method : 0.0053558349609375 length of segment : 47 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 905 time to create 1 rle with old method : 0.0016202926635742188 length of segment : 66 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0005953311920166016 length of segment : 27 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0004470348358154297 length of segment : 11 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.001264810562133789 length of segment : 56 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 289 time to create 1 rle with old method : 0.000598907470703125 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 240.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 121.38125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0005733966827392578 length of segment : 18 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00034880638122558594 length of segment : 17 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00047087669372558594 length of segment : 13 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0007090568542480469 length of segment : 31 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1493 time to create 1 rle with old method : 0.0020482540130615234 length of segment : 49 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006921291351318359 length of segment : 32 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0004374980926513672 length of segment : 16 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005717277526855469 length of segment : 25 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.00030493736267089844 length of segment : 21 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.0021333694458007812 length of segment : 30 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.0012753009796142578 length of segment : 27 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0005979537963867188 length of segment : 15 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0006930828094482422 length of segment : 33 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0007848739624023438 length of segment : 27 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.00030732154846191406 length of segment : 15 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0010311603546142578 length of segment : 32 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0010237693786621094 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.70156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0010561943054199219 length of segment : 23 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0005099773406982422 length of segment : 21 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0003116130828857422 length of segment : 10 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 2109 time to create 1 rle with old method : 0.004127979278564453 length of segment : 25 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0007359981536865234 length of segment : 30 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0003898143768310547 length of segment : 14 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.0006666183471679688 length of segment : 25 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 6 time to create 1 rle with old method : 4.2438507080078125e-05 length of segment : 3 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.001425027847290039 length of segment : 32 time for calcul the mask position with numpy : 0.00017952919006347656 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0022759437561035156 length of segment : 88 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0007343292236328125 length of segment : 25 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0007979869842529297 length of segment : 31 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002796649932861328 length of segment : 32 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.20000 max: 145.63906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 609 time to create 1 rle with old method : 0.001186370849609375 length of segment : 47 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 876 time to create 1 rle with old method : 0.0015621185302734375 length of segment : 41 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 893 time to create 1 rle with old method : 0.0016677379608154297 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00010037422180175781 nb_pixel_total : 803 time to create 1 rle with old method : 0.0015869140625 length of segment : 50 time for calcul the mask position with numpy : 0.00011563301086425781 nb_pixel_total : 2721 time to create 1 rle with old method : 0.005055427551269531 length of segment : 53 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0011565685272216797 length of segment : 56 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 1234 time to create 1 rle with old method : 0.002193450927734375 length of segment : 38 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 668 time to create 1 rle with old method : 0.0012748241424560547 length of segment : 45 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 985 time to create 1 rle with old method : 0.001710653305053711 length of segment : 72 time for calcul the mask position with numpy : 0.00025081634521484375 nb_pixel_total : 5448 time to create 1 rle with old method : 0.009697914123535156 length of segment : 94 time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 6109 time to create 1 rle with old method : 0.010495662689208984 length of segment : 103 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 1059 time to create 1 rle with old method : 0.0018711090087890625 length of segment : 44 time for calcul the mask position with numpy : 0.00016617774963378906 nb_pixel_total : 512 time to create 1 rle with old method : 0.0011107921600341797 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.15703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0009336471557617188 length of segment : 33 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 3185 time to create 1 rle with old method : 0.0060575008392333984 length of segment : 98 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 232.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 110.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0008876323699951172 length of segment : 18 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 845 time to create 1 rle with old method : 0.0011646747589111328 length of segment : 53 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00029921531677246094 length of segment : 11 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0008139610290527344 length of segment : 18 time for calcul the mask position with numpy : 0.0006902217864990234 nb_pixel_total : 58917 time to create 1 rle with old method : 0.07215118408203125 length of segment : 288 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 163.00000 molded_images shape: (1, 640, 640, 3) min: -98.10625 max: 47.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 252.00000 molded_images shape: (1, 640, 640, 3) min: -115.21172 max: 130.69766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.00014400482177734375 length of segment : 13 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0002048015594482422 length of segment : 11 time for calcul the mask position with numpy : 0.0002498626708984375 nb_pixel_total : 9918 time to create 1 rle with old method : 0.014872074127197266 length of segment : 166 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.85234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 649 time to create 1 rle with old method : 0.0014424324035644531 length of segment : 58 time for calcul the mask position with numpy : 0.00028252601623535156 nb_pixel_total : 13454 time to create 1 rle with old method : 0.01784038543701172 length of segment : 132 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0009763240814208984 length of segment : 32 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1625 time to create 1 rle with old method : 0.002321958541870117 length of segment : 26 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002987384796142578 length of segment : 20 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005784034729003906 length of segment : 28 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 669 time to create 1 rle with old method : 0.0009200572967529297 length of segment : 30 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003135204315185547 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.34844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1245 time to create 1 rle with old method : 0.001827239990234375 length of segment : 44 time for calcul the mask position with numpy : 0.00011444091796875 nb_pixel_total : 1618 time to create 1 rle with old method : 0.0021398067474365234 length of segment : 124 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 828 time to create 1 rle with old method : 0.0010862350463867188 length of segment : 36 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.000492095947265625 length of segment : 17 time for calcul the mask position with numpy : 0.0002772808074951172 nb_pixel_total : 7975 time to create 1 rle with old method : 0.011002063751220703 length of segment : 230 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 1283 time to create 1 rle with old method : 0.0016980171203613281 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.07656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0005235671997070312 length of segment : 20 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 583 time to create 1 rle with old method : 0.0008485317230224609 length of segment : 44 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 1887 time to create 1 rle with old method : 0.002498626708984375 length of segment : 90 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0017330646514892578 length of segment : 59 time for calcul the mask position with numpy : 0.00012755393981933594 nb_pixel_total : 3353 time to create 1 rle with old method : 0.005234479904174805 length of segment : 203 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00022745132446289062 length of segment : 7 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0023009777069091797 length of segment : 91 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 159.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 35.76016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0015230178833007812 nb_pixel_total : 106425 time to create 1 rle with old method : 0.16163253784179688 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.77578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00016498565673828125 length of segment : 7 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003299713134765625 length of segment : 18 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00010919570922851562 length of segment : 12 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001971721649169922 length of segment : 12 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 3941 time to create 1 rle with old method : 0.004901885986328125 length of segment : 83 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 2926 time to create 1 rle with old method : 0.003698110580444336 length of segment : 47 time for calcul the mask position with numpy : 0.0005877017974853516 nb_pixel_total : 47713 time to create 1 rle with old method : 0.05677151679992676 length of segment : 238 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006468296051025391 length of segment : 17 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 2572 time to create 1 rle with old method : 0.005285978317260742 length of segment : 50 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0007984638214111328 length of segment : 34 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 236.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 120.85781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0004107952117919922 length of segment : 21 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0004889965057373047 length of segment : 15 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0005342960357666016 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0003502368927001953 length of segment : 14 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0006511211395263672 length of segment : 34 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0007677078247070312 length of segment : 24 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0006575584411621094 length of segment : 32 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0003006458282470703 length of segment : 13 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1239 time to create 1 rle with old method : 0.0022864341735839844 length of segment : 41 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0009119510650634766 length of segment : 29 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0014121532440185547 length of segment : 48 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 687 time to create 1 rle with old method : 0.0013532638549804688 length of segment : 41 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0004856586456298828 length of segment : 23 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 657 time to create 1 rle with old method : 0.0012922286987304688 length of segment : 29 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.00041985511779785156 length of segment : 16 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0005893707275390625 length of segment : 15 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0004665851593017578 length of segment : 19 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.0003612041473388672 length of segment : 11 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 942 time to create 1 rle with old method : 0.0017189979553222656 length of segment : 48 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0007660388946533203 length of segment : 33 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0006234645843505859 length of segment : 31 time for calcul the mask position with numpy : 0.00021982192993164062 nb_pixel_total : 10970 time to create 1 rle with old method : 0.018851041793823242 length of segment : 85 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0007803440093994141 length of segment : 26 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.000823974609375 length of segment : 28 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00032806396484375 length of segment : 35 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.20000 max: 145.17422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 918 time to create 1 rle with old method : 0.001245260238647461 length of segment : 41 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007390975952148438 length of segment : 59 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.91484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0008332729339599609 length of segment : 37 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00028443336486816406 length of segment : 28 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 2266 time to create 1 rle with old method : 0.0032210350036621094 length of segment : 49 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 49 time to create 1 rle with old method : 0.00011181831359863281 length of segment : 7 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 22 time to create 1 rle with old method : 7.319450378417969e-05 length of segment : 3 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 7867 time to create 1 rle with old method : 0.010091304779052734 length of segment : 87 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 859 time to create 1 rle with old method : 0.001134634017944336 length of segment : 40 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 34 time to create 1 rle with old method : 7.557868957519531e-05 length of segment : 6 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00027942657470703125 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -93.89141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.0002167224884033203 nb_pixel_total : 8970 time to create 1 rle with old method : 0.011331319808959961 length of segment : 133 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 6040 time to create 1 rle with old method : 0.007359743118286133 length of segment : 106 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0008654594421386719 length of segment : 41 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 957 time to create 1 rle with old method : 0.0013892650604248047 length of segment : 29 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 969 time to create 1 rle with old method : 0.0012466907501220703 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.17656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006635189056396484 length of segment : 40 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 3355 time to create 1 rle with old method : 0.00539708137512207 length of segment : 102 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00030732154846191406 length of segment : 22 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 239.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 116.35781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0007326602935791016 length of segment : 18 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1649 time to create 1 rle with old method : 0.002164602279663086 length of segment : 42 time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 55726 time to create 1 rle with old method : 0.06239795684814453 length of segment : 312 time for calcul the mask position with numpy : 0.0006721019744873047 nb_pixel_total : 57422 time to create 1 rle with old method : 0.06856465339660645 length of segment : 261 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 171.00000 molded_images shape: (1, 640, 640, 3) min: -97.14531 max: 55.00234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 253.00000 molded_images shape: (1, 640, 640, 3) min: -110.59453 max: 141.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00023674964904785156 length of segment : 17 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 9529 time to create 1 rle with old method : 0.022387981414794922 length of segment : 129 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.00016951560974121094 length of segment : 11 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.0010607242584228516 length of segment : 34 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 841 time to create 1 rle with old method : 0.001115560531616211 length of segment : 36 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.001190185546875 length of segment : 43 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005929470062255859 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.43828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.0002789497375488281 nb_pixel_total : 14593 time to create 1 rle with old method : 0.02360248565673828 length of segment : 134 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1370 time to create 1 rle with old method : 0.002204418182373047 length of segment : 54 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0006513595581054688 length of segment : 48 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0007183551788330078 length of segment : 29 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 693 time to create 1 rle with old method : 0.0009150505065917969 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.64531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 1904 time to create 1 rle with old method : 0.002420186996459961 length of segment : 135 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1137 time to create 1 rle with old method : 0.0020580291748046875 length of segment : 41 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0003762245178222656 length of segment : 20 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 743 time to create 1 rle with old method : 0.0010514259338378906 length of segment : 33 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1264 time to create 1 rle with old method : 0.0016970634460449219 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.37344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0004990100860595703 length of segment : 21 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 646 time to create 1 rle with old method : 0.0009074211120605469 length of segment : 30 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 1761 time to create 1 rle with old method : 0.002811431884765625 length of segment : 85 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1137 time to create 1 rle with old method : 0.0015184879302978516 length of segment : 55 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0007007122039794922 length of segment : 28 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.0001468658447265625 length of segment : 8 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0007207393646240234 length of segment : 31 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 782 time to create 1 rle with old method : 0.001096963882446289 length of segment : 102 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 1315 time to create 1 rle with old method : 0.0020868778228759766 length of segment : 66 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006740093231201172 length of segment : 24 time for calcul the mask position with numpy : 0.00018334388732910156 nb_pixel_total : 3190 time to create 1 rle with old method : 0.003940105438232422 length of segment : 176 time for calcul the mask position with numpy : 0.0001995563507080078 nb_pixel_total : 4020 time to create 1 rle with old method : 0.004925251007080078 length of segment : 201 Processing 1 images image shape: (280, 400, 3) min: 7.00000 max: 158.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 38.61562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009477138519287109 nb_pixel_total : 105410 time to create 1 rle with old method : 0.1237185001373291 length of segment : 278 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0004470348358154297 length of segment : 15 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 809 time to create 1 rle with old method : 0.0014767646789550781 length of segment : 70 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00016951560974121094 length of segment : 7 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00011539459228515625 length of segment : 12 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 2946 time to create 1 rle with old method : 0.0039005279541015625 length of segment : 38 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.00020051002502441406 length of segment : 11 time for calcul the mask position with numpy : 0.00014495849609375 nb_pixel_total : 3610 time to create 1 rle with old method : 0.004777431488037109 length of segment : 74 time for calcul the mask position with numpy : 0.00096893310546875 nb_pixel_total : 46403 time to create 1 rle with old method : 0.057126760482788086 length of segment : 235 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004737377166748047 length of segment : 19 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 3245 time to create 1 rle with old method : 0.005257129669189453 length of segment : 50 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 785 time to create 1 rle with old method : 0.0010442733764648438 length of segment : 70 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.68984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.0004737377166748047 length of segment : 14 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0005784034729003906 length of segment : 17 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.000385284423828125 length of segment : 20 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0005998611450195312 length of segment : 17 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0008127689361572266 length of segment : 24 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0003447532653808594 length of segment : 18 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 608 time to create 1 rle with old method : 0.0011565685272216797 length of segment : 27 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0011584758758544922 length of segment : 37 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 961 time to create 1 rle with old method : 0.0017969608306884766 length of segment : 37 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0007765293121337891 length of segment : 36 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 15 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1379 time to create 1 rle with old method : 0.002508878707885742 length of segment : 46 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0008301734924316406 length of segment : 37 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0010387897491455078 length of segment : 32 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.000553131103515625 length of segment : 18 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0008029937744140625 length of segment : 28 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 55 time to create 1 rle with old method : 9.703636169433594e-05 length of segment : 17 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007419586181640625 length of segment : 63 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002849102020263672 length of segment : 15 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.46719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0015985965728759766 length of segment : 43 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003657341003417969 length of segment : 30 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 28 time to create 1 rle with old method : 8.344650268554688e-05 length of segment : 10 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1826 time to create 1 rle with old method : 0.0027663707733154297 length of segment : 24 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0018336772918701172 length of segment : 31 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0007860660552978516 length of segment : 32 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.00047707557678222656 length of segment : 18 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0007617473602294922 length of segment : 26 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00042939186096191406 length of segment : 36 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.93438 max: 145.57266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.00087738037109375 length of segment : 53 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 890 time to create 1 rle with old method : 0.0012390613555908203 length of segment : 43 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 897 time to create 1 rle with old method : 0.0011894702911376953 length of segment : 38 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.0012743473052978516 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.47734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0008893013000488281 length of segment : 36 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1067 time to create 1 rle with old method : 0.0018305778503417969 length of segment : 55 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 2271 time to create 1 rle with old method : 0.004015922546386719 length of segment : 58 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 36 time to create 1 rle with old method : 0.00010657310485839844 length of segment : 6 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0003533363342285156 length of segment : 17 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00036025047302246094 length of segment : 15 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 23 time to create 1 rle with old method : 8.654594421386719e-05 length of segment : 5 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 909 time to create 1 rle with old method : 0.0012767314910888672 length of segment : 39 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0005519390106201172 length of segment : 36 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0020318031311035156 length of segment : 58 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.00039577484130859375 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.72734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 5829 time to create 1 rle with old method : 0.007550239562988281 length of segment : 103 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006716251373291016 length of segment : 22 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0010645389556884766 length of segment : 39 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 5640 time to create 1 rle with old method : 0.007052898406982422 length of segment : 109 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.93828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1932 time to create 1 rle with old method : 0.002420663833618164 length of segment : 60 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.0008780956268310547 length of segment : 73 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 450 time to create 1 rle with old method : 0.0007789134979248047 length of segment : 26 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 736 time to create 1 rle with old method : 0.0010259151458740234 length of segment : 66 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0008444786071777344 length of segment : 27 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 221.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 109.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0010259151458740234 length of segment : 20 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1569 time to create 1 rle with old method : 0.001990795135498047 length of segment : 88 time for calcul the mask position with numpy : 0.0006768703460693359 nb_pixel_total : 59275 time to create 1 rle with old method : 0.06741070747375488 length of segment : 247 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 164.00000 molded_images shape: (1, 640, 640, 3) min: -96.59844 max: 48.71328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -115.21172 max: 133.36562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001418590545654297 length of segment : 16 time for calcul the mask position with numpy : 0.0001468658447265625 nb_pixel_total : 7664 time to create 1 rle with old method : 0.009663581848144531 length of segment : 104 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.67656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 10628 time to create 1 rle with old method : 0.012709617614746094 length of segment : 114 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1213 time to create 1 rle with old method : 0.0015816688537597656 length of segment : 51 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003523826599121094 length of segment : 48 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006809234619140625 length of segment : 27 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0003209114074707031 length of segment : 20 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003628730773925781 length of segment : 20 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008983612060546875 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.58672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 2033 time to create 1 rle with old method : 0.002586841583251953 length of segment : 140 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1232 time to create 1 rle with old method : 0.0017626285552978516 length of segment : 44 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 830 time to create 1 rle with old method : 0.0011181831359863281 length of segment : 36 time for calcul the mask position with numpy : 0.0002911090850830078 nb_pixel_total : 14639 time to create 1 rle with old method : 0.017600297927856445 length of segment : 296 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1268 time to create 1 rle with old method : 0.0015621185302734375 length of segment : 43 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 6429 time to create 1 rle with old method : 0.007911205291748047 length of segment : 161 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1274 time to create 1 rle with old method : 0.0015993118286132812 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.20547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0005004405975341797 length of segment : 21 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0011641979217529297 length of segment : 45 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 1815 time to create 1 rle with old method : 0.0024292469024658203 length of segment : 86 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.0001690387725830078 length of segment : 7 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 859 time to create 1 rle with old method : 0.001190185546875 length of segment : 67 time for calcul the mask position with numpy : 0.00011086463928222656 nb_pixel_total : 2675 time to create 1 rle with old method : 0.0033445358276367188 length of segment : 75 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 812 time to create 1 rle with old method : 0.001180887222290039 length of segment : 70 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0006482601165771484 length of segment : 24 Processing 1 images image shape: (280, 400, 3) min: 3.00000 max: 160.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 39.74062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001203775405883789 nb_pixel_total : 105431 time to create 1 rle with old method : 0.11960530281066895 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.70547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001747608184814453 length of segment : 7 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 3064 time to create 1 rle with old method : 0.004116535186767578 length of segment : 48 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 931 time to create 1 rle with old method : 0.001253366470336914 length of segment : 66 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00019049644470214844 length of segment : 11 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 55 time to create 1 rle with old method : 9.822845458984375e-05 length of segment : 11 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007526874542236328 length of segment : 46 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 976 time to create 1 rle with old method : 0.0013337135314941406 length of segment : 54 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 19 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 3682 time to create 1 rle with old method : 0.00474238395690918 length of segment : 50 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 243.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 125.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004889965057373047 length of segment : 18 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00038623809814453125 length of segment : 15 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.00047135353088378906 length of segment : 17 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009043216705322266 length of segment : 26 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00023674964904785156 length of segment : 14 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 878 time to create 1 rle with old method : 0.0011832714080810547 length of segment : 43 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006439685821533203 length of segment : 29 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 25 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005006790161132812 length of segment : 34 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004115104675292969 length of segment : 15 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0016641616821289062 length of segment : 43 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005769729614257812 length of segment : 30 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007989406585693359 length of segment : 31 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00010275840759277344 length of segment : 16 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0008692741394042969 length of segment : 45 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1397 time to create 1 rle with old method : 0.0018012523651123047 length of segment : 47 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0012006759643554688 length of segment : 31 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 16 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007393360137939453 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00020170211791992188 nb_pixel_total : 9528 time to create 1 rle with old method : 0.011384248733520508 length of segment : 99 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 613 time to create 1 rle with old method : 0.0008423328399658203 length of segment : 42 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002665519714355469 length of segment : 15 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002129077911376953 length of segment : 9 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005919933319091797 length of segment : 37 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00023031234741210938 length of segment : 27 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 2252 time to create 1 rle with old method : 0.0029897689819335938 length of segment : 26 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003170967102050781 length of segment : 27 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004687309265136719 length of segment : 31 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00045990943908691406 nb_pixel_total : 255 time to create 1 rle with old method : 0.0005731582641601562 length of segment : 42 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 543 time to create 1 rle with old method : 0.0008089542388916016 length of segment : 78 Detection mask done ! Trying to reset tf kernel 3071592 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3890 tf kernel not reseted sub process len(results) : 438 len(list_Values) 438 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 438 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5083 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 438 chid ids of type : 4228 Number RLEs to save : 22783 save missing photos in datou_result : time spend for datou_step_exec : 43.36840581893921 time spend to save output : 1.7053306102752686 total time spend for step 1 : 45.07373642921448 step2:brightness Fri Feb 28 05:21:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740716430_3070810_1339964345_ff79321d0a39d0e4bd257b86430d9a5f.jpg treat image : temp/1740716430_3070810_1339964341_f83f23aa16b18c040c6dfb3cce787c36.jpg treat image : temp/1740716430_3070810_1339964338_9868933c349639169a8b25765518c076.jpg treat image : temp/1740716430_3070810_1339964333_010f599e44bed5cb6b4c19b00fe06a40.jpg treat image : temp/1740716430_3070810_1339964325_b0f46142face101aac926484ef110a01.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.013951539993286133 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.014550447463989258 save missing photos in datou_result : time spend for datou_step_exec : 1.3612632751464844 time spend to save output : 0.03310990333557129 total time spend for step 2 : 1.3943731784820557 step3:blur_detection Fri Feb 28 05:21:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740716430_3070810_1339964345_ff79321d0a39d0e4bd257b86430d9a5f.jpg resize: (1080, 1920) 1339964345 -7.044891895387023 treat image : temp/1740716430_3070810_1339964341_f83f23aa16b18c040c6dfb3cce787c36.jpg resize: (1080, 1920) 1339964341 -7.0231358313947725 treat image : temp/1740716430_3070810_1339964338_9868933c349639169a8b25765518c076.jpg resize: (1080, 1920) 1339964338 -7.054640511523418 treat image : temp/1740716430_3070810_1339964333_010f599e44bed5cb6b4c19b00fe06a40.jpg resize: (1080, 1920) 1339964333 -7.033384610832983 treat image : temp/1740716430_3070810_1339964325_b0f46142face101aac926484ef110a01.jpg resize: (1080, 1920) 1339964325 -7.060390605880712 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.014444351196289062 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.013430595397949219 save missing photos in datou_result : time spend for datou_step_exec : 5.3574378490448 time spend to save output : 0.03312373161315918 total time spend for step 3 : 5.390561580657959 step4:rle_unique_nms_with_priority Fri Feb 28 05:21:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 438 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 85 nb_hashtags : 6 time to prepare the origin masks : 1.221752643585205 time for calcul the mask position with numpy : 0.07580137252807617 nb_pixel_total : 1767101 time to create 1 rle with new method : 0.46335744857788086 time for calcul the mask position with numpy : 0.012107133865356445 nb_pixel_total : 77 time to create 1 rle with old method : 0.0001399517059326172 time for calcul the mask position with numpy : 0.009088516235351562 nb_pixel_total : 135 time to create 1 rle with old method : 0.00021123886108398438 time for calcul the mask position with numpy : 0.009162664413452148 nb_pixel_total : 3325 time to create 1 rle with old method : 0.004106044769287109 time for calcul the mask position with numpy : 0.010866880416870117 nb_pixel_total : 619 time to create 1 rle with old method : 0.0011892318725585938 time for calcul the mask position with numpy : 0.009490251541137695 nb_pixel_total : 1504 time to create 1 rle with old method : 0.0017635822296142578 time for calcul the mask position with numpy : 0.008380413055419922 nb_pixel_total : 899 time to create 1 rle with old method : 0.0010323524475097656 time for calcul the mask position with numpy : 0.008382081985473633 nb_pixel_total : 573 time to create 1 rle with old method : 0.0006756782531738281 time for calcul the mask position with numpy : 0.008378028869628906 nb_pixel_total : 106 time to create 1 rle with old method : 0.0001590251922607422 time for calcul the mask position with numpy : 0.008384943008422852 nb_pixel_total : 152 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.008392810821533203 nb_pixel_total : 2457 time to create 1 rle with old method : 0.002773284912109375 time for calcul the mask position with numpy : 0.008692026138305664 nb_pixel_total : 52048 time to create 1 rle with old method : 0.06083536148071289 time for calcul the mask position with numpy : 0.008455753326416016 nb_pixel_total : 1074 time to create 1 rle with old method : 0.0012178421020507812 time for calcul the mask position with numpy : 0.008432865142822266 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006277561187744141 time for calcul the mask position with numpy : 0.008409500122070312 nb_pixel_total : 685 time to create 1 rle with old method : 0.0007987022399902344 time for calcul the mask position with numpy : 0.00839543342590332 nb_pixel_total : 940 time to create 1 rle with old method : 0.001064300537109375 time for calcul the mask position with numpy : 0.008514642715454102 nb_pixel_total : 1144 time to create 1 rle with old method : 0.0012946128845214844 time for calcul the mask position with numpy : 0.00855565071105957 nb_pixel_total : 3925 time to create 1 rle with old method : 0.004488706588745117 time for calcul the mask position with numpy : 0.010227441787719727 nb_pixel_total : 2207 time to create 1 rle with old method : 0.002497434616088867 time for calcul the mask position with numpy : 0.008517980575561523 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005421638488769531 time for calcul the mask position with numpy : 0.008624553680419922 nb_pixel_total : 5218 time to create 1 rle with old method : 0.006099224090576172 time for calcul the mask position with numpy : 0.008764505386352539 nb_pixel_total : 2052 time to create 1 rle with old method : 0.0023047924041748047 time for calcul the mask position with numpy : 0.008683443069458008 nb_pixel_total : 766 time to create 1 rle with old method : 0.0008819103240966797 time for calcul the mask position with numpy : 0.009102106094360352 nb_pixel_total : 534 time to create 1 rle with old method : 0.0006413459777832031 time for calcul the mask position with numpy : 0.008678913116455078 nb_pixel_total : 7396 time to create 1 rle with old method : 0.00865936279296875 time for calcul the mask position with numpy : 0.00855565071105957 nb_pixel_total : 675 time to create 1 rle with old method : 0.0007586479187011719 time for calcul the mask position with numpy : 0.008522272109985352 nb_pixel_total : 844 time to create 1 rle with old method : 0.0010528564453125 time for calcul the mask position with numpy : 0.00861215591430664 nb_pixel_total : 1253 time to create 1 rle with old method : 0.0014085769653320312 time for calcul the mask position with numpy : 0.008593320846557617 nb_pixel_total : 11940 time to create 1 rle with old method : 0.013566970825195312 time for calcul the mask position with numpy : 0.008592844009399414 nb_pixel_total : 15047 time to create 1 rle with old method : 0.024150609970092773 time for calcul the mask position with numpy : 0.00953817367553711 nb_pixel_total : 488 time to create 1 rle with old method : 0.0008192062377929688 time for calcul the mask position with numpy : 0.009531021118164062 nb_pixel_total : 289 time to create 1 rle with old method : 0.0004696846008300781 time for calcul the mask position with numpy : 0.009517669677734375 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0022869110107421875 time for calcul the mask position with numpy : 0.009571075439453125 nb_pixel_total : 2304 time to create 1 rle with old method : 0.0038683414459228516 time for calcul the mask position with numpy : 0.00968623161315918 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008530616760253906 time for calcul the mask position with numpy : 0.008527994155883789 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006220340728759766 time for calcul the mask position with numpy : 0.00849604606628418 nb_pixel_total : 34 time to create 1 rle with old method : 5.626678466796875e-05 time for calcul the mask position with numpy : 0.008481025695800781 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0013604164123535156 time for calcul the mask position with numpy : 0.008539438247680664 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011515617370605469 time for calcul the mask position with numpy : 0.008511781692504883 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006401538848876953 time for calcul the mask position with numpy : 0.008465290069580078 nb_pixel_total : 70 time to create 1 rle with old method : 9.298324584960938e-05 time for calcul the mask position with numpy : 0.008450746536254883 nb_pixel_total : 1068 time to create 1 rle with old method : 0.001241445541381836 time for calcul the mask position with numpy : 0.008454084396362305 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005240440368652344 time for calcul the mask position with numpy : 0.008407831192016602 nb_pixel_total : 1827 time to create 1 rle with old method : 0.0021517276763916016 time for calcul the mask position with numpy : 0.008407831192016602 nb_pixel_total : 705 time to create 1 rle with old method : 0.0008103847503662109 time for calcul the mask position with numpy : 0.00932455062866211 nb_pixel_total : 105156 time to create 1 rle with old method : 0.14947724342346191 time for calcul the mask position with numpy : 0.009644508361816406 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005123615264892578 time for calcul the mask position with numpy : 0.008947372436523438 nb_pixel_total : 43578 time to create 1 rle with old method : 0.056226253509521484 time for calcul the mask position with numpy : 0.009751081466674805 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003554821014404297 time for calcul the mask position with numpy : 0.009721040725708008 nb_pixel_total : 71 time to create 1 rle with old method : 0.0001342296600341797 time for calcul the mask position with numpy : 0.009802103042602539 nb_pixel_total : 110 time to create 1 rle with old method : 0.00019502639770507812 time for calcul the mask position with numpy : 0.013851404190063477 nb_pixel_total : 89 time to create 1 rle with old method : 0.00017023086547851562 time for calcul the mask position with numpy : 0.009780645370483398 nb_pixel_total : 230 time to create 1 rle with old method : 0.00027680397033691406 time for calcul the mask position with numpy : 0.010619401931762695 nb_pixel_total : 3109 time to create 1 rle with old method : 0.005776882171630859 time for calcul the mask position with numpy : 0.014273405075073242 nb_pixel_total : 667 time to create 1 rle with old method : 0.0012896060943603516 time for calcul the mask position with numpy : 0.014177322387695312 nb_pixel_total : 596 time to create 1 rle with old method : 0.0010924339294433594 time for calcul the mask position with numpy : 0.011749029159545898 nb_pixel_total : 194 time to create 1 rle with old method : 0.00037169456481933594 time for calcul the mask position with numpy : 0.011199474334716797 nb_pixel_total : 6 time to create 1 rle with old method : 4.38690185546875e-05 time for calcul the mask position with numpy : 0.011282920837402344 nb_pixel_total : 384 time to create 1 rle with old method : 0.0007333755493164062 time for calcul the mask position with numpy : 0.011235237121582031 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002949237823486328 time for calcul the mask position with numpy : 0.011400222778320312 nb_pixel_total : 273 time to create 1 rle with old method : 0.0005362033843994141 time for calcul the mask position with numpy : 0.011174201965332031 nb_pixel_total : 621 time to create 1 rle with old method : 0.001249074935913086 time for calcul the mask position with numpy : 0.011266708374023438 nb_pixel_total : 92 time to create 1 rle with old method : 0.00021076202392578125 time for calcul the mask position with numpy : 0.011391401290893555 nb_pixel_total : 308 time to create 1 rle with old method : 0.0005924701690673828 time for calcul the mask position with numpy : 0.011112451553344727 nb_pixel_total : 381 time to create 1 rle with old method : 0.0014071464538574219 time for calcul the mask position with numpy : 0.011274099349975586 nb_pixel_total : 2038 time to create 1 rle with old method : 0.0037910938262939453 time for calcul the mask position with numpy : 0.012703657150268555 nb_pixel_total : 813 time to create 1 rle with old method : 0.001543283462524414 time for calcul the mask position with numpy : 0.011205673217773438 nb_pixel_total : 394 time to create 1 rle with old method : 0.0007686614990234375 time for calcul the mask position with numpy : 0.013761758804321289 nb_pixel_total : 17 time to create 1 rle with old method : 5.5789947509765625e-05 time for calcul the mask position with numpy : 0.011372089385986328 nb_pixel_total : 9256 time to create 1 rle with old method : 0.016809701919555664 time for calcul the mask position with numpy : 0.011280298233032227 nb_pixel_total : 1380 time to create 1 rle with old method : 0.002505064010620117 time for calcul the mask position with numpy : 0.011402368545532227 nb_pixel_total : 557 time to create 1 rle with old method : 0.0010371208190917969 time for calcul the mask position with numpy : 0.010985374450683594 nb_pixel_total : 28 time to create 1 rle with old method : 0.00011205673217773438 time for calcul the mask position with numpy : 0.011213064193725586 nb_pixel_total : 188 time to create 1 rle with old method : 0.00038242340087890625 time for calcul the mask position with numpy : 0.011147499084472656 nb_pixel_total : 483 time to create 1 rle with old method : 0.000888824462890625 time for calcul the mask position with numpy : 0.011031627655029297 nb_pixel_total : 356 time to create 1 rle with old method : 0.0006690025329589844 time for calcul the mask position with numpy : 0.011095285415649414 nb_pixel_total : 202 time to create 1 rle with old method : 0.00040459632873535156 time for calcul the mask position with numpy : 0.010795354843139648 nb_pixel_total : 457 time to create 1 rle with old method : 0.0008561611175537109 time for calcul the mask position with numpy : 0.010933876037597656 nb_pixel_total : 232 time to create 1 rle with old method : 0.00044465065002441406 time for calcul the mask position with numpy : 0.010836124420166016 nb_pixel_total : 582 time to create 1 rle with old method : 0.0010776519775390625 time for calcul the mask position with numpy : 0.010942459106445312 nb_pixel_total : 126 time to create 1 rle with old method : 0.0006361007690429688 time for calcul the mask position with numpy : 0.010992288589477539 nb_pixel_total : 2128 time to create 1 rle with old method : 0.003914594650268555 time for calcul the mask position with numpy : 0.011089086532592773 nb_pixel_total : 213 time to create 1 rle with old method : 0.00043129920959472656 time for calcul the mask position with numpy : 0.04927206039428711 nb_pixel_total : 21 time to create 1 rle with old method : 9.489059448242188e-05 time for calcul the mask position with numpy : 0.011095046997070312 nb_pixel_total : 254 time to create 1 rle with old method : 0.0004889965057373047 time for calcul the mask position with numpy : 0.011343240737915039 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005609989166259766 create new chi : 1.8634769916534424 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.011440753936767578 batch 1 Loaded 86 chid ids of type : 4230 Number RLEs to save : 9553 TO DO : save crop sub photo not yet done ! save time : 0.7186324596405029 nb_obj : 86 nb_hashtags : 5 time to prepare the origin masks : 2.3505191802978516 time for calcul the mask position with numpy : 0.4521007537841797 nb_pixel_total : 1768522 time to create 1 rle with new method : 0.20360064506530762 time for calcul the mask position with numpy : 0.008231639862060547 nb_pixel_total : 9675 time to create 1 rle with old method : 0.012969017028808594 time for calcul the mask position with numpy : 0.007365703582763672 nb_pixel_total : 840 time to create 1 rle with old method : 0.0015163421630859375 time for calcul the mask position with numpy : 0.007620096206665039 nb_pixel_total : 117 time to create 1 rle with old method : 0.0003247261047363281 time for calcul the mask position with numpy : 0.007942914962768555 nb_pixel_total : 821 time to create 1 rle with old method : 0.0014271736145019531 time for calcul the mask position with numpy : 0.007523059844970703 nb_pixel_total : 613 time to create 1 rle with old method : 0.001110076904296875 time for calcul the mask position with numpy : 0.0074427127838134766 nb_pixel_total : 513 time to create 1 rle with old method : 0.0008552074432373047 time for calcul the mask position with numpy : 0.0076596736907958984 nb_pixel_total : 49581 time to create 1 rle with old method : 0.06676888465881348 time for calcul the mask position with numpy : 0.0067272186279296875 nb_pixel_total : 103 time to create 1 rle with old method : 0.00018978118896484375 time for calcul the mask position with numpy : 0.007123470306396484 nb_pixel_total : 2737 time to create 1 rle with old method : 0.0031385421752929688 time for calcul the mask position with numpy : 0.007013559341430664 nb_pixel_total : 66 time to create 1 rle with old method : 9.608268737792969e-05 time for calcul the mask position with numpy : 0.00705409049987793 nb_pixel_total : 368 time to create 1 rle with old method : 0.0004436969757080078 time for calcul the mask position with numpy : 0.00631403923034668 nb_pixel_total : 178 time to create 1 rle with old method : 0.00022339820861816406 time for calcul the mask position with numpy : 0.006180763244628906 nb_pixel_total : 5823 time to create 1 rle with old method : 0.0067865848541259766 time for calcul the mask position with numpy : 0.006623506546020508 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005519390106201172 time for calcul the mask position with numpy : 0.00624537467956543 nb_pixel_total : 2970 time to create 1 rle with old method : 0.003447294235229492 time for calcul the mask position with numpy : 0.006170749664306641 nb_pixel_total : 135 time to create 1 rle with old method : 0.00018358230590820312 time for calcul the mask position with numpy : 0.0064830780029296875 nb_pixel_total : 2355 time to create 1 rle with old method : 0.002718210220336914 time for calcul the mask position with numpy : 0.006428718566894531 nb_pixel_total : 762 time to create 1 rle with old method : 0.0008881092071533203 time for calcul the mask position with numpy : 0.006257057189941406 nb_pixel_total : 553 time to create 1 rle with old method : 0.0007152557373046875 time for calcul the mask position with numpy : 0.011088371276855469 nb_pixel_total : 15263 time to create 1 rle with old method : 0.024590015411376953 time for calcul the mask position with numpy : 0.011402368545532227 nb_pixel_total : 653 time to create 1 rle with old method : 0.0010714530944824219 time for calcul the mask position with numpy : 0.011426210403442383 nb_pixel_total : 1753 time to create 1 rle with old method : 0.0030088424682617188 time for calcul the mask position with numpy : 0.007404804229736328 nb_pixel_total : 815 time to create 1 rle with old method : 0.0013532638549804688 time for calcul the mask position with numpy : 0.0073261260986328125 nb_pixel_total : 13175 time to create 1 rle with old method : 0.01785421371459961 time for calcul the mask position with numpy : 0.006781101226806641 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0014424324035644531 time for calcul the mask position with numpy : 0.006499290466308594 nb_pixel_total : 45 time to create 1 rle with old method : 7.843971252441406e-05 time for calcul the mask position with numpy : 0.006579160690307617 nb_pixel_total : 8507 time to create 1 rle with old method : 0.011301279067993164 time for calcul the mask position with numpy : 0.0066318511962890625 nb_pixel_total : 940 time to create 1 rle with old method : 0.0011866092681884766 time for calcul the mask position with numpy : 0.006579160690307617 nb_pixel_total : 311 time to create 1 rle with old method : 0.0003960132598876953 time for calcul the mask position with numpy : 0.006505727767944336 nb_pixel_total : 1114 time to create 1 rle with old method : 0.0014615058898925781 time for calcul the mask position with numpy : 0.007018566131591797 nb_pixel_total : 2219 time to create 1 rle with old method : 0.002613067626953125 time for calcul the mask position with numpy : 0.006418704986572266 nb_pixel_total : 4144 time to create 1 rle with old method : 0.004803895950317383 time for calcul the mask position with numpy : 0.0063838958740234375 nb_pixel_total : 299 time to create 1 rle with old method : 0.00035834312438964844 time for calcul the mask position with numpy : 0.00651860237121582 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0014543533325195312 time for calcul the mask position with numpy : 0.006500244140625 nb_pixel_total : 120 time to create 1 rle with old method : 0.00016355514526367188 time for calcul the mask position with numpy : 0.006078958511352539 nb_pixel_total : 69 time to create 1 rle with old method : 0.00010418891906738281 time for calcul the mask position with numpy : 0.00641179084777832 nb_pixel_total : 1144 time to create 1 rle with old method : 0.0013852119445800781 time for calcul the mask position with numpy : 0.0067234039306640625 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005559921264648438 time for calcul the mask position with numpy : 0.006455898284912109 nb_pixel_total : 72 time to create 1 rle with old method : 0.00010228157043457031 time for calcul the mask position with numpy : 0.006332874298095703 nb_pixel_total : 1805 time to create 1 rle with old method : 0.0020599365234375 time for calcul the mask position with numpy : 0.006508827209472656 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001201629638671875 time for calcul the mask position with numpy : 0.006685972213745117 nb_pixel_total : 11 time to create 1 rle with old method : 5.435943603515625e-05 time for calcul the mask position with numpy : 0.0064966678619384766 nb_pixel_total : 110 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.00658416748046875 nb_pixel_total : 105980 time to create 1 rle with old method : 0.11595845222473145 time for calcul the mask position with numpy : 0.0067899227142333984 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002827644348144531 time for calcul the mask position with numpy : 0.006910562515258789 nb_pixel_total : 39706 time to create 1 rle with old method : 0.04872441291809082 time for calcul the mask position with numpy : 0.0065348148345947266 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003757476806640625 time for calcul the mask position with numpy : 0.006191253662109375 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001723766326904297 time for calcul the mask position with numpy : 0.006209135055541992 nb_pixel_total : 59 time to create 1 rle with old method : 8.630752563476562e-05 time for calcul the mask position with numpy : 0.00611114501953125 nb_pixel_total : 106 time to create 1 rle with old method : 0.00014019012451171875 time for calcul the mask position with numpy : 0.006063222885131836 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012493133544921875 time for calcul the mask position with numpy : 0.006265401840209961 nb_pixel_total : 176 time to create 1 rle with old method : 0.00022292137145996094 time for calcul the mask position with numpy : 0.006341218948364258 nb_pixel_total : 249 time to create 1 rle with old method : 0.00029850006103515625 time for calcul the mask position with numpy : 0.00633692741394043 nb_pixel_total : 351 time to create 1 rle with old method : 0.00041174888610839844 time for calcul the mask position with numpy : 0.006183147430419922 nb_pixel_total : 880 time to create 1 rle with old method : 0.0010194778442382812 time for calcul the mask position with numpy : 0.006482124328613281 nb_pixel_total : 2961 time to create 1 rle with old method : 0.0033416748046875 time for calcul the mask position with numpy : 0.006417512893676758 nb_pixel_total : 666 time to create 1 rle with old method : 0.0007610321044921875 time for calcul the mask position with numpy : 0.006266355514526367 nb_pixel_total : 3626 time to create 1 rle with old method : 0.00408935546875 time for calcul the mask position with numpy : 0.006522417068481445 nb_pixel_total : 1009 time to create 1 rle with old method : 0.001169443130493164 time for calcul the mask position with numpy : 0.006509304046630859 nb_pixel_total : 140 time to create 1 rle with old method : 0.0001800060272216797 time for calcul the mask position with numpy : 0.0064792633056640625 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006363391876220703 time for calcul the mask position with numpy : 0.006853818893432617 nb_pixel_total : 268 time to create 1 rle with old method : 0.00032591819763183594 time for calcul the mask position with numpy : 0.006695985794067383 nb_pixel_total : 696 time to create 1 rle with old method : 0.0008084774017333984 time for calcul the mask position with numpy : 0.006615638732910156 nb_pixel_total : 90 time to create 1 rle with old method : 0.00013184547424316406 time for calcul the mask position with numpy : 0.006105899810791016 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004115104675292969 time for calcul the mask position with numpy : 0.006091594696044922 nb_pixel_total : 2109 time to create 1 rle with old method : 0.0024118423461914062 time for calcul the mask position with numpy : 0.006163597106933594 nb_pixel_total : 146 time to create 1 rle with old method : 0.0001933574676513672 time for calcul the mask position with numpy : 0.006114482879638672 nb_pixel_total : 905 time to create 1 rle with old method : 0.0010938644409179688 time for calcul the mask position with numpy : 0.00587153434753418 nb_pixel_total : 401 time to create 1 rle with old method : 0.0004870891571044922 time for calcul the mask position with numpy : 0.006113290786743164 nb_pixel_total : 1493 time to create 1 rle with old method : 0.00170135498046875 time for calcul the mask position with numpy : 0.006220102310180664 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006265640258789062 time for calcul the mask position with numpy : 0.006071329116821289 nb_pixel_total : 6 time to create 1 rle with old method : 2.86102294921875e-05 time for calcul the mask position with numpy : 0.005993843078613281 nb_pixel_total : 32 time to create 1 rle with old method : 7.796287536621094e-05 time for calcul the mask position with numpy : 0.0068662166595458984 nb_pixel_total : 382 time to create 1 rle with old method : 0.00045037269592285156 time for calcul the mask position with numpy : 0.010219335556030273 nb_pixel_total : 155 time to create 1 rle with old method : 0.00020456314086914062 time for calcul the mask position with numpy : 0.010271072387695312 nb_pixel_total : 497 time to create 1 rle with old method : 0.0005886554718017578 time for calcul the mask position with numpy : 0.010341405868530273 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005445480346679688 time for calcul the mask position with numpy : 0.01020193099975586 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002529621124267578 time for calcul the mask position with numpy : 0.010351896286010742 nb_pixel_total : 227 time to create 1 rle with old method : 0.00027561187744140625 time for calcul the mask position with numpy : 0.01174163818359375 nb_pixel_total : 3034 time to create 1 rle with old method : 0.003468751907348633 time for calcul the mask position with numpy : 0.010232210159301758 nb_pixel_total : 249 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.010392189025878906 nb_pixel_total : 319 time to create 1 rle with old method : 0.0003829002380371094 time for calcul the mask position with numpy : 0.010479450225830078 nb_pixel_total : 375 time to create 1 rle with old method : 0.00044226646423339844 time for calcul the mask position with numpy : 0.010259151458740234 nb_pixel_total : 241 time to create 1 rle with old method : 0.0002956390380859375 time for calcul the mask position with numpy : 0.010228633880615234 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.010474443435668945 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001773834228515625 create new chi : 1.6728284358978271 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001399993896484375 batch 1 Loaded 87 chid ids of type : 4230 Number RLEs to save : 9499 TO DO : save crop sub photo not yet done ! save time : 0.8802759647369385 nb_obj : 79 nb_hashtags : 5 time to prepare the origin masks : 1.460498571395874 time for calcul the mask position with numpy : 0.02305459976196289 nb_pixel_total : 1761346 time to create 1 rle with new method : 0.043819427490234375 time for calcul the mask position with numpy : 0.00751948356628418 nb_pixel_total : 512 time to create 1 rle with old method : 0.0007061958312988281 time for calcul the mask position with numpy : 0.0074384212493896484 nb_pixel_total : 1234 time to create 1 rle with old method : 0.0016040802001953125 time for calcul the mask position with numpy : 0.0075206756591796875 nb_pixel_total : 985 time to create 1 rle with old method : 0.0015516281127929688 time for calcul the mask position with numpy : 0.008862972259521484 nb_pixel_total : 5448 time to create 1 rle with old method : 0.006961345672607422 time for calcul the mask position with numpy : 0.013737678527832031 nb_pixel_total : 803 time to create 1 rle with old method : 0.001129150390625 time for calcul the mask position with numpy : 0.012905597686767578 nb_pixel_total : 876 time to create 1 rle with old method : 0.0012202262878417969 time for calcul the mask position with numpy : 0.012052059173583984 nb_pixel_total : 609 time to create 1 rle with old method : 0.0008172988891601562 time for calcul the mask position with numpy : 0.01235198974609375 nb_pixel_total : 668 time to create 1 rle with old method : 0.000965118408203125 time for calcul the mask position with numpy : 0.012547969818115234 nb_pixel_total : 91 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.012978792190551758 nb_pixel_total : 2721 time to create 1 rle with old method : 0.004278898239135742 time for calcul the mask position with numpy : 0.013405084609985352 nb_pixel_total : 58917 time to create 1 rle with old method : 0.07091689109802246 time for calcul the mask position with numpy : 0.0071563720703125 nb_pixel_total : 1059 time to create 1 rle with old method : 0.0013360977172851562 time for calcul the mask position with numpy : 0.006757497787475586 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005362033843994141 time for calcul the mask position with numpy : 0.006506681442260742 nb_pixel_total : 638 time to create 1 rle with old method : 0.0011372566223144531 time for calcul the mask position with numpy : 0.007576942443847656 nb_pixel_total : 6109 time to create 1 rle with old method : 0.007244586944580078 time for calcul the mask position with numpy : 0.006143808364868164 nb_pixel_total : 120 time to create 1 rle with old method : 0.0001685619354248047 time for calcul the mask position with numpy : 0.006139516830444336 nb_pixel_total : 3185 time to create 1 rle with old method : 0.00389862060546875 time for calcul the mask position with numpy : 0.0064046382904052734 nb_pixel_total : 845 time to create 1 rle with old method : 0.0010385513305664062 time for calcul the mask position with numpy : 0.0068171024322509766 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006058216094970703 time for calcul the mask position with numpy : 0.0066509246826171875 nb_pixel_total : 35 time to create 1 rle with old method : 8.7738037109375e-05 time for calcul the mask position with numpy : 0.006718158721923828 nb_pixel_total : 7975 time to create 1 rle with old method : 0.009050846099853516 time for calcul the mask position with numpy : 0.006648063659667969 nb_pixel_total : 669 time to create 1 rle with old method : 0.0007996559143066406 time for calcul the mask position with numpy : 0.0063250064849853516 nb_pixel_total : 828 time to create 1 rle with old method : 0.0009555816650390625 time for calcul the mask position with numpy : 0.0062389373779296875 nb_pixel_total : 1582 time to create 1 rle with old method : 0.001857757568359375 time for calcul the mask position with numpy : 0.006243705749511719 nb_pixel_total : 13454 time to create 1 rle with old method : 0.015694379806518555 time for calcul the mask position with numpy : 0.00629425048828125 nb_pixel_total : 1283 time to create 1 rle with old method : 0.001547098159790039 time for calcul the mask position with numpy : 0.0067901611328125 nb_pixel_total : 9918 time to create 1 rle with old method : 0.011834144592285156 time for calcul the mask position with numpy : 0.006177186965942383 nb_pixel_total : 583 time to create 1 rle with old method : 0.0007205009460449219 time for calcul the mask position with numpy : 0.0064296722412109375 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004227161407470703 time for calcul the mask position with numpy : 0.0063359737396240234 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002551078796386719 time for calcul the mask position with numpy : 0.006505012512207031 nb_pixel_total : 649 time to create 1 rle with old method : 0.0007731914520263672 time for calcul the mask position with numpy : 0.010211706161499023 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002887248992919922 time for calcul the mask position with numpy : 0.010784626007080078 nb_pixel_total : 1180 time to create 1 rle with old method : 0.0014331340789794922 time for calcul the mask position with numpy : 0.013119935989379883 nb_pixel_total : 1618 time to create 1 rle with old method : 0.0018460750579833984 time for calcul the mask position with numpy : 0.009858846664428711 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011444091796875 time for calcul the mask position with numpy : 0.010905981063842773 nb_pixel_total : 3326 time to create 1 rle with old method : 0.0038001537322998047 time for calcul the mask position with numpy : 0.010473489761352539 nb_pixel_total : 602 time to create 1 rle with old method : 0.0006871223449707031 time for calcul the mask position with numpy : 0.0066945552825927734 nb_pixel_total : 30 time to create 1 rle with old method : 6.008148193359375e-05 time for calcul the mask position with numpy : 0.006581306457519531 nb_pixel_total : 1245 time to create 1 rle with old method : 0.0015761852264404297 time for calcul the mask position with numpy : 0.006619930267333984 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002617835998535156 time for calcul the mask position with numpy : 0.006228446960449219 nb_pixel_total : 69 time to create 1 rle with old method : 0.00010347366333007812 time for calcul the mask position with numpy : 0.00623011589050293 nb_pixel_total : 1887 time to create 1 rle with old method : 0.0022215843200683594 time for calcul the mask position with numpy : 0.006185770034790039 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004703998565673828 time for calcul the mask position with numpy : 0.006307840347290039 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.0066869258880615234 nb_pixel_total : 106425 time to create 1 rle with old method : 0.12521934509277344 time for calcul the mask position with numpy : 0.0071713924407958984 nb_pixel_total : 41485 time to create 1 rle with old method : 0.05235171318054199 time for calcul the mask position with numpy : 0.00668787956237793 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002319812774658203 time for calcul the mask position with numpy : 0.006591320037841797 nb_pixel_total : 60 time to create 1 rle with old method : 0.00011038780212402344 time for calcul the mask position with numpy : 0.007853031158447266 nb_pixel_total : 114 time to create 1 rle with old method : 0.00016379356384277344 time for calcul the mask position with numpy : 0.007069826126098633 nb_pixel_total : 758 time to create 1 rle with old method : 0.0008833408355712891 time for calcul the mask position with numpy : 0.007137298583984375 nb_pixel_total : 80 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.006293535232543945 nb_pixel_total : 225 time to create 1 rle with old method : 0.00027561187744140625 time for calcul the mask position with numpy : 0.00659942626953125 nb_pixel_total : 248 time to create 1 rle with old method : 0.0002982616424560547 time for calcul the mask position with numpy : 0.006645917892456055 nb_pixel_total : 2926 time to create 1 rle with old method : 0.0033826828002929688 time for calcul the mask position with numpy : 0.00673365592956543 nb_pixel_total : 492 time to create 1 rle with old method : 0.0005774497985839844 time for calcul the mask position with numpy : 0.0065708160400390625 nb_pixel_total : 3941 time to create 1 rle with old method : 0.00447845458984375 time for calcul the mask position with numpy : 0.006642580032348633 nb_pixel_total : 189 time to create 1 rle with old method : 0.00023412704467773438 time for calcul the mask position with numpy : 0.008856534957885742 nb_pixel_total : 192 time to create 1 rle with old method : 0.00030231475830078125 time for calcul the mask position with numpy : 0.0075147151947021484 nb_pixel_total : 123 time to create 1 rle with old method : 0.00016117095947265625 time for calcul the mask position with numpy : 0.006560087203979492 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003082752227783203 time for calcul the mask position with numpy : 0.006478071212768555 nb_pixel_total : 657 time to create 1 rle with old method : 0.0007662773132324219 time for calcul the mask position with numpy : 0.008300065994262695 nb_pixel_total : 402 time to create 1 rle with old method : 0.0004780292510986328 time for calcul the mask position with numpy : 0.006697893142700195 nb_pixel_total : 6 time to create 1 rle with old method : 3.170967102050781e-05 time for calcul the mask position with numpy : 0.00659632682800293 nb_pixel_total : 392 time to create 1 rle with old method : 0.00047016143798828125 time for calcul the mask position with numpy : 0.006791830062866211 nb_pixel_total : 10970 time to create 1 rle with old method : 0.012329578399658203 time for calcul the mask position with numpy : 0.006453752517700195 nb_pixel_total : 1239 time to create 1 rle with old method : 0.0014615058898925781 time for calcul the mask position with numpy : 0.006320476531982422 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005695819854736328 time for calcul the mask position with numpy : 0.006444215774536133 nb_pixel_total : 942 time to create 1 rle with old method : 0.0010919570922851562 time for calcul the mask position with numpy : 0.006720066070556641 nb_pixel_total : 161 time to create 1 rle with old method : 0.000213623046875 time for calcul the mask position with numpy : 0.006281137466430664 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004208087921142578 time for calcul the mask position with numpy : 0.00628972053527832 nb_pixel_total : 314 time to create 1 rle with old method : 0.000400543212890625 time for calcul the mask position with numpy : 0.006300926208496094 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.007193088531494141 nb_pixel_total : 233 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.006247282028198242 nb_pixel_total : 669 time to create 1 rle with old method : 0.0008218288421630859 time for calcul the mask position with numpy : 0.0065801143646240234 nb_pixel_total : 31 time to create 1 rle with old method : 7.033348083496094e-05 time for calcul the mask position with numpy : 0.006211519241333008 nb_pixel_total : 397 time to create 1 rle with old method : 0.0004951953887939453 time for calcul the mask position with numpy : 0.006335735321044922 nb_pixel_total : 2572 time to create 1 rle with old method : 0.003069162368774414 time for calcul the mask position with numpy : 0.0064508914947509766 nb_pixel_total : 277 time to create 1 rle with old method : 0.00034427642822265625 time for calcul the mask position with numpy : 0.0063991546630859375 nb_pixel_total : 149 time to create 1 rle with old method : 0.0001895427703857422 create new chi : 1.0458788871765137 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014586448669433594 batch 1 Loaded 80 chid ids of type : 4230 Number RLEs to save : 9242 TO DO : save crop sub photo not yet done ! save time : 0.6016623973846436 nb_obj : 89 nb_hashtags : 6 time to prepare the origin masks : 1.3744533061981201 time for calcul the mask position with numpy : 0.38012027740478516 nb_pixel_total : 1761836 time to create 1 rle with new method : 0.1631770133972168 time for calcul the mask position with numpy : 0.006783008575439453 nb_pixel_total : 146 time to create 1 rle with old method : 0.00019598007202148438 time for calcul the mask position with numpy : 0.006699800491333008 nb_pixel_total : 8970 time to create 1 rle with old method : 0.009987831115722656 time for calcul the mask position with numpy : 0.006886482238769531 nb_pixel_total : 636 time to create 1 rle with old method : 0.0007383823394775391 time for calcul the mask position with numpy : 0.0063533782958984375 nb_pixel_total : 918 time to create 1 rle with old method : 0.0011112689971923828 time for calcul the mask position with numpy : 0.006490230560302734 nb_pixel_total : 38 time to create 1 rle with old method : 7.319450378417969e-05 time for calcul the mask position with numpy : 0.0063588619232177734 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005619525909423828 time for calcul the mask position with numpy : 0.006422281265258789 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006551742553710938 time for calcul the mask position with numpy : 0.006707668304443359 nb_pixel_total : 55726 time to create 1 rle with old method : 0.06449031829833984 time for calcul the mask position with numpy : 0.006915569305419922 nb_pixel_total : 7547 time to create 1 rle with old method : 0.011423587799072266 time for calcul the mask position with numpy : 0.007833719253540039 nb_pixel_total : 2266 time to create 1 rle with old method : 0.0037145614624023438 time for calcul the mask position with numpy : 0.007299184799194336 nb_pixel_total : 34 time to create 1 rle with old method : 9.202957153320312e-05 time for calcul the mask position with numpy : 0.007727861404418945 nb_pixel_total : 18 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.007429838180541992 nb_pixel_total : 43 time to create 1 rle with old method : 0.00010585784912109375 time for calcul the mask position with numpy : 0.0076558589935302734 nb_pixel_total : 969 time to create 1 rle with old method : 0.0016372203826904297 time for calcul the mask position with numpy : 0.0074498653411865234 nb_pixel_total : 475 time to create 1 rle with old method : 0.0008389949798583984 time for calcul the mask position with numpy : 0.007383108139038086 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003788471221923828 time for calcul the mask position with numpy : 0.0074672698974609375 nb_pixel_total : 859 time to create 1 rle with old method : 0.0014493465423583984 time for calcul the mask position with numpy : 0.008245706558227539 nb_pixel_total : 957 time to create 1 rle with old method : 0.0011861324310302734 time for calcul the mask position with numpy : 0.0071446895599365234 nb_pixel_total : 6040 time to create 1 rle with old method : 0.006948232650756836 time for calcul the mask position with numpy : 0.0068094730377197266 nb_pixel_total : 3355 time to create 1 rle with old method : 0.003844022750854492 time for calcul the mask position with numpy : 0.007470846176147461 nb_pixel_total : 1649 time to create 1 rle with old method : 0.0018863677978515625 time for calcul the mask position with numpy : 0.007093191146850586 nb_pixel_total : 7867 time to create 1 rle with old method : 0.009178400039672852 time for calcul the mask position with numpy : 0.006842136383056641 nb_pixel_total : 494 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.006856679916381836 nb_pixel_total : 693 time to create 1 rle with old method : 0.0008227825164794922 time for calcul the mask position with numpy : 0.0065844058990478516 nb_pixel_total : 743 time to create 1 rle with old method : 0.0008513927459716797 time for calcul the mask position with numpy : 0.007040500640869141 nb_pixel_total : 14593 time to create 1 rle with old method : 0.016408443450927734 time for calcul the mask position with numpy : 0.0066242218017578125 nb_pixel_total : 1264 time to create 1 rle with old method : 0.0014486312866210938 time for calcul the mask position with numpy : 0.008314371109008789 nb_pixel_total : 9529 time to create 1 rle with old method : 0.01105952262878418 time for calcul the mask position with numpy : 0.006653308868408203 nb_pixel_total : 646 time to create 1 rle with old method : 0.000827789306640625 time for calcul the mask position with numpy : 0.006649971008300781 nb_pixel_total : 304 time to create 1 rle with old method : 0.0004074573516845703 time for calcul the mask position with numpy : 0.007364034652709961 nb_pixel_total : 30 time to create 1 rle with old method : 6.723403930664062e-05 time for calcul the mask position with numpy : 0.007419109344482422 nb_pixel_total : 173 time to create 1 rle with old method : 0.00023603439331054688 time for calcul the mask position with numpy : 0.0073986053466796875 nb_pixel_total : 1137 time to create 1 rle with old method : 0.0017058849334716797 time for calcul the mask position with numpy : 0.008381843566894531 nb_pixel_total : 373 time to create 1 rle with old method : 0.0006039142608642578 time for calcul the mask position with numpy : 0.009130477905273438 nb_pixel_total : 1904 time to create 1 rle with old method : 0.002752065658569336 time for calcul the mask position with numpy : 0.007949590682983398 nb_pixel_total : 166 time to create 1 rle with old method : 0.00031948089599609375 time for calcul the mask position with numpy : 0.007225751876831055 nb_pixel_total : 3190 time to create 1 rle with old method : 0.003792285919189453 time for calcul the mask position with numpy : 0.0067958831787109375 nb_pixel_total : 973 time to create 1 rle with old method : 0.0012433528900146484 time for calcul the mask position with numpy : 0.007241725921630859 nb_pixel_total : 4 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.0076313018798828125 nb_pixel_total : 69 time to create 1 rle with old method : 0.00017499923706054688 time for calcul the mask position with numpy : 0.008846521377563477 nb_pixel_total : 1366 time to create 1 rle with old method : 0.002350330352783203 time for calcul the mask position with numpy : 0.007642269134521484 nb_pixel_total : 574 time to create 1 rle with old method : 0.0009684562683105469 time for calcul the mask position with numpy : 0.007439613342285156 nb_pixel_total : 506 time to create 1 rle with old method : 0.0009050369262695312 time for calcul the mask position with numpy : 0.007180452346801758 nb_pixel_total : 67 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.006666421890258789 nb_pixel_total : 1137 time to create 1 rle with old method : 0.0013298988342285156 time for calcul the mask position with numpy : 0.0068471431732177734 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001316070556640625 time for calcul the mask position with numpy : 0.006792306900024414 nb_pixel_total : 1761 time to create 1 rle with old method : 0.0019981861114501953 time for calcul the mask position with numpy : 0.00716710090637207 nb_pixel_total : 760 time to create 1 rle with old method : 0.0012202262878417969 time for calcul the mask position with numpy : 0.007333040237426758 nb_pixel_total : 76 time to create 1 rle with old method : 0.00014734268188476562 time for calcul the mask position with numpy : 0.010584831237792969 nb_pixel_total : 765 time to create 1 rle with old method : 0.000934600830078125 time for calcul the mask position with numpy : 0.006735563278198242 nb_pixel_total : 100 time to create 1 rle with old method : 0.00022983551025390625 time for calcul the mask position with numpy : 0.0065631866455078125 nb_pixel_total : 55 time to create 1 rle with old method : 8.177757263183594e-05 time for calcul the mask position with numpy : 0.006962299346923828 nb_pixel_total : 105410 time to create 1 rle with old method : 0.11742115020751953 time for calcul the mask position with numpy : 0.006800413131713867 nb_pixel_total : 42302 time to create 1 rle with old method : 0.04878878593444824 time for calcul the mask position with numpy : 0.006985187530517578 nb_pixel_total : 306 time to create 1 rle with old method : 0.00037670135498046875 time for calcul the mask position with numpy : 0.006487846374511719 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002665519714355469 time for calcul the mask position with numpy : 0.006395816802978516 nb_pixel_total : 65 time to create 1 rle with old method : 0.00010371208190917969 time for calcul the mask position with numpy : 0.006517171859741211 nb_pixel_total : 115 time to create 1 rle with old method : 0.00016307830810546875 time for calcul the mask position with numpy : 0.007152080535888672 nb_pixel_total : 92 time to create 1 rle with old method : 0.00016236305236816406 time for calcul the mask position with numpy : 0.006680727005004883 nb_pixel_total : 627 time to create 1 rle with old method : 0.0007488727569580078 time for calcul the mask position with numpy : 0.006441593170166016 nb_pixel_total : 188 time to create 1 rle with old method : 0.00025177001953125 time for calcul the mask position with numpy : 0.007313966751098633 nb_pixel_total : 277 time to create 1 rle with old method : 0.0004937648773193359 time for calcul the mask position with numpy : 0.006676912307739258 nb_pixel_total : 617 time to create 1 rle with old method : 0.0010395050048828125 time for calcul the mask position with numpy : 0.006751298904418945 nb_pixel_total : 3610 time to create 1 rle with old method : 0.005864381790161133 time for calcul the mask position with numpy : 0.0068323612213134766 nb_pixel_total : 191 time to create 1 rle with old method : 0.0003390312194824219 time for calcul the mask position with numpy : 0.0066678524017333984 nb_pixel_total : 128 time to create 1 rle with old method : 0.00023365020751953125 time for calcul the mask position with numpy : 0.006923198699951172 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004711151123046875 time for calcul the mask position with numpy : 0.006844997406005859 nb_pixel_total : 608 time to create 1 rle with old method : 0.0010085105895996094 time for calcul the mask position with numpy : 0.0067098140716552734 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002803802490234375 time for calcul the mask position with numpy : 0.009630441665649414 nb_pixel_total : 809 time to create 1 rle with old method : 0.0013873577117919922 time for calcul the mask position with numpy : 0.009697914123535156 nb_pixel_total : 225 time to create 1 rle with old method : 0.00026607513427734375 time for calcul the mask position with numpy : 0.008402109146118164 nb_pixel_total : 1826 time to create 1 rle with old method : 0.0020291805267333984 time for calcul the mask position with numpy : 0.008369207382202148 nb_pixel_total : 785 time to create 1 rle with old method : 0.0009219646453857422 time for calcul the mask position with numpy : 0.008428096771240234 nb_pixel_total : 407 time to create 1 rle with old method : 0.0004811286926269531 time for calcul the mask position with numpy : 0.008398294448852539 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0015735626220703125 time for calcul the mask position with numpy : 0.00838923454284668 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006048679351806641 time for calcul the mask position with numpy : 0.008387327194213867 nb_pixel_total : 28 time to create 1 rle with old method : 4.553794860839844e-05 time for calcul the mask position with numpy : 0.008382797241210938 nb_pixel_total : 840 time to create 1 rle with old method : 0.0009694099426269531 time for calcul the mask position with numpy : 0.008414030075073242 nb_pixel_total : 155 time to create 1 rle with old method : 0.00018739700317382812 time for calcul the mask position with numpy : 0.008367300033569336 nb_pixel_total : 961 time to create 1 rle with old method : 0.0010967254638671875 time for calcul the mask position with numpy : 0.008408069610595703 nb_pixel_total : 418 time to create 1 rle with old method : 0.0004916191101074219 time for calcul the mask position with numpy : 0.009347677230834961 nb_pixel_total : 187 time to create 1 rle with old method : 0.00023293495178222656 time for calcul the mask position with numpy : 0.008683443069458008 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005109310150146484 time for calcul the mask position with numpy : 0.008474588394165039 nb_pixel_total : 217 time to create 1 rle with old method : 0.00027370452880859375 time for calcul the mask position with numpy : 0.008488655090332031 nb_pixel_total : 2946 time to create 1 rle with old method : 0.003354310989379883 time for calcul the mask position with numpy : 0.008748769760131836 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004489421844482422 time for calcul the mask position with numpy : 0.00854182243347168 nb_pixel_total : 411 time to create 1 rle with old method : 0.0004899501800537109 time for calcul the mask position with numpy : 0.008789300918579102 nb_pixel_total : 96 time to create 1 rle with old method : 0.00013709068298339844 time for calcul the mask position with numpy : 0.008417844772338867 nb_pixel_total : 298 time to create 1 rle with old method : 0.00034737586975097656 create new chi : 1.5914170742034912 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0024263858795166016 batch 1 Loaded 90 chid ids of type : 4230 Number RLEs to save : 9699 TO DO : save crop sub photo not yet done ! save time : 0.6996965408325195 nb_obj : 92 nb_hashtags : 7 time to prepare the origin masks : 1.4495925903320312 time for calcul the mask position with numpy : 0.7425696849822998 nb_pixel_total : 1801711 time to create 1 rle with new method : 0.14837932586669922 time for calcul the mask position with numpy : 0.006575822830200195 nb_pixel_total : 5640 time to create 1 rle with old method : 0.006234645843505859 time for calcul the mask position with numpy : 0.006335735321044922 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.006217002868652344 nb_pixel_total : 723 time to create 1 rle with old method : 0.0008509159088134766 time for calcul the mask position with numpy : 0.006162166595458984 nb_pixel_total : 890 time to create 1 rle with old method : 0.0010616779327392578 time for calcul the mask position with numpy : 0.006655693054199219 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007381439208984375 time for calcul the mask position with numpy : 0.006300210952758789 nb_pixel_total : 63 time to create 1 rle with old method : 0.00012373924255371094 time for calcul the mask position with numpy : 0.006626129150390625 nb_pixel_total : 470 time to create 1 rle with old method : 0.0005490779876708984 time for calcul the mask position with numpy : 0.00598907470703125 nb_pixel_total : 168 time to create 1 rle with old method : 0.00021886825561523438 time for calcul the mask position with numpy : 0.00607752799987793 nb_pixel_total : 23 time to create 1 rle with old method : 4.744529724121094e-05 time for calcul the mask position with numpy : 0.0058956146240234375 nb_pixel_total : 181 time to create 1 rle with old method : 0.00022411346435546875 time for calcul the mask position with numpy : 0.006163358688354492 nb_pixel_total : 2271 time to create 1 rle with old method : 0.002696990966796875 time for calcul the mask position with numpy : 0.006197452545166016 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.0060961246490478516 nb_pixel_total : 36 time to create 1 rle with old method : 5.936622619628906e-05 time for calcul the mask position with numpy : 0.006415128707885742 nb_pixel_total : 4 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.0065250396728515625 nb_pixel_total : 59275 time to create 1 rle with old method : 0.06511235237121582 time for calcul the mask position with numpy : 0.006087779998779297 nb_pixel_total : 696 time to create 1 rle with old method : 0.001071929931640625 time for calcul the mask position with numpy : 0.00736546516418457 nb_pixel_total : 1067 time to create 1 rle with old method : 0.0012278556823730469 time for calcul the mask position with numpy : 0.006129741668701172 nb_pixel_total : 73 time to create 1 rle with old method : 0.00011992454528808594 time for calcul the mask position with numpy : 0.006029605865478516 nb_pixel_total : 909 time to create 1 rle with old method : 0.0013089179992675781 time for calcul the mask position with numpy : 0.00606083869934082 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005223751068115234 time for calcul the mask position with numpy : 0.006122112274169922 nb_pixel_total : 450 time to create 1 rle with old method : 0.0005278587341308594 time for calcul the mask position with numpy : 0.006081819534301758 nb_pixel_total : 736 time to create 1 rle with old method : 0.0008766651153564453 time for calcul the mask position with numpy : 0.005977630615234375 nb_pixel_total : 5829 time to create 1 rle with old method : 0.010461091995239258 time for calcul the mask position with numpy : 0.008671045303344727 nb_pixel_total : 541 time to create 1 rle with old method : 0.0010693073272705078 time for calcul the mask position with numpy : 0.012993335723876953 nb_pixel_total : 1569 time to create 1 rle with old method : 0.004730939865112305 time for calcul the mask position with numpy : 0.010986804962158203 nb_pixel_total : 1932 time to create 1 rle with old method : 0.002288818359375 time for calcul the mask position with numpy : 0.006555795669555664 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006089210510253906 time for calcul the mask position with numpy : 0.006823539733886719 nb_pixel_total : 14639 time to create 1 rle with old method : 0.016695737838745117 time for calcul the mask position with numpy : 0.0067043304443359375 nb_pixel_total : 670 time to create 1 rle with old method : 0.0007865428924560547 time for calcul the mask position with numpy : 0.006600856781005859 nb_pixel_total : 830 time to create 1 rle with old method : 0.0009982585906982422 time for calcul the mask position with numpy : 0.006899118423461914 nb_pixel_total : 301 time to create 1 rle with old method : 0.0005941390991210938 time for calcul the mask position with numpy : 0.007210254669189453 nb_pixel_total : 1268 time to create 1 rle with old method : 0.001558065414428711 time for calcul the mask position with numpy : 0.007604122161865234 nb_pixel_total : 33 time to create 1 rle with old method : 0.00010371208190917969 time for calcul the mask position with numpy : 0.007467031478881836 nb_pixel_total : 10628 time to create 1 rle with old method : 0.011829137802124023 time for calcul the mask position with numpy : 0.0064160823822021484 nb_pixel_total : 7664 time to create 1 rle with old method : 0.008614301681518555 time for calcul the mask position with numpy : 0.006982088088989258 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009343624114990234 time for calcul the mask position with numpy : 0.006300210952758789 nb_pixel_total : 321 time to create 1 rle with old method : 0.00039196014404296875 time for calcul the mask position with numpy : 0.006657123565673828 nb_pixel_total : 859 time to create 1 rle with old method : 0.0010116100311279297 time for calcul the mask position with numpy : 0.006587028503417969 nb_pixel_total : 38 time to create 1 rle with old method : 0.00010347366333007812 time for calcul the mask position with numpy : 0.006550312042236328 nb_pixel_total : 2033 time to create 1 rle with old method : 0.0023355484008789062 time for calcul the mask position with numpy : 0.00667119026184082 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003077983856201172 time for calcul the mask position with numpy : 0.006298065185546875 nb_pixel_total : 331 time to create 1 rle with old method : 0.0003981590270996094 time for calcul the mask position with numpy : 0.006437063217163086 nb_pixel_total : 1213 time to create 1 rle with old method : 0.0015363693237304688 time for calcul the mask position with numpy : 0.006463527679443359 nb_pixel_total : 2675 time to create 1 rle with old method : 0.0030143260955810547 time for calcul the mask position with numpy : 0.006346464157104492 nb_pixel_total : 113 time to create 1 rle with old method : 0.00014781951904296875 time for calcul the mask position with numpy : 0.0061266422271728516 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005688667297363281 time for calcul the mask position with numpy : 0.0058939456939697266 nb_pixel_total : 76 time to create 1 rle with old method : 0.00011754035949707031 time for calcul the mask position with numpy : 0.00629734992980957 nb_pixel_total : 251 time to create 1 rle with old method : 0.00029850006103515625 time for calcul the mask position with numpy : 0.006055116653442383 nb_pixel_total : 1232 time to create 1 rle with old method : 0.0014231204986572266 time for calcul the mask position with numpy : 0.005956411361694336 nb_pixel_total : 84 time to create 1 rle with old method : 0.00012183189392089844 time for calcul the mask position with numpy : 0.0063130855560302734 nb_pixel_total : 1815 time to create 1 rle with old method : 0.0020394325256347656 time for calcul the mask position with numpy : 0.006652116775512695 nb_pixel_total : 105431 time to create 1 rle with old method : 0.11647176742553711 time for calcul the mask position with numpy : 0.006373405456542969 nb_pixel_total : 62 time to create 1 rle with old method : 8.96453857421875e-05 time for calcul the mask position with numpy : 0.006410360336303711 nb_pixel_total : 324 time to create 1 rle with old method : 0.00044226646423339844 time for calcul the mask position with numpy : 0.006414651870727539 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.006402015686035156 nb_pixel_total : 55 time to create 1 rle with old method : 7.963180541992188e-05 time for calcul the mask position with numpy : 0.006609678268432617 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001628398895263672 time for calcul the mask position with numpy : 0.006547212600708008 nb_pixel_total : 651 time to create 1 rle with old method : 0.0007712841033935547 time for calcul the mask position with numpy : 0.006488323211669922 nb_pixel_total : 87 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.006259918212890625 nb_pixel_total : 224 time to create 1 rle with old method : 0.00027680397033691406 time for calcul the mask position with numpy : 0.006210803985595703 nb_pixel_total : 887 time to create 1 rle with old method : 0.0010561943054199219 time for calcul the mask position with numpy : 0.006131172180175781 nb_pixel_total : 3064 time to create 1 rle with old method : 0.003475666046142578 time for calcul the mask position with numpy : 0.006413459777832031 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003705024719238281 time for calcul the mask position with numpy : 0.007582426071166992 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003962516784667969 time for calcul the mask position with numpy : 0.006723165512084961 nb_pixel_total : 695 time to create 1 rle with old method : 0.0007982254028320312 time for calcul the mask position with numpy : 0.006627321243286133 nb_pixel_total : 98 time to create 1 rle with old method : 0.00027251243591308594 time for calcul the mask position with numpy : 0.00635528564453125 nb_pixel_total : 976 time to create 1 rle with old method : 0.0011403560638427734 time for calcul the mask position with numpy : 0.006346464157104492 nb_pixel_total : 238 time to create 1 rle with old method : 0.0002903938293457031 time for calcul the mask position with numpy : 0.006215333938598633 nb_pixel_total : 2252 time to create 1 rle with old method : 0.002546072006225586 time for calcul the mask position with numpy : 0.006145477294921875 nb_pixel_total : 163 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.00601959228515625 nb_pixel_total : 931 time to create 1 rle with old method : 0.0010268688201904297 time for calcul the mask position with numpy : 0.006035804748535156 nb_pixel_total : 390 time to create 1 rle with old method : 0.00046253204345703125 time for calcul the mask position with numpy : 0.0063114166259765625 nb_pixel_total : 9528 time to create 1 rle with old method : 0.010937213897705078 time for calcul the mask position with numpy : 0.006325483322143555 nb_pixel_total : 131 time to create 1 rle with old method : 0.00024509429931640625 time for calcul the mask position with numpy : 0.0062122344970703125 nb_pixel_total : 1368 time to create 1 rle with old method : 0.001562356948852539 time for calcul the mask position with numpy : 0.006139278411865234 nb_pixel_total : 62 time to create 1 rle with old method : 0.00012040138244628906 time for calcul the mask position with numpy : 0.005860567092895508 nb_pixel_total : 552 time to create 1 rle with old method : 0.0006363391876220703 time for calcul the mask position with numpy : 0.006040811538696289 nb_pixel_total : 613 time to create 1 rle with old method : 0.0007114410400390625 time for calcul the mask position with numpy : 0.0058362483978271484 nb_pixel_total : 148 time to create 1 rle with old method : 0.00020551681518554688 time for calcul the mask position with numpy : 0.005982637405395508 nb_pixel_total : 878 time to create 1 rle with old method : 0.0010540485382080078 time for calcul the mask position with numpy : 0.006203174591064453 nb_pixel_total : 15 time to create 1 rle with old method : 5.173683166503906e-05 time for calcul the mask position with numpy : 0.006916522979736328 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005791187286376953 time for calcul the mask position with numpy : 0.005903959274291992 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002586841583251953 time for calcul the mask position with numpy : 0.006785869598388672 nb_pixel_total : 402 time to create 1 rle with old method : 0.0004930496215820312 time for calcul the mask position with numpy : 0.006070852279663086 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003154277801513672 time for calcul the mask position with numpy : 0.006358623504638672 nb_pixel_total : 579 time to create 1 rle with old method : 0.0006604194641113281 time for calcul the mask position with numpy : 0.005984306335449219 nb_pixel_total : 411 time to create 1 rle with old method : 0.00048542022705078125 time for calcul the mask position with numpy : 0.0060007572174072266 nb_pixel_total : 3682 time to create 1 rle with old method : 0.00414729118347168 time for calcul the mask position with numpy : 0.00824880599975586 nb_pixel_total : 357 time to create 1 rle with old method : 0.00040984153747558594 time for calcul the mask position with numpy : 0.008226394653320312 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003161430358886719 time for calcul the mask position with numpy : 0.008265256881713867 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003352165222167969 time for calcul the mask position with numpy : 0.008197784423828125 nb_pixel_total : 132 time to create 1 rle with old method : 0.00015544891357421875 create new chi : 1.8253746032714844 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001458883285522461 batch 1 Loaded 93 chid ids of type : 4230 Number RLEs to save : 9388 TO DO : save crop sub photo not yet done ! save time : 0.5711126327514648 map_output_result : {1339964345: (0.0, 'Should be the crop_list due to order', 0.0), 1339964341: (0.0, 'Should be the crop_list due to order', 0.0), 1339964338: (0.0, 'Should be the crop_list due to order', 0.0), 1339964333: (0.0, 'Should be the crop_list due to order', 0.0), 1339964325: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1339964345, 1339964341, 1339964338, 1339964333, 1339964325] Looping around the photos to save general results len do output : 5 /1339964345.Didn't retrieve data . /1339964341.Didn't retrieve data . /1339964338.Didn't retrieve data . /1339964333.Didn't retrieve data . /1339964325.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964345', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964341', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964338', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964333', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964325', None, None, None, None, None, '2620645') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.027512073516845703 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.208329916000366 time spend to save output : 0.027849197387695312 total time spend for step 4 : 20.23617911338806 step5:crop_condition Fri Feb 28 05:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 436 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 160 About to insert : list_path_to_insert length 160 new photo from crops ! About to upload 160 photos upload in portfolio : 4869462 init cache_photo without model_param we have 160 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740716506_3070810 we have uploaded 160 photos in the portfolio 4869462 time of upload the photos Elapsed time : 43.97126793861389 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 4869462 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740716551_3070810 we have uploaded 45 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.623388528823853 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 4869462 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740716564_3070810 we have uploaded 7 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.5070102214813232 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 73 About to insert : list_path_to_insert length 73 new photo from crops ! About to upload 73 photos upload in portfolio : 4869462 init cache_photo without model_param we have 73 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740716568_3070810 we have uploaded 73 photos in the portfolio 4869462 time of upload the photos Elapsed time : 18.273818492889404 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1339964345, 1339964341, 1339964338, 1339964333, 1339964325] Looping around the photos to save general results len do output : 285 /1340069126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340069443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964345', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964341', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964338', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964333', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964325', None, None, None, None, None, '2620645') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 860 time used for this insertion : 0.09402585029602051 save_final save missing photos in datou_result : time spend for datou_step_exec : 83.39945554733276 time spend to save output : 0.10122561454772949 total time spend for step 5 : 83.5006811618805 step6:thcl Fri Feb 28 05:23:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.017367839813232422 time to convert the images to numpy array : 0.06119656562805176 time to import caffe and check if the image exist : 0.012792825698852539 time to convert the images to numpy array : 0.08468770980834961 time to import caffe and check if the image exist : 0.027124404907226562 time to convert the images to numpy array : 0.07628273963928223 time to import caffe and check if the image exist : 0.024721622467041016 time to convert the images to numpy array : 0.08134675025939941 time to import caffe and check if the image exist : 0.022624969482421875 time to convert the images to numpy array : 0.09616637229919434 time to import caffe and check if the image exist : 0.032028913497924805 time to convert the images to numpy array : 0.09296035766601562 time to import caffe and check if the image exist : 0.037804603576660156 time to convert the images to numpy array : 0.08710503578186035 time to import caffe and check if the image exist : 0.03603243827819824 time to convert the images to numpy array : 0.08909010887145996 time to import caffe and check if the image exist : 0.023123741149902344 time to convert the images to numpy array : 0.10686111450195312 time to import caffe and check if the image exist : 0.0359797477722168 time to convert the images to numpy array : 0.09445405006408691 total time to convert the images to numpy array : 0.6201770305633545 list photo_ids error: [] list photo_ids correct : [1340069126, 1340069127, 1340069128, 1340069129, 1340069130, 1340069131, 1340069132, 1340069134, 1340069135, 1340069136, 1340069137, 1340069138, 1340069139, 1340069140, 1340069141, 1340069142, 1340069143, 1340069144, 1340069145, 1340069146, 1340069148, 1340069149, 1340069150, 1340069151, 1340069152, 1340069153, 1340069154, 1340069155, 1340069156, 1340069420, 1340069421, 1340069422, 1340069423, 1340069424, 1340069425, 1340069426, 1340069427, 1340069428, 1340069429, 1340069430, 1340069431, 1340069432, 1340069433, 1340069434, 1340069435, 1340069436, 1340069437, 1340069438, 1340069439, 1340069440, 1340069441, 1340069442, 1340069443, 1340069391, 1340069392, 1340069393, 1340069394, 1340069395, 1340069396, 1340069397, 1340069398, 1340069399, 1340069400, 1340069401, 1340069402, 1340069403, 1340069404, 1340069405, 1340069406, 1340069407, 1340069408, 1340069409, 1340069410, 1340069411, 1340069412, 1340069413, 1340069414, 1340069415, 1340069416, 1340069417, 1340069418, 1340069419, 1340069326, 1340069327, 1340069328, 1340069329, 1340069330, 1340069331, 1340069332, 1340069333, 1340069334, 1340069335, 1340069337, 1340069338, 1340069339, 1340069340, 1340069341, 1340069342, 1340069343, 1340069344, 1340069345, 1340069346, 1340069347, 1340069348, 1340069349, 1340069350, 1340069351, 1340069352, 1340069353, 1340069354, 1340069355, 1340069356, 1340069357, 1340069358, 1340069359, 1340069360, 1340069361, 1340069362, 1340069364, 1340069365, 1340069371, 1340069372, 1340069373, 1340069374, 1340069375, 1340069376, 1340069377, 1340069378, 1340069379, 1340069380, 1340069381, 1340069382, 1340069383, 1340069384, 1340069385, 1340069386, 1340069387, 1340069388, 1340069389, 1340069390, 1340069285, 1340069286, 1340069288, 1340069289, 1340069290, 1340069291, 1340069292, 1340069293, 1340069294, 1340069295, 1340069296, 1340069297, 1340069299, 1340069300, 1340069301, 1340069311, 1340069312, 1340069313, 1340069315, 1340069316, 1340069317, 1340069318, 1340069319, 1340069320, 1340069321, 1340069322, 1340069323, 1340069324, 1340069325, 1340069254, 1340069255, 1340069256, 1340069257, 1340069258, 1340069259, 1340069260, 1340069261, 1340069262, 1340069263, 1340069264, 1340069266, 1340069267, 1340069268, 1340069269, 1340069270, 1340069271, 1340069272, 1340069273, 1340069274, 1340069275, 1340069276, 1340069277, 1340069278, 1340069280, 1340069281, 1340069282, 1340069283, 1340069284, 1340069224, 1340069226, 1340069227, 1340069228, 1340069229, 1340069230, 1340069231, 1340069232, 1340069233, 1340069234, 1340069235, 1340069236, 1340069237, 1340069238, 1340069239, 1340069240, 1340069241, 1340069242, 1340069243, 1340069244, 1340069245, 1340069246, 1340069247, 1340069248, 1340069249, 1340069250, 1340069251, 1340069252, 1340069253, 1340069190, 1340069191, 1340069192, 1340069193, 1340069194, 1340069195, 1340069198, 1340069199, 1340069200, 1340069201, 1340069203, 1340069204, 1340069205, 1340069206, 1340069207, 1340069208, 1340069209, 1340069210, 1340069211, 1340069212, 1340069213, 1340069214, 1340069215, 1340069216, 1340069217, 1340069218, 1340069219, 1340069220, 1340069221, 1340069157, 1340069158, 1340069159, 1340069160, 1340069161, 1340069162, 1340069163, 1340069164, 1340069165, 1340069166, 1340069167, 1340069169, 1340069172, 1340069174, 1340069175, 1340069176, 1340069177, 1340069178, 1340069179, 1340069180, 1340069181, 1340069182, 1340069183, 1340069184, 1340069185, 1340069186, 1340069187, 1340069188, 1340069189] number of photos to traite : 285 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5083 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4864 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.422091007232666 time used to do the prediction : 1.2640972137451172 save descriptor for thcl : 3237 time to traite the descriptors : 1.7413699626922607 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340069126 To insert : 1340069127 To insert : 1340069128 To insert : 1340069129 To insert : 1340069130 To insert : 1340069131 To insert : 1340069132 To insert : 1340069134 To insert : 1340069135 To insert : 1340069136 To insert : 1340069137 To insert : 1340069138 To insert : 1340069139 To insert : 1340069140 To insert : 1340069141 To insert : 1340069142 To insert : 1340069143 To insert : 1340069144 To insert : 1340069145 To insert : 1340069146 To insert : 1340069148 To insert : 1340069149 To insert : 1340069150 To insert : 1340069151 To insert : 1340069152 To insert : 1340069153 To insert : 1340069154 To insert : 1340069155 To insert : 1340069156 To insert : 1340069420 To insert : 1340069421 To insert : 1340069422 To insert : 1340069423 To insert : 1340069424 To insert : 1340069425 To insert : 1340069426 To insert : 1340069427 To insert : 1340069428 To insert : 1340069429 To insert : 1340069430 To insert : 1340069431 To insert : 1340069432 To insert : 1340069433 To insert : 1340069434 To insert : 1340069435 To insert : 1340069436 To insert : 1340069437 To insert : 1340069438 To insert : 1340069439 To insert : 1340069440 To insert : 1340069441 To insert : 1340069442 To insert : 1340069443 To insert : 1340069391 To insert : 1340069392 To insert : 1340069393 To insert : 1340069394 To insert : 1340069395 To insert : 1340069396 To insert : 1340069397 To insert : 1340069398 To insert : 1340069399 To insert : 1340069400 To insert : 1340069401 To insert : 1340069402 To insert : 1340069403 To insert : 1340069404 To insert : 1340069405 To insert : 1340069406 To insert : 1340069407 To insert : 1340069408 To insert : 1340069409 To insert : 1340069410 To insert : 1340069411 To insert : 1340069412 To insert : 1340069413 To insert : 1340069414 To insert : 1340069415 To insert : 1340069416 To insert : 1340069417 To insert : 1340069418 To insert : 1340069419 To insert : 1340069326 To insert : 1340069327 To insert : 1340069328 To insert : 1340069329 To insert : 1340069330 To insert : 1340069331 To insert : 1340069332 To insert : 1340069333 To insert : 1340069334 To insert : 1340069335 To insert : 1340069337 To insert : 1340069338 To insert : 1340069339 To insert : 1340069340 To insert : 1340069341 To insert : 1340069342 To insert : 1340069343 To insert : 1340069344 To insert : 1340069345 To insert : 1340069346 To insert : 1340069347 To insert : 1340069348 To insert : 1340069349 To insert : 1340069350 To insert : 1340069351 To insert : 1340069352 To insert : 1340069353 To insert : 1340069354 To insert : 1340069355 To insert : 1340069356 To insert : 1340069357 To insert : 1340069358 To insert : 1340069359 To insert : 1340069360 To insert : 1340069361 To insert : 1340069362 To insert : 1340069364 To insert : 1340069365 To insert : 1340069371 To insert : 1340069372 To insert : 1340069373 To insert : 1340069374 To insert : 1340069375 To insert : 1340069376 To insert : 1340069377 To insert : 1340069378 To insert : 1340069379 To insert : 1340069380 To insert : 1340069381 To insert : 1340069382 To insert : 1340069383 To insert : 1340069384 To insert : 1340069385 To insert : 1340069386 To insert : 1340069387 To insert : 1340069388 To insert : 1340069389 To insert : 1340069390 To insert : 1340069285 To insert : 1340069286 To insert : 1340069288 To insert : 1340069289 To insert : 1340069290 To insert : 1340069291 To insert : 1340069292 To insert : 1340069293 To insert : 1340069294 To insert : 1340069295 To insert : 1340069296 To insert : 1340069297 To insert : 1340069299 To insert : 1340069300 To insert : 1340069301 To insert : 1340069311 To insert : 1340069312 To insert : 1340069313 To insert : 1340069315 To insert : 1340069316 To insert : 1340069317 To insert : 1340069318 To insert : 1340069319 To insert : 1340069320 To insert : 1340069321 To insert : 1340069322 To insert : 1340069323 To insert : 1340069324 To insert : 1340069325 To insert : 1340069254 To insert : 1340069255 To insert : 1340069256 To insert : 1340069257 To insert : 1340069258 To insert : 1340069259 To insert : 1340069260 To insert : 1340069261 To insert : 1340069262 To insert : 1340069263 To insert : 1340069264 To insert : 1340069266 To insert : 1340069267 To insert : 1340069268 To insert : 1340069269 To insert : 1340069270 To insert : 1340069271 To insert : 1340069272 To insert : 1340069273 To insert : 1340069274 To insert : 1340069275 To insert : 1340069276 To insert : 1340069277 To insert : 1340069278 To insert : 1340069280 To insert : 1340069281 To insert : 1340069282 To insert : 1340069283 To insert : 1340069284 To insert : 1340069224 To insert : 1340069226 To insert : 1340069227 To insert : 1340069228 To insert : 1340069229 To insert : 1340069230 To insert : 1340069231 To insert : 1340069232 To insert : 1340069233 To insert : 1340069234 To insert : 1340069235 To insert : 1340069236 To insert : 1340069237 To insert : 1340069238 To insert : 1340069239 To insert : 1340069240 To insert : 1340069241 To insert : 1340069242 To insert : 1340069243 To insert : 1340069244 To insert : 1340069245 To insert : 1340069246 To insert : 1340069247 To insert : 1340069248 To insert : 1340069249 To insert : 1340069250 To insert : 1340069251 To insert : 1340069252 To insert : 1340069253 To insert : 1340069190 To insert : 1340069191 To insert : 1340069192 To insert : 1340069193 To insert : 1340069194 To insert : 1340069195 To insert : 1340069198 To insert : 1340069199 To insert : 1340069200 To insert : 1340069201 To insert : 1340069203 To insert : 1340069204 To insert : 1340069205 To insert : 1340069206 To insert : 1340069207 To insert : 1340069208 To insert : 1340069209 To insert : 1340069210 To insert : 1340069211 To insert : 1340069212 To insert : 1340069213 To insert : 1340069214 To insert : 1340069215 To insert : 1340069216 To insert : 1340069217 To insert : 1340069218 To insert : 1340069219 To insert : 1340069220 To insert : 1340069221 To insert : 1340069157 To insert : 1340069158 To insert : 1340069159 To insert : 1340069160 To insert : 1340069161 To insert : 1340069162 To insert : 1340069163 To insert : 1340069164 To insert : 1340069165 To insert : 1340069166 To insert : 1340069167 To insert : 1340069169 To insert : 1340069172 To insert : 1340069174 To insert : 1340069175 To insert : 1340069176 To insert : 1340069177 To insert : 1340069178 To insert : 1340069179 To insert : 1340069180 To insert : 1340069181 To insert : 1340069182 To insert : 1340069183 To insert : 1340069184 To insert : 1340069185 To insert : 1340069186 To insert : 1340069187 To insert : 1340069188 To insert : 1340069189 time to insert the descriptors : 60.13269782066345 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 477 time used for this insertion : 0.6570241451263428 save missing photos in datou_result : time spend for datou_step_exec : 69.1358745098114 time spend to save output : 0.7085764408111572 total time spend for step 6 : 69.84445095062256 step7:ventilate_hashtags_in_portfolio Fri Feb 28 05:24:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20891033 get user id for portfolio 20891033 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891033 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_clair','flou','Film_plastique','Carton','autre','mal_croppe','Tetrapak','PEHD','refus','pehd','papier','metal','pet_fonce','PET_fonce','PET_clair','carton','Papier')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891033 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_clair','flou','Film_plastique','Carton','autre','mal_croppe','Tetrapak','PEHD','refus','pehd','papier','metal','pet_fonce','PET_fonce','PET_clair','carton','Papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20899978,20899979,20899980,20899984,20899988,20899991,20899985,20899992,20899989,20899990,20899993,20899994,20899995?tags=environnement,film_plastique,autre,carton,papier,pet_fonce,tetrapak,pehd,pet_clair,metal,flou,mal_croppe,refus&datou_id_consolidate=4235&port_consolidate=20891033 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1339964345, 1339964341, 1339964338, 1339964333, 1339964325] Looping around the photos to save general results len do output : 1 /20891033. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964345', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964341', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964338', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964333', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964325', None, None, None, None, None, '2620645') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013541460037231445 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9815938472747803 time spend to save output : 0.01394510269165039 total time spend for step 7 : 1.9955389499664307 step8:final Fri Feb 28 05:24:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1339964345: ('0.23532760501848093',), 1339964341: ('0.23532760501848093',), 1339964338: ('0.23532760501848093',), 1339964333: ('0.23532760501848093',), 1339964325: ('0.23532760501848093',)} new output for save of step final : {1339964345: ('0.23532760501848093',), 1339964341: ('0.23532760501848093',), 1339964338: ('0.23532760501848093',), 1339964333: ('0.23532760501848093',), 1339964325: ('0.23532760501848093',)} [1339964345, 1339964341, 1339964338, 1339964333, 1339964325] Looping around the photos to save general results len do output : 5 /1339964345.Didn't retrieve data . /1339964341.Didn't retrieve data . /1339964338.Didn't retrieve data . /1339964333.Didn't retrieve data . /1339964325.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964345', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964341', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964338', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964333', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964325', None, None, None, None, None, '2620645') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013414144515991211 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1363844871520996 time spend to save output : 0.013734817504882812 total time spend for step 8 : 0.15011930465698242 step9:velours_tree Fri Feb 28 05:24:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20899978,20899979,20899980,20899984,20899988,20899991,20899985,20899992,20899989,20899990,20899993,20899994,20899995 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899978 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899979 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899980 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899984 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899988 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899991 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899985 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899992 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899989 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899990 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899993 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899994 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20899995 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 5000 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 0 5 ... 1 0 1] Elapsed time: 16.8651180267334 graph_id used : 80618 - Beta version, working pretty good on 11-5-16 ! too many photos (6124 more than 5000) Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 337.5675277709961 time spend to save output : 0.6565277576446533 total time spend for step 9 : 338.22405552864075 step10:send_mail_cod Fri Feb 28 05:29:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20891033_28-02-2025_05_29_56.pdf 20899961 imagette208999611740716996 20899962 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette208999621740716996 20899966 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette208999661740716998 20899970 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette208999701740716999 20899973 imagette208999731740717000 20899967 imagette208999671740717000 20899974 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette208999741740717000 20899971 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette208999711740717001 20899972 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette208999721740717003 20899975 imagette208999751740717004 20899976 imagette208999761740717004 20899977 imagette208999771740717004 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20891033 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20899978,20899979,20899980,20899984,20899988,20899991,20899985,20899992,20899989,20899990,20899993,20899994,20899995?tags=environnement,film_plastique,autre,carton,papier,pet_fonce,tetrapak,pehd,pet_clair,metal,flou,mal_croppe,refus&datou_id_consolidate=4235&port_consolidate=20891033 your option no_mail is active, we will not send the real mail to your client args[1339964345] : ((1339964345, -7.044891895387023, 492609224), (1339964345, -0.9929995008403227, 501862349), '0.23532760501848093') We are sending mail with results at cod@fotonower.com args[1339964341] : ((1339964341, -7.0231358313947725, 492609224), (1339964341, -0.9781227958155495, 501862349), '0.23532760501848093') We are sending mail with results at cod@fotonower.com args[1339964338] : ((1339964338, -7.054640511523418, 492609224), (1339964338, -0.9700640620049007, 501862349), '0.23532760501848093') We are sending mail with results at cod@fotonower.com args[1339964333] : ((1339964333, -7.033384610832983, 492609224), (1339964333, -0.9741666290802183, 501862349), '0.23532760501848093') We are sending mail with results at cod@fotonower.com args[1339964325] : ((1339964325, -7.060390605880712, 492609224), (1339964325, -0.9563348527605092, 501862349), '0.23532760501848093') We are sending mail with results at cod@fotonower.com refus_total : 0.23532760501848093 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20891033 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891033_28-02-2025_05_29_56.pdf results_Qualipapia_P20891033_28-02-2025_05_29_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891033_28-02-2025_05_29_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20891033','results_Qualipapia_P20891033_28-02-2025_05_29_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891033_28-02-2025_05_29_56.pdf','pdf','','0.23','0.23532760501848093') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1339964345, 1339964341, 1339964338, 1339964333, 1339964325] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964345', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964341', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964338', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964333', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964325', None, None, None, None, None, '2620645') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.11147880554199219 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.537739515304565 time spend to save output : 0.11175656318664551 total time spend for step 10 : 9.649496078491211 step11:split_time_score Fri Feb 28 05:30:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 110),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27022025 20891033 Nombre de photos uploadées : 110 / 23040 (0%) 27022025 20891033 Nombre de photos taguées (types de déchets): 110 / 110 (100%) 27022025 20891033 Nombre de photos taguées (volume) : 0 / 110 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 8.106231689453125e-06 ?????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0054323673248291016 elapsed_time : insert_dashboard_record_day_entry 0.02464914321899414 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.19685402815434147 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880914_27-02-2025_15_47_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880914 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880914 AND mptpi.`type`=4230 To do Qualite : 0.21152497949138183 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880915_27-02-2025_15_54_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880915 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880915 AND mptpi.`type`=4230 To do Qualite : 0.18979229772842968 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880916_27-02-2025_16_14_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880916 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880916 AND mptpi.`type`=4230 To do Qualite : 0.22691391007392073 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880917_27-02-2025_16_18_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880917 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880917 AND mptpi.`type`=4230 To do Qualite : 0.2513147479157829 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880918_27-02-2025_16_24_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880918 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880918 AND mptpi.`type`=4230 To do Qualite : 0.25009736379758823 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880919_27-02-2025_15_47_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880919 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880919 AND mptpi.`type`=4230 To do Qualite : 0.11007267109192401 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880920_27-02-2025_14_46_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880920 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880920 AND mptpi.`type`=4230 To do Qualite : 0.19961527896716455 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20880921_27-02-2025_12_49_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20880921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20880921 AND mptpi.`type`=4230 To do Qualite : 0.2407666415285407 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20881153_27-02-2025_13_22_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20881153 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20881153 AND mptpi.`type`=4230 To do Qualite : 0.16957394556367378 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20881154_27-02-2025_13_19_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20881154 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20881154 AND mptpi.`type`=4230 To do Qualite : 0.1847201060328798 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20881155_27-02-2025_15_46_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20881155 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20881155 AND mptpi.`type`=4230 To do Qualite : 0.22728245879244777 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20881447_27-02-2025_13_47_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20881447 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20881447 AND mptpi.`type`=4230 To do Qualite : 0.17626552099815018 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885729_27-02-2025_20_58_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885729 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885729 AND mptpi.`type`=4230 To do Qualite : 0.2226373081351226 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885731_27-02-2025_21_03_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885731 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885731 AND mptpi.`type`=4230 To do Qualite : 0.2160402578335216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885733_27-02-2025_21_07_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885733 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885733 AND mptpi.`type`=4230 To do Qualite : 0.2150972751637293 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885735_27-02-2025_17_48_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885735 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885735 AND mptpi.`type`=4230 To do Qualite : 0.21161213433613119 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885737_27-02-2025_21_27_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885737 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885737 AND mptpi.`type`=4230 To do Qualite : 0.19207157935691652 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885739_27-02-2025_16_47_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885739 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885739 AND mptpi.`type`=4230 To do Qualite : 0.1820895488940009 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20885740_27-02-2025_17_33_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20885740 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20885740 AND mptpi.`type`=4230 To do Qualite : 0.1987515355230658 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888085_27-02-2025_22_47_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888085 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888085 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888086 order by id desc limit 1 Qualite : 0.16646903302631547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888087_27-02-2025_22_57_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888087 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888087 AND mptpi.`type`=4230 To do Qualite : 0.21162826992937084 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888088_27-02-2025_18_40_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888088 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888088 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888339 order by id desc limit 1 Qualite : 0.22637596140207053 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888340_27-02-2025_23_57_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888340 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888340 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888341 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888342 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888343 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888344 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888345 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888346 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888347 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888348 order by id desc limit 1 Qualite : 0.16811916136619814 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888349_27-02-2025_18_47_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888349 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888349 AND mptpi.`type`=4230 To do Qualite : 0.15953951709869643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888709_28-02-2025_02_02_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888709 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888709 AND mptpi.`type`=4230 To do Qualite : 0.1718124027565281 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888710_28-02-2025_02_23_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888710 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888710 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888711 order by id desc limit 1 Qualite : 0.17129870981396472 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888712_28-02-2025_02_21_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888712 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888712 AND mptpi.`type`=4230 To do Qualite : 0.19061174492101876 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888713_28-02-2025_02_24_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888713 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888713 AND mptpi.`type`=4230 To do Qualite : 0.2073025473729617 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888714_28-02-2025_02_29_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888714 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888714 AND mptpi.`type`=4230 To do Qualite : 0.12320528039979477 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888715_28-02-2025_03_17_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888715 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888715 AND mptpi.`type`=4230 To do Qualite : 0.2016483183694775 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888716_28-02-2025_02_37_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888716 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888716 AND mptpi.`type`=4230 To do Qualite : 0.18895236027103013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888717_28-02-2025_04_33_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888717 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888717 AND mptpi.`type`=4230 To do Qualite : 0.08852324952552083 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888718_28-02-2025_02_52_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888718 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888718 AND mptpi.`type`=4230 To do Qualite : 0.23367328954054498 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888719_28-02-2025_02_57_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888719 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888719 AND mptpi.`type`=4230 To do Qualite : 0.2064208926692625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888720_28-02-2025_03_02_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888720 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888720 AND mptpi.`type`=4230 To do Qualite : 0.18664316475994175 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888721_28-02-2025_03_10_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888721 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888721 AND mptpi.`type`=4230 To do Qualite : 0.2028878797674792 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888722_28-02-2025_03_19_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888722 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888722 AND mptpi.`type`=4230 To do Qualite : 0.16689976746289348 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888723_28-02-2025_03_18_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888723 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888723 AND mptpi.`type`=4230 To do Qualite : 0.16981797891253236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888724_27-02-2025_19_34_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888724 AND mptpi.`type`=4230 To do Qualite : 0.17044993311570272 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888725_27-02-2025_19_22_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888725 AND mptpi.`type`=4230 To do Qualite : 0.15717663944229918 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20888726_27-02-2025_19_18_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20888726 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20888726 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889794 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889795 order by id desc limit 1 Qualite : 0.1415010598512813 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889796_28-02-2025_03_58_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889796 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889796 AND mptpi.`type`=4230 To do Qualite : 0.21159475601791009 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889797_28-02-2025_04_02_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889797 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889797 AND mptpi.`type`=4230 To do Qualite : 0.173358398566582 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889798_28-02-2025_04_08_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889798 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889798 AND mptpi.`type`=4230 To do Qualite : 0.1694694685645321 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889799_28-02-2025_01_47_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889799 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889799 AND mptpi.`type`=4230 To do Qualite : 0.16570148489532288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20889800_28-02-2025_01_24_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20889800 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20889800 AND mptpi.`type`=4230 To do Qualite : 0.23774034162320024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891033_28-02-2025_05_29_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891033 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891033 AND mptpi.`type`=4230 To do Qualite : 0.23567691447106798 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891034_27-02-2025_23_35_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891034 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891034 AND mptpi.`type`=4230 To do Qualite : 0.2498587351726735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891035_27-02-2025_21_07_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891035 AND mptpi.`type`=4230 To do Qualite : 0.2473345296710318 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891036_27-02-2025_22_54_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891036 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891036 AND mptpi.`type`=4230 To do Qualite : 0.25475831753092626 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891037_27-02-2025_22_36_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891037 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891037 AND mptpi.`type`=4230 To do Qualite : 0.24580568531663002 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20891038_27-02-2025_20_19_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20891038 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20891038 AND mptpi.`type`=4230 To do Qualite : 0.17561677212499766 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20893121_27-02-2025_21_23_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20893121 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20893121 AND mptpi.`type`=4230 To do Qualite : 0.17483690139268926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20894292_27-02-2025_21_48_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20894292 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20894292 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27022025': {'nb_upload': 110, 'nb_taggue_class': 110, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1339964345, 1339964341, 1339964338, 1339964333, 1339964325] Looping around the photos to save general results len do output : 1 /20891033Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964345', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964341', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964338', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964333', None, None, None, None, None, '2620645') ('4234', None, None, None, None, None, None, None, '2620645') ('4234', None, '1339964325', None, None, None, None, None, '2620645') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.05233621597290039 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.10625958442688 time spend to save output : 0.05249357223510742 total time spend for step 11 : 14.158753156661987 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 89.85user 43.11system 9:55.72elapsed 22%CPU (0avgtext+0avgdata 2424076maxresident)k 2039192inputs+61008outputs (22728major+2621407minor)pagefaults 0swaps