python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2015922 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2610482'] with mtr_portfolio_ids : ['20779166'] and first list_photo_ids : [] new path : /proc/2015922/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.5791873931884766 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Feb 24 20:20:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-24 20:20:35.386527: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-24 20:20:35.415090: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-24 20:20:35.416856: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f79ac000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-24 20:20:35.416906: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-24 20:20:35.419422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-24 20:20:35.630936: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xae71560 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-24 20:20:35.630980: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-24 20:20:35.632373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 20:20:35.632765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 20:20:35.635953: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 20:20:35.639018: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 20:20:35.639534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 20:20:35.642409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 20:20:35.643745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 20:20:35.649465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 20:20:35.651442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 20:20:35.651529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 20:20:35.652558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-24 20:20:35.652578: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-24 20:20:35.652591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-24 20:20:35.653870: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-24 20:20:35.910360: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 20:20:35.910504: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 20:20:35.910537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 20:20:35.910568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 20:20:35.910597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 20:20:35.910626: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 20:20:35.910654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 20:20:35.910683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 20:20:35.912599: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 20:20:35.913762: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 20:20:35.913797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 20:20:35.913813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 20:20:35.913827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 20:20:35.913841: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 20:20:35.913854: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 20:20:35.913868: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 20:20:35.913882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 20:20:35.915088: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 20:20:35.915124: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-24 20:20:35.915133: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-24 20:20:35.915141: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-24 20:20:35.916440: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-24 20:20:43.164873: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 20:20:43.367340: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.32109 max: 149.97891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 35 time to create 1 rle with old method : 0.0001595020294189453 length of segment : 25 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 956 time to create 1 rle with old method : 0.0018134117126464844 length of segment : 37 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.0002474784851074219 length of segment : 36 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 913 time to create 1 rle with old method : 0.001359701156616211 length of segment : 43 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0002853870391845703 length of segment : 13 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.0001552104949951172 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.96563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004069805145263672 length of segment : 36 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00018310546875 length of segment : 20 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2443 time to create 1 rle with old method : 0.0033168792724609375 length of segment : 54 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0012657642364501953 length of segment : 39 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 2793 time to create 1 rle with old method : 0.003887653350830078 length of segment : 56 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.77031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 2546 time to create 1 rle with old method : 0.0033173561096191406 length of segment : 109 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0010950565338134766 length of segment : 25 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00040912628173828125 length of segment : 15 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.0006794929504394531 length of segment : 37 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 2224 time to create 1 rle with old method : 0.0037059783935546875 length of segment : 91 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00045037269592285156 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.29375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 217.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 88.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0009613037109375 length of segment : 27 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002758502960205078 length of segment : 17 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 2243 time to create 1 rle with old method : 0.003150463104248047 length of segment : 61 time for calcul the mask position with numpy : 0.0007460117340087891 nb_pixel_total : 65456 time to create 1 rle with old method : 0.10526084899902344 length of segment : 288 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 193.00000 molded_images shape: (1, 640, 640, 3) min: -92.86406 max: 75.14687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.31719 max: 146.52187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.00039696693420410156 length of segment : 19 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0005471706390380859 length of segment : 25 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 2414 time to create 1 rle with old method : 0.004012346267700195 length of segment : 48 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004525184631347656 length of segment : 49 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0006835460662841797 length of segment : 20 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 161 time to create 1 rle with old method : 0.0006968975067138672 length of segment : 23 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0004296302795410156 length of segment : 21 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0004367828369140625 length of segment : 26 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00024509429931640625 length of segment : 18 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0008301734924316406 length of segment : 21 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 838 time to create 1 rle with old method : 0.0013616085052490234 length of segment : 32 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0013065338134765625 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.53984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 978 time to create 1 rle with old method : 0.0015897750854492188 length of segment : 33 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 736 time to create 1 rle with old method : 0.0012025833129882812 length of segment : 28 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.001007080078125 length of segment : 39 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 681 time to create 1 rle with old method : 0.0009474754333496094 length of segment : 42 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1898 time to create 1 rle with old method : 0.002717256546020508 length of segment : 41 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 785 time to create 1 rle with old method : 0.0013339519500732422 length of segment : 38 time for calcul the mask position with numpy : 0.00014448165893554688 nb_pixel_total : 4220 time to create 1 rle with old method : 0.005451679229736328 length of segment : 82 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 16 time to create 1 rle with old method : 7.033348083496094e-05 length of segment : 10 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002644062042236328 length of segment : 45 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 1879 time to create 1 rle with old method : 0.0040283203125 length of segment : 40 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0010526180267333984 length of segment : 25 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0025365352630615234 length of segment : 46 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0011820793151855469 length of segment : 35 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006191730499267578 length of segment : 59 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.80547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.001833200454711914 length of segment : 50 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1019 time to create 1 rle with old method : 0.002148866653442383 length of segment : 34 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 1113 time to create 1 rle with old method : 0.005603790283203125 length of segment : 39 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0023775100708007812 length of segment : 37 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0008087158203125 length of segment : 27 time for calcul the mask position with numpy : 0.00012183189392089844 nb_pixel_total : 2210 time to create 1 rle with old method : 0.0030548572540283203 length of segment : 101 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 218.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 81.48281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 762 time to create 1 rle with old method : 0.0011889934539794922 length of segment : 29 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 1307 time to create 1 rle with old method : 0.002211332321166992 length of segment : 136 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0017702579498291016 length of segment : 84 time for calcul the mask position with numpy : 0.00020432472229003906 nb_pixel_total : 3475 time to create 1 rle with old method : 0.005608081817626953 length of segment : 183 Processing 1 images image shape: (280, 400, 3) min: 15.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 71.96719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0011513233184814453 nb_pixel_total : 106672 time to create 1 rle with old method : 0.1253669261932373 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.49062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00027441978454589844 length of segment : 13 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.0008645057678222656 length of segment : 31 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 14 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00038170814514160156 length of segment : 17 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.00012731552124023438 length of segment : 10 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00015211105346679688 length of segment : 12 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1186 time to create 1 rle with old method : 0.0015308856964111328 length of segment : 45 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 2318 time to create 1 rle with old method : 0.0029439926147460938 length of segment : 80 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.0011682510375976562 length of segment : 50 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 50 time to create 1 rle with old method : 0.00011348724365234375 length of segment : 11 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 1117 time to create 1 rle with old method : 0.0016369819641113281 length of segment : 112 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00035262107849121094 length of segment : 27 time for calcul the mask position with numpy : 0.0007765293121337891 nb_pixel_total : 50257 time to create 1 rle with old method : 0.06069326400756836 length of segment : 275 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007789134979248047 length of segment : 53 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.70937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 1468 time to create 1 rle with old method : 0.0018029212951660156 length of segment : 50 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 735 time to create 1 rle with old method : 0.00098419189453125 length of segment : 49 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005156993865966797 length of segment : 19 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00015544891357421875 length of segment : 16 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.00032448768615722656 length of segment : 13 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005979537963867188 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003781318664550781 length of segment : 21 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006949901580810547 length of segment : 38 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.00039267539978027344 length of segment : 19 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.000247955322265625 length of segment : 14 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0008213520050048828 length of segment : 27 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00034809112548828125 length of segment : 18 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003390312194824219 length of segment : 16 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0009427070617675781 length of segment : 29 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006282329559326172 length of segment : 22 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.00043010711669921875 length of segment : 21 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0007343292236328125 length of segment : 26 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 824 time to create 1 rle with old method : 0.001112222671508789 length of segment : 25 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.0006852149963378906 length of segment : 36 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 632 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 26 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0007069110870361328 length of segment : 33 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.83047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 3 time to create 1 rle with old method : 3.9577484130859375e-05 length of segment : 3 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003731250762939453 length of segment : 29 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0004088878631591797 length of segment : 19 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00034332275390625 length of segment : 20 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0008008480072021484 length of segment : 31 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 17 time to create 1 rle with old method : 5.0067901611328125e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.78984 max: 149.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 929 time to create 1 rle with old method : 0.0012748241424560547 length of segment : 42 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002281665802001953 length of segment : 21 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001323223114013672 length of segment : 25 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 23 time to create 1 rle with old method : 6.794929504394531e-05 length of segment : 12 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00012731552124023438 length of segment : 28 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 809 time to create 1 rle with old method : 0.0010755062103271484 length of segment : 39 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 1 time to create 1 rle with old method : 2.4557113647460938e-05 length of segment : 1 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0011169910430908203 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00032448768615722656 length of segment : 34 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 900 time to create 1 rle with old method : 0.0011756420135498047 length of segment : 39 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001952648162841797 length of segment : 25 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00022673606872558594 length of segment : 23 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 2269 time to create 1 rle with old method : 0.0027930736541748047 length of segment : 55 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 2443 time to create 1 rle with old method : 0.003178834915161133 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.97344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00023794174194335938 nb_pixel_total : 10335 time to create 1 rle with old method : 0.01573634147644043 length of segment : 136 time for calcul the mask position with numpy : 0.00014662742614746094 nb_pixel_total : 4083 time to create 1 rle with old method : 0.005301952362060547 length of segment : 45 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0003826618194580078 length of segment : 14 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009033679962158203 length of segment : 46 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00028705596923828125 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.63359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0007517337799072266 length of segment : 24 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.000274658203125 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 222.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 100.13516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0007848739624023438 length of segment : 22 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002434253692626953 length of segment : 16 time for calcul the mask position with numpy : 0.0007004737854003906 nb_pixel_total : 68896 time to create 1 rle with old method : 0.08724546432495117 length of segment : 278 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 1338 time to create 1 rle with old method : 0.001834869384765625 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 192.00000 molded_images shape: (1, 640, 640, 3) min: -90.69219 max: 69.33437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.50859 max: 146.83437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00030803680419921875 length of segment : 18 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 2459 time to create 1 rle with old method : 0.003209829330444336 length of segment : 48 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0007028579711914062 length of segment : 25 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00017642974853515625 length of segment : 18 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018358230590820312 length of segment : 20 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005962848663330078 length of segment : 22 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0004153251647949219 length of segment : 23 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00021004676818847656 length of segment : 43 time for calcul the mask position with numpy : 0.0002696514129638672 nb_pixel_total : 6646 time to create 1 rle with old method : 0.00767064094543457 length of segment : 136 time for calcul the mask position with numpy : 0.0002753734588623047 nb_pixel_total : 9122 time to create 1 rle with old method : 0.011374711990356445 length of segment : 230 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006639957427978516 length of segment : 27 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005974769592285156 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.84063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0009033679962158203 length of segment : 41 time for calcul the mask position with numpy : 0.00010228157043457031 nb_pixel_total : 2352 time to create 1 rle with old method : 0.003177165985107422 length of segment : 80 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0010330677032470703 length of segment : 34 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0011739730834960938 length of segment : 33 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0015256404876708984 length of segment : 65 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.00029468536376953125 length of segment : 49 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003478527069091797 length of segment : 13 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1630 time to create 1 rle with old method : 0.002103567123413086 length of segment : 75 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 713 time to create 1 rle with old method : 0.0010228157043457031 length of segment : 20 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1556 time to create 1 rle with old method : 0.0020895004272460938 length of segment : 40 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1261 time to create 1 rle with old method : 0.0017316341400146484 length of segment : 36 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.001065969467163086 length of segment : 33 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002512931823730469 length of segment : 12 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1825 time to create 1 rle with old method : 0.002268552780151367 length of segment : 36 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0010614395141601562 length of segment : 31 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005497932434082031 length of segment : 32 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1884 time to create 1 rle with old method : 0.0022079944610595703 length of segment : 37 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1409 time to create 1 rle with old method : 0.0018603801727294922 length of segment : 35 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0008993148803710938 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.32500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0007882118225097656 length of segment : 25 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 995 time to create 1 rle with old method : 0.0019431114196777344 length of segment : 33 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 1850 time to create 1 rle with old method : 0.002389192581176758 length of segment : 133 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0009248256683349609 length of segment : 39 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 1129 time to create 1 rle with old method : 0.001712799072265625 length of segment : 40 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0016906261444091797 length of segment : 40 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.00041031837463378906 length of segment : 45 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1346 time to create 1 rle with old method : 0.0017025470733642578 length of segment : 42 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 212.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 86.18828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.0010647773742675781 length of segment : 105 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.0010449886322021484 length of segment : 34 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 3158 time to create 1 rle with old method : 0.0038919448852539062 length of segment : 196 Processing 1 images image shape: (280, 400, 3) min: 14.00000 max: 182.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 67.84609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010683536529541016 nb_pixel_total : 105793 time to create 1 rle with old method : 0.135284423828125 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.15469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0003669261932373047 length of segment : 12 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00036215782165527344 length of segment : 12 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 52 time to create 1 rle with old method : 0.00014257431030273438 length of segment : 8 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1094 time to create 1 rle with old method : 0.0020029544830322266 length of segment : 53 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0006606578826904297 length of segment : 18 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0013802051544189453 length of segment : 22 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0003495216369628906 length of segment : 17 time for calcul the mask position with numpy : 0.0001392364501953125 nb_pixel_total : 3299 time to create 1 rle with old method : 0.005397319793701172 length of segment : 64 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00013303756713867188 length of segment : 13 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 782 time to create 1 rle with old method : 0.0010540485382080078 length of segment : 67 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003445148468017578 length of segment : 24 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001957416534423828 length of segment : 14 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 2729 time to create 1 rle with old method : 0.0034072399139404297 length of segment : 43 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.00041222572326660156 length of segment : 24 time for calcul the mask position with numpy : 0.0006394386291503906 nb_pixel_total : 49356 time to create 1 rle with old method : 0.0564730167388916 length of segment : 281 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 2703 time to create 1 rle with old method : 0.003504514694213867 length of segment : 48 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 3425 time to create 1 rle with old method : 0.00436854362487793 length of segment : 65 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0011224746704101562 length of segment : 43 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0006074905395507812 length of segment : 21 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0006330013275146484 length of segment : 23 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1466 time to create 1 rle with old method : 0.0018832683563232422 length of segment : 52 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.00041604042053222656 length of segment : 22 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0008044242858886719 length of segment : 24 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005249977111816406 length of segment : 18 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003552436828613281 length of segment : 15 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003199577331542969 length of segment : 13 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009324550628662109 length of segment : 24 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003485679626464844 length of segment : 32 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0009560585021972656 length of segment : 29 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003409385681152344 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003135204315185547 length of segment : 12 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 808 time to create 1 rle with old method : 0.0010838508605957031 length of segment : 48 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007781982421875 length of segment : 27 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00023794174194335938 length of segment : 15 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006692409515380859 length of segment : 40 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.84219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0008237361907958984 length of segment : 28 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0004987716674804688 length of segment : 22 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0005738735198974609 length of segment : 26 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00025343894958496094 length of segment : 21 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 17 time to create 1 rle with old method : 7.581710815429688e-05 length of segment : 4 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0008611679077148438 length of segment : 33 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 37 time to create 1 rle with old method : 8.130073547363281e-05 length of segment : 16 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.30156 max: 145.43203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 904 time to create 1 rle with old method : 0.0012791156768798828 length of segment : 40 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 20 time to create 1 rle with old method : 6.031990051269531e-05 length of segment : 14 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 895 time to create 1 rle with old method : 0.001163482666015625 length of segment : 41 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002734661102294922 length of segment : 26 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.00012183189392089844 length of segment : 31 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0010712146759033203 length of segment : 34 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.00011539459228515625 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.80938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.0003364086151123047 length of segment : 34 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 40 time to create 1 rle with old method : 9.465217590332031e-05 length of segment : 8 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.00031065940856933594 length of segment : 28 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.0014450550079345703 length of segment : 36 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 2398 time to create 1 rle with old method : 0.004141807556152344 length of segment : 54 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0009016990661621094 length of segment : 42 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00040030479431152344 length of segment : 37 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 2271 time to create 1 rle with old method : 0.004090070724487305 length of segment : 48 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 2173 time to create 1 rle with old method : 0.0037050247192382812 length of segment : 46 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2654 time to create 1 rle with old method : 0.0032281875610351562 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.73906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.0002715587615966797 nb_pixel_total : 14179 time to create 1 rle with old method : 0.01638031005859375 length of segment : 144 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 7142 time to create 1 rle with old method : 0.00835561752319336 length of segment : 124 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 2058 time to create 1 rle with old method : 0.0027108192443847656 length of segment : 72 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00033783912658691406 length of segment : 11 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 1925 time to create 1 rle with old method : 0.002588033676147461 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.24297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002903938293457031 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 228.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 100.06094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002460479736328125 length of segment : 15 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 588 time to create 1 rle with old method : 0.0008037090301513672 length of segment : 22 time for calcul the mask position with numpy : 0.0007314682006835938 nb_pixel_total : 68725 time to create 1 rle with old method : 0.07685089111328125 length of segment : 304 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.000766754150390625 length of segment : 21 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 1105 time to create 1 rle with old method : 0.0014090538024902344 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 192.00000 molded_images shape: (1, 640, 640, 3) min: -93.63750 max: 73.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.99297 max: 147.13516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 18 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005831718444824219 length of segment : 22 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.00043392181396484375 length of segment : 45 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 2433 time to create 1 rle with old method : 0.004025936126708984 length of segment : 49 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0008487701416015625 length of segment : 27 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004451274871826172 length of segment : 22 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00035834312438964844 length of segment : 26 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 8179 time to create 1 rle with old method : 0.009653568267822266 length of segment : 114 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00035262107849121094 length of segment : 27 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001666545867919922 length of segment : 19 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 536 time to create 1 rle with old method : 0.0008101463317871094 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.69219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0009653568267822266 length of segment : 34 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 734 time to create 1 rle with old method : 0.0010666847229003906 length of segment : 20 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1376 time to create 1 rle with old method : 0.0019176006317138672 length of segment : 30 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00029659271240234375 length of segment : 12 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1734 time to create 1 rle with old method : 0.0027658939361572266 length of segment : 39 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1640 time to create 1 rle with old method : 0.002962827682495117 length of segment : 45 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.001338958740234375 length of segment : 31 time for calcul the mask position with numpy : 0.00019598007202148438 nb_pixel_total : 2368 time to create 1 rle with old method : 0.004126548767089844 length of segment : 84 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 728 time to create 1 rle with old method : 0.0009095668792724609 length of segment : 41 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1106 time to create 1 rle with old method : 0.0016434192657470703 length of segment : 39 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.001003265380859375 length of segment : 22 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1183 time to create 1 rle with old method : 0.0015342235565185547 length of segment : 37 time for calcul the mask position with numpy : 0.00011157989501953125 nb_pixel_total : 1947 time to create 1 rle with old method : 0.002386331558227539 length of segment : 131 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 995 time to create 1 rle with old method : 0.001481771469116211 length of segment : 35 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1352 time to create 1 rle with old method : 0.002109050750732422 length of segment : 42 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00045752525329589844 length of segment : 17 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 226.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 89.04531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00013446807861328125 nb_pixel_total : 1422 time to create 1 rle with old method : 0.003088235855102539 length of segment : 133 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 1517 time to create 1 rle with old method : 0.0018665790557861328 length of segment : 80 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.0010502338409423828 length of segment : 34 time for calcul the mask position with numpy : 0.00020170211791992188 nb_pixel_total : 3707 time to create 1 rle with old method : 0.0049250125885009766 length of segment : 191 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0015289783477783203 length of segment : 99 time for calcul the mask position with numpy : 0.00016689300537109375 nb_pixel_total : 3822 time to create 1 rle with old method : 0.0045583248138427734 length of segment : 207 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.71719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009260177612304688 nb_pixel_total : 106667 time to create 1 rle with old method : 0.11887097358703613 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.79141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002868175506591797 length of segment : 12 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009238719940185547 length of segment : 28 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002181529998779297 length of segment : 12 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 987 time to create 1 rle with old method : 0.0012507438659667969 length of segment : 50 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00040793418884277344 length of segment : 32 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2513 time to create 1 rle with old method : 0.003127574920654297 length of segment : 64 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1195 time to create 1 rle with old method : 0.001665353775024414 length of segment : 73 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.0008587837219238281 length of segment : 47 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00012183189392089844 length of segment : 9 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00011277198791503906 length of segment : 12 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2686 time to create 1 rle with old method : 0.0032553672790527344 length of segment : 68 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.0006895065307617188 length of segment : 57 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0008807182312011719 length of segment : 44 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.44375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.0013663768768310547 length of segment : 46 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.001028299331665039 length of segment : 26 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 642 time to create 1 rle with old method : 0.0011906623840332031 length of segment : 24 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.001116037368774414 length of segment : 28 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1500 time to create 1 rle with old method : 0.002558469772338867 length of segment : 52 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.00041985511779785156 length of segment : 12 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.00046706199645996094 length of segment : 18 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0006585121154785156 length of segment : 22 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0005147457122802734 length of segment : 21 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0011227130889892578 length of segment : 21 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0007016658782958984 length of segment : 19 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1308 time to create 1 rle with old method : 0.002306699752807617 length of segment : 50 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0009465217590332031 length of segment : 30 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006365776062011719 length of segment : 35 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005519390106201172 length of segment : 38 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006241798400878906 length of segment : 24 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0006153583526611328 length of segment : 40 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.97109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00036263465881347656 length of segment : 21 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.00043845176696777344 length of segment : 23 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003941059112548828 length of segment : 17 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 14 time to create 1 rle with old method : 6.4849853515625e-05 length of segment : 8 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00013589859008789062 length of segment : 11 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.66250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 16 time to create 1 rle with old method : 5.245208740234375e-05 length of segment : 4 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001609325408935547 length of segment : 26 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 431 time to create 1 rle with old method : 0.0005500316619873047 length of segment : 31 time for calcul the mask position with numpy : 0.0004775524139404297 nb_pixel_total : 40062 time to create 1 rle with old method : 0.044936180114746094 length of segment : 384 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.23516 max: 149.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.0011556148529052734 length of segment : 40 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00019097328186035156 length of segment : 15 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 50 time to create 1 rle with old method : 9.822845458984375e-05 length of segment : 28 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00025534629821777344 length of segment : 18 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.001184701919555664 length of segment : 39 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 890 time to create 1 rle with old method : 0.0011878013610839844 length of segment : 36 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 36 time to create 1 rle with old method : 7.62939453125e-05 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.18828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0013756752014160156 length of segment : 30 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 33 time to create 1 rle with old method : 6.914138793945312e-05 length of segment : 7 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 2428 time to create 1 rle with old method : 0.003045797348022461 length of segment : 49 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 1001 time to create 1 rle with old method : 0.0012814998626708984 length of segment : 32 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00012183189392089844 length of segment : 16 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 1000 time to create 1 rle with old method : 0.0013079643249511719 length of segment : 33 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 2595 time to create 1 rle with old method : 0.0030975341796875 length of segment : 57 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 2890 time to create 1 rle with old method : 0.0034942626953125 length of segment : 56 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.0009980201721191406 length of segment : 33 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 798 time to create 1 rle with old method : 0.000989675521850586 length of segment : 34 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0010929107666015625 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.03203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 2257 time to create 1 rle with old method : 0.003224611282348633 length of segment : 74 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 3704 time to create 1 rle with old method : 0.004736423492431641 length of segment : 68 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0002868175506591797 length of segment : 10 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0003399848937988281 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.27813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00042319297790527344 length of segment : 23 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021004676818847656 length of segment : 17 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005235671997070312 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 223.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 96.60781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0007293224334716797 length of segment : 24 time for calcul the mask position with numpy : 0.0006098747253417969 nb_pixel_total : 59905 time to create 1 rle with old method : 0.06684398651123047 length of segment : 295 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 59854 time to create 1 rle with old method : 0.06546592712402344 length of segment : 254 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 187.00000 molded_images shape: (1, 640, 640, 3) min: -92.62188 max: 69.33437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.81719 max: 148.67031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 2545 time to create 1 rle with old method : 0.0032842159271240234 length of segment : 50 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004093647003173828 length of segment : 55 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0009551048278808594 length of segment : 80 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.000331878662109375 length of segment : 18 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0006306171417236328 length of segment : 23 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 766 time to create 1 rle with old method : 0.000995635986328125 length of segment : 32 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001876354217529297 length of segment : 20 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00019431114196777344 length of segment : 17 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 8324 time to create 1 rle with old method : 0.00954890251159668 length of segment : 119 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00037169456481933594 length of segment : 27 time for calcul the mask position with numpy : 0.00011944770812988281 nb_pixel_total : 7631 time to create 1 rle with old method : 0.00924539566040039 length of segment : 106 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0008692741394042969 length of segment : 30 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00044608116149902344 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.69219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 687 time to create 1 rle with old method : 0.0008625984191894531 length of segment : 43 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0015897750854492188 length of segment : 30 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.001293182373046875 length of segment : 58 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 4395 time to create 1 rle with old method : 0.0052869319915771484 length of segment : 94 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0008094310760498047 length of segment : 42 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.001032114028930664 length of segment : 35 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003170967102050781 length of segment : 23 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1399 time to create 1 rle with old method : 0.001852273941040039 length of segment : 49 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1787 time to create 1 rle with old method : 0.002359628677368164 length of segment : 42 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 2916 time to create 1 rle with old method : 0.0036516189575195312 length of segment : 76 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.36016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0016341209411621094 length of segment : 39 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 970 time to create 1 rle with old method : 0.0013544559478759766 length of segment : 33 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 694 time to create 1 rle with old method : 0.0008618831634521484 length of segment : 40 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1091 time to create 1 rle with old method : 0.0014984607696533203 length of segment : 37 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 998 time to create 1 rle with old method : 0.0013921260833740234 length of segment : 33 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 223.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 90.25078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.001058340072631836 length of segment : 36 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 1333 time to create 1 rle with old method : 0.0017824172973632812 length of segment : 158 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1197 time to create 1 rle with old method : 0.001535654067993164 length of segment : 115 Processing 1 images image shape: (280, 400, 3) min: 7.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 71.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009019374847412109 nb_pixel_total : 106593 time to create 1 rle with old method : 0.11922001838684082 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.30703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00026607513427734375 length of segment : 13 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 614 time to create 1 rle with old method : 0.0008232593536376953 length of segment : 28 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1019 time to create 1 rle with old method : 0.0012972354888916016 length of segment : 49 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 16 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002923011779785156 length of segment : 13 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00012874603271484375 length of segment : 9 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002906322479248047 length of segment : 24 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00023102760314941406 length of segment : 15 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 987 time to create 1 rle with old method : 0.0012409687042236328 length of segment : 54 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0005104541778564453 length of segment : 23 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00011658668518066406 length of segment : 13 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00036406517028808594 length of segment : 30 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 3004 time to create 1 rle with old method : 0.0035741329193115234 length of segment : 63 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.70156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.001020193099975586 length of segment : 47 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0007152557373046875 length of segment : 27 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 33 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003046989440917969 length of segment : 13 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0005075931549072266 length of segment : 18 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0007917881011962891 length of segment : 26 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.00029921531677246094 length of segment : 14 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003829002380371094 length of segment : 19 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1467 time to create 1 rle with old method : 0.0018482208251953125 length of segment : 51 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0006921291351318359 length of segment : 25 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00012683868408203125 length of segment : 15 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008099079132080078 length of segment : 25 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0008845329284667969 length of segment : 21 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0011281967163085938 length of segment : 26 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005421638488769531 length of segment : 30 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003197193145751953 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.27187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003955364227294922 length of segment : 27 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003352165222167969 length of segment : 22 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001552104949951172 length of segment : 11 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 19 time to create 1 rle with old method : 5.507469177246094e-05 length of segment : 4 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00023031234741210938 length of segment : 20 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002903938293457031 length of segment : 42 time for calcul the mask position with numpy : 0.0004265308380126953 nb_pixel_total : 34798 time to create 1 rle with old method : 0.0384523868560791 length of segment : 244 Detection mask done ! Trying to reset tf kernel 2016587 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 406 len(list_Values) 406 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 406 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 406 chid ids of type : 4228 Number RLEs to save : 18677 save missing photos in datou_result : time spend for datou_step_exec : 29.432875871658325 time spend to save output : 1.3984498977661133 total time spend for step 1 : 30.83132576942444 step2:brightness Mon Feb 24 20:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740424832_2015922_1339366605_58844f5cb55bcfe54739c838f30e0264.jpg treat image : temp/1740424832_2015922_1339366602_58b97b4fcbd3bec8da4f5130570395b2.jpg treat image : temp/1740424832_2015922_1339366599_46a6b25c3288b38ca0be3b9dd18db864.jpg treat image : temp/1740424832_2015922_1339366596_a18053ec1dc435b97dc16176df57cad9.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.010713577270507812 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.01089167594909668 save missing photos in datou_result : time spend for datou_step_exec : 0.904090404510498 time spend to save output : 0.02592945098876953 total time spend for step 2 : 0.9300198554992676 step3:blur_detection Mon Feb 24 20:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740424832_2015922_1339366605_58844f5cb55bcfe54739c838f30e0264.jpg resize: (1080, 1920) 1339366605 -7.389050871646514 treat image : temp/1740424832_2015922_1339366602_58b97b4fcbd3bec8da4f5130570395b2.jpg resize: (1080, 1920) 1339366602 -7.38193246576138 treat image : temp/1740424832_2015922_1339366599_46a6b25c3288b38ca0be3b9dd18db864.jpg resize: (1080, 1920) 1339366599 -7.392946213499503 treat image : temp/1740424832_2015922_1339366596_a18053ec1dc435b97dc16176df57cad9.jpg resize: (1080, 1920) 1339366596 -7.373200792373475 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.010911226272583008 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.011868715286254883 save missing photos in datou_result : time spend for datou_step_exec : 3.1758766174316406 time spend to save output : 0.027386188507080078 total time spend for step 3 : 3.2032628059387207 step4:rle_unique_nms_with_priority Mon Feb 24 20:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 406 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 98 nb_hashtags : 6 time to prepare the origin masks : 1.0693459510803223 time for calcul the mask position with numpy : 0.04938030242919922 nb_pixel_total : 1794691 time to create 1 rle with new method : 0.09379792213439941 time for calcul the mask position with numpy : 0.008706808090209961 nb_pixel_total : 65456 time to create 1 rle with old method : 0.07363128662109375 time for calcul the mask position with numpy : 0.00845956802368164 nb_pixel_total : 67 time to create 1 rle with old method : 8.440017700195312e-05 time for calcul the mask position with numpy : 0.00831747055053711 nb_pixel_total : 34 time to create 1 rle with old method : 7.367134094238281e-05 time for calcul the mask position with numpy : 0.008333921432495117 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012302398681640625 time for calcul the mask position with numpy : 0.008224725723266602 nb_pixel_total : 956 time to create 1 rle with old method : 0.0010838508605957031 time for calcul the mask position with numpy : 0.008235454559326172 nb_pixel_total : 35 time to create 1 rle with old method : 4.9114227294921875e-05 time for calcul the mask position with numpy : 0.008228063583374023 nb_pixel_total : 105 time to create 1 rle with old method : 0.00011682510375976562 time for calcul the mask position with numpy : 0.00810384750366211 nb_pixel_total : 23 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.008123159408569336 nb_pixel_total : 261 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.008186101913452148 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004367828369140625 time for calcul the mask position with numpy : 0.008308649063110352 nb_pixel_total : 2443 time to create 1 rle with old method : 0.002766847610473633 time for calcul the mask position with numpy : 0.008427619934082031 nb_pixel_total : 517 time to create 1 rle with old method : 0.0005812644958496094 time for calcul the mask position with numpy : 0.00840306282043457 nb_pixel_total : 866 time to create 1 rle with old method : 0.0010132789611816406 time for calcul the mask position with numpy : 0.00844883918762207 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009000301361083984 time for calcul the mask position with numpy : 0.00841069221496582 nb_pixel_total : 2546 time to create 1 rle with old method : 0.003302335739135742 time for calcul the mask position with numpy : 0.008493661880493164 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002014636993408203 time for calcul the mask position with numpy : 0.008460044860839844 nb_pixel_total : 159 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.008603572845458984 nb_pixel_total : 2136 time to create 1 rle with old method : 0.002455472946166992 time for calcul the mask position with numpy : 0.008476734161376953 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007283687591552734 time for calcul the mask position with numpy : 0.008118152618408203 nb_pixel_total : 200 time to create 1 rle with old method : 0.00023818016052246094 time for calcul the mask position with numpy : 0.00796365737915039 nb_pixel_total : 1898 time to create 1 rle with old method : 0.0021796226501464844 time for calcul the mask position with numpy : 0.00808858871459961 nb_pixel_total : 49 time to create 1 rle with old method : 9.441375732421875e-05 time for calcul the mask position with numpy : 0.008046150207519531 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0014400482177734375 time for calcul the mask position with numpy : 0.008062601089477539 nb_pixel_total : 184 time to create 1 rle with old method : 0.00019502639770507812 time for calcul the mask position with numpy : 0.00823211669921875 nb_pixel_total : 16 time to create 1 rle with old method : 3.314018249511719e-05 time for calcul the mask position with numpy : 0.00814962387084961 nb_pixel_total : 887 time to create 1 rle with old method : 0.0009729862213134766 time for calcul the mask position with numpy : 0.008012771606445312 nb_pixel_total : 978 time to create 1 rle with old method : 0.0010955333709716797 time for calcul the mask position with numpy : 0.007999181747436523 nb_pixel_total : 736 time to create 1 rle with old method : 0.0008342266082763672 time for calcul the mask position with numpy : 0.007830142974853516 nb_pixel_total : 297 time to create 1 rle with old method : 0.00032329559326171875 time for calcul the mask position with numpy : 0.008049726486206055 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0012822151184082031 time for calcul the mask position with numpy : 0.007826089859008789 nb_pixel_total : 379 time to create 1 rle with old method : 0.000400543212890625 time for calcul the mask position with numpy : 0.007973194122314453 nb_pixel_total : 762 time to create 1 rle with old method : 0.0008959770202636719 time for calcul the mask position with numpy : 0.007902145385742188 nb_pixel_total : 2210 time to create 1 rle with old method : 0.002306699752807617 time for calcul the mask position with numpy : 0.008055686950683594 nb_pixel_total : 4220 time to create 1 rle with old method : 0.0043544769287109375 time for calcul the mask position with numpy : 0.00783681869506836 nb_pixel_total : 1307 time to create 1 rle with old method : 0.0014126300811767578 time for calcul the mask position with numpy : 0.008010387420654297 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005390644073486328 time for calcul the mask position with numpy : 0.00787043571472168 nb_pixel_total : 3475 time to create 1 rle with old method : 0.003907918930053711 time for calcul the mask position with numpy : 0.007964611053466797 nb_pixel_total : 437 time to create 1 rle with old method : 0.000484466552734375 time for calcul the mask position with numpy : 0.007940530776977539 nb_pixel_total : 254 time to create 1 rle with old method : 0.0002944469451904297 time for calcul the mask position with numpy : 0.00791025161743164 nb_pixel_total : 308 time to create 1 rle with old method : 0.000335693359375 time for calcul the mask position with numpy : 0.00812077522277832 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005080699920654297 time for calcul the mask position with numpy : 0.007898807525634766 nb_pixel_total : 785 time to create 1 rle with old method : 0.0008816719055175781 time for calcul the mask position with numpy : 0.007997274398803711 nb_pixel_total : 594 time to create 1 rle with old method : 0.0006160736083984375 time for calcul the mask position with numpy : 0.00815439224243164 nb_pixel_total : 74 time to create 1 rle with old method : 0.00010967254638671875 time for calcul the mask position with numpy : 0.007914066314697266 nb_pixel_total : 681 time to create 1 rle with old method : 0.0007395744323730469 time for calcul the mask position with numpy : 0.00785064697265625 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001380443572998047 time for calcul the mask position with numpy : 0.007826805114746094 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006127357482910156 time for calcul the mask position with numpy : 0.007843971252441406 nb_pixel_total : 2414 time to create 1 rle with old method : 0.002632617950439453 time for calcul the mask position with numpy : 0.007972240447998047 nb_pixel_total : 161 time to create 1 rle with old method : 0.00019598007202148438 time for calcul the mask position with numpy : 0.007940530776977539 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0012040138244628906 time for calcul the mask position with numpy : 0.007898092269897461 nb_pixel_total : 228 time to create 1 rle with old method : 0.00024366378784179688 time for calcul the mask position with numpy : 0.008033037185668945 nb_pixel_total : 1019 time to create 1 rle with old method : 0.0011088848114013672 time for calcul the mask position with numpy : 0.008118629455566406 nb_pixel_total : 125 time to create 1 rle with old method : 0.0001418590545654297 time for calcul the mask position with numpy : 0.00812840461730957 nb_pixel_total : 838 time to create 1 rle with old method : 0.0009541511535644531 time for calcul the mask position with numpy : 0.008093118667602539 nb_pixel_total : 8 time to create 1 rle with old method : 3.457069396972656e-05 time for calcul the mask position with numpy : 0.007839202880859375 nb_pixel_total : 416 time to create 1 rle with old method : 0.0004489421844482422 time for calcul the mask position with numpy : 0.008348226547241211 nb_pixel_total : 106672 time to create 1 rle with old method : 0.12379312515258789 time for calcul the mask position with numpy : 0.00961923599243164 nb_pixel_total : 67 time to create 1 rle with old method : 0.0001227855682373047 time for calcul the mask position with numpy : 0.009624004364013672 nb_pixel_total : 625 time to create 1 rle with old method : 0.0010221004486083984 time for calcul the mask position with numpy : 0.009628534317016602 nb_pixel_total : 50 time to create 1 rle with old method : 9.584426879882812e-05 time for calcul the mask position with numpy : 0.009636163711547852 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002834796905517578 time for calcul the mask position with numpy : 0.009592294692993164 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002810955047607422 time for calcul the mask position with numpy : 0.009719371795654297 nb_pixel_total : 46464 time to create 1 rle with old method : 0.05325007438659668 time for calcul the mask position with numpy : 0.007890939712524414 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0011832714080810547 time for calcul the mask position with numpy : 0.007992982864379883 nb_pixel_total : 243 time to create 1 rle with old method : 0.0002772808074951172 time for calcul the mask position with numpy : 0.008011341094970703 nb_pixel_total : 247 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.00809621810913086 nb_pixel_total : 84 time to create 1 rle with old method : 0.00010633468627929688 time for calcul the mask position with numpy : 0.008166074752807617 nb_pixel_total : 417 time to create 1 rle with old method : 0.0004858970642089844 time for calcul the mask position with numpy : 0.008040904998779297 nb_pixel_total : 824 time to create 1 rle with old method : 0.0008869171142578125 time for calcul the mask position with numpy : 0.008167505264282227 nb_pixel_total : 6 time to create 1 rle with old method : 2.6702880859375e-05 time for calcul the mask position with numpy : 0.008039474487304688 nb_pixel_total : 2310 time to create 1 rle with old method : 0.0024824142456054688 time for calcul the mask position with numpy : 0.008126020431518555 nb_pixel_total : 1186 time to create 1 rle with old method : 0.0013148784637451172 time for calcul the mask position with numpy : 0.008221149444580078 nb_pixel_total : 545 time to create 1 rle with old method : 0.0006034374237060547 time for calcul the mask position with numpy : 0.008198022842407227 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001308917999267578 time for calcul the mask position with numpy : 0.00781702995300293 nb_pixel_total : 618 time to create 1 rle with old method : 0.0006690025329589844 time for calcul the mask position with numpy : 0.007737874984741211 nb_pixel_total : 371 time to create 1 rle with old method : 0.0003960132598876953 time for calcul the mask position with numpy : 0.007846593856811523 nb_pixel_total : 259 time to create 1 rle with old method : 0.0002872943878173828 time for calcul the mask position with numpy : 0.008033514022827148 nb_pixel_total : 232 time to create 1 rle with old method : 0.0002658367156982422 time for calcul the mask position with numpy : 0.007993698120117188 nb_pixel_total : 1468 time to create 1 rle with old method : 0.0017118453979492188 time for calcul the mask position with numpy : 0.008126497268676758 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002570152282714844 time for calcul the mask position with numpy : 0.007973432540893555 nb_pixel_total : 269 time to create 1 rle with old method : 0.00029158592224121094 time for calcul the mask position with numpy : 0.008025884628295898 nb_pixel_total : 102 time to create 1 rle with old method : 0.00012159347534179688 time for calcul the mask position with numpy : 0.007979869842529297 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005619525909423828 time for calcul the mask position with numpy : 0.007985353469848633 nb_pixel_total : 261 time to create 1 rle with old method : 0.00029468536376953125 time for calcul the mask position with numpy : 0.008113622665405273 nb_pixel_total : 17 time to create 1 rle with old method : 2.47955322265625e-05 time for calcul the mask position with numpy : 0.008316993713378906 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002994537353515625 time for calcul the mask position with numpy : 0.008481740951538086 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003437995910644531 time for calcul the mask position with numpy : 0.00802922248840332 nb_pixel_total : 3 time to create 1 rle with old method : 1.3589859008789062e-05 time for calcul the mask position with numpy : 0.008910417556762695 nb_pixel_total : 151 time to create 1 rle with old method : 0.00017213821411132812 time for calcul the mask position with numpy : 0.008403778076171875 nb_pixel_total : 735 time to create 1 rle with old method : 0.0008416175842285156 time for calcul the mask position with numpy : 0.008101940155029297 nb_pixel_total : 875 time to create 1 rle with old method : 0.0009660720825195312 time for calcul the mask position with numpy : 0.00829172134399414 nb_pixel_total : 104 time to create 1 rle with old method : 0.00012493133544921875 time for calcul the mask position with numpy : 0.008164405822753906 nb_pixel_total : 528 time to create 1 rle with old method : 0.0005741119384765625 time for calcul the mask position with numpy : 0.008229970932006836 nb_pixel_total : 524 time to create 1 rle with old method : 0.0005600452423095703 time for calcul the mask position with numpy : 0.008246898651123047 nb_pixel_total : 273 time to create 1 rle with old method : 0.00031065940856933594 time for calcul the mask position with numpy : 0.008194923400878906 nb_pixel_total : 15 time to create 1 rle with old method : 2.4557113647460938e-05 time for calcul the mask position with numpy : 0.008278131484985352 nb_pixel_total : 730 time to create 1 rle with old method : 0.0008938312530517578 time for calcul the mask position with numpy : 0.0083160400390625 nb_pixel_total : 215 time to create 1 rle with old method : 0.0002434253692626953 create new chi : 1.2778983116149902 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006059169769287109 batch 1 Loaded 99 chid ids of type : 4230 Number RLEs to save : 9069 TO DO : save crop sub photo not yet done ! save time : 0.647313117980957 nb_obj : 110 nb_hashtags : 5 time to prepare the origin masks : 2.0437541007995605 time for calcul the mask position with numpy : 0.027019023895263672 nb_pixel_total : 1767402 time to create 1 rle with new method : 0.29881954193115234 time for calcul the mask position with numpy : 0.007959127426147461 nb_pixel_total : 10335 time to create 1 rle with old method : 0.013211965560913086 time for calcul the mask position with numpy : 0.00803685188293457 nb_pixel_total : 68866 time to create 1 rle with old method : 0.0860142707824707 time for calcul the mask position with numpy : 0.007951736450195312 nb_pixel_total : 23 time to create 1 rle with old method : 6.461143493652344e-05 time for calcul the mask position with numpy : 0.00790858268737793 nb_pixel_total : 18 time to create 1 rle with old method : 5.9604644775390625e-05 time for calcul the mask position with numpy : 0.008141756057739258 nb_pixel_total : 134 time to create 1 rle with old method : 0.00020599365234375 time for calcul the mask position with numpy : 0.009611368179321289 nb_pixel_total : 929 time to create 1 rle with old method : 0.0015597343444824219 time for calcul the mask position with numpy : 0.008228540420532227 nb_pixel_total : 121 time to create 1 rle with old method : 0.00020432472229003906 time for calcul the mask position with numpy : 0.007802248001098633 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001246929168701172 time for calcul the mask position with numpy : 0.008155107498168945 nb_pixel_total : 15 time to create 1 rle with old method : 6.532669067382812e-05 time for calcul the mask position with numpy : 0.008989334106445312 nb_pixel_total : 109 time to create 1 rle with old method : 0.0002346038818359375 time for calcul the mask position with numpy : 0.008428573608398438 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003185272216796875 time for calcul the mask position with numpy : 0.007769346237182617 nb_pixel_total : 14 time to create 1 rle with old method : 9.441375732421875e-05 time for calcul the mask position with numpy : 0.007843971252441406 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005228519439697266 time for calcul the mask position with numpy : 0.007480621337890625 nb_pixel_total : 2269 time to create 1 rle with old method : 0.0029544830322265625 time for calcul the mask position with numpy : 0.007578134536743164 nb_pixel_total : 1 time to create 1 rle with old method : 2.7179718017578125e-05 time for calcul the mask position with numpy : 0.008355140686035156 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002951622009277344 time for calcul the mask position with numpy : 0.00800013542175293 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005643367767333984 time for calcul the mask position with numpy : 0.009096145629882812 nb_pixel_total : 900 time to create 1 rle with old method : 0.0012218952178955078 time for calcul the mask position with numpy : 0.008790016174316406 nb_pixel_total : 4083 time to create 1 rle with old method : 0.0053403377532958984 time for calcul the mask position with numpy : 0.011304855346679688 nb_pixel_total : 682 time to create 1 rle with old method : 0.0014142990112304688 time for calcul the mask position with numpy : 0.011206388473510742 nb_pixel_total : 146 time to create 1 rle with old method : 0.00033164024353027344 time for calcul the mask position with numpy : 0.009269475936889648 nb_pixel_total : 1338 time to create 1 rle with old method : 0.0025985240936279297 time for calcul the mask position with numpy : 0.008690834045410156 nb_pixel_total : 555 time to create 1 rle with old method : 0.0010881423950195312 time for calcul the mask position with numpy : 0.008848905563354492 nb_pixel_total : 193 time to create 1 rle with old method : 0.0004448890686035156 time for calcul the mask position with numpy : 0.00874638557434082 nb_pixel_total : 1 time to create 1 rle with old method : 3.170967102050781e-05 time for calcul the mask position with numpy : 0.008790016174316406 nb_pixel_total : 73 time to create 1 rle with old method : 0.0003402233123779297 time for calcul the mask position with numpy : 0.008165359497070312 nb_pixel_total : 1825 time to create 1 rle with old method : 0.0034532546997070312 time for calcul the mask position with numpy : 0.008350372314453125 nb_pixel_total : 1556 time to create 1 rle with old method : 0.002008199691772461 time for calcul the mask position with numpy : 0.007916450500488281 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003113746643066406 time for calcul the mask position with numpy : 0.00816965103149414 nb_pixel_total : 651 time to create 1 rle with old method : 0.0008616447448730469 time for calcul the mask position with numpy : 0.008234977722167969 nb_pixel_total : 9122 time to create 1 rle with old method : 0.011624574661254883 time for calcul the mask position with numpy : 0.00799250602722168 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002906322479248047 time for calcul the mask position with numpy : 0.008410453796386719 nb_pixel_total : 1261 time to create 1 rle with old method : 0.0017313957214355469 time for calcul the mask position with numpy : 0.011525869369506836 nb_pixel_total : 698 time to create 1 rle with old method : 0.0009067058563232422 time for calcul the mask position with numpy : 0.012094497680664062 nb_pixel_total : 50 time to create 1 rle with old method : 0.00010919570922851562 time for calcul the mask position with numpy : 0.01110982894897461 nb_pixel_total : 140 time to create 1 rle with old method : 0.0002887248992919922 time for calcul the mask position with numpy : 0.011020660400390625 nb_pixel_total : 760 time to create 1 rle with old method : 0.001087188720703125 time for calcul the mask position with numpy : 0.0098419189453125 nb_pixel_total : 71 time to create 1 rle with old method : 0.00016450881958007812 time for calcul the mask position with numpy : 0.010893821716308594 nb_pixel_total : 138 time to create 1 rle with old method : 0.00021791458129882812 time for calcul the mask position with numpy : 0.012186765670776367 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0018868446350097656 time for calcul the mask position with numpy : 0.012233972549438477 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005824565887451172 time for calcul the mask position with numpy : 0.010694026947021484 nb_pixel_total : 85 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.011026144027709961 nb_pixel_total : 6619 time to create 1 rle with old method : 0.008965253829956055 time for calcul the mask position with numpy : 0.01024770736694336 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004220008850097656 time for calcul the mask position with numpy : 0.010061264038085938 nb_pixel_total : 716 time to create 1 rle with old method : 0.0009741783142089844 time for calcul the mask position with numpy : 0.010688543319702148 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0015685558319091797 time for calcul the mask position with numpy : 0.008754491806030273 nb_pixel_total : 696 time to create 1 rle with old method : 0.0011038780212402344 time for calcul the mask position with numpy : 0.0088043212890625 nb_pixel_total : 2352 time to create 1 rle with old method : 0.003101348876953125 time for calcul the mask position with numpy : 0.008626461029052734 nb_pixel_total : 67 time to create 1 rle with old method : 0.0002186298370361328 time for calcul the mask position with numpy : 0.008351564407348633 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002181529998779297 time for calcul the mask position with numpy : 0.00847005844116211 nb_pixel_total : 3158 time to create 1 rle with old method : 0.004436016082763672 time for calcul the mask position with numpy : 0.008598804473876953 nb_pixel_total : 452 time to create 1 rle with old method : 0.0006096363067626953 time for calcul the mask position with numpy : 0.008981704711914062 nb_pixel_total : 1850 time to create 1 rle with old method : 0.0025055408477783203 time for calcul the mask position with numpy : 0.007599830627441406 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003018379211425781 time for calcul the mask position with numpy : 0.006476640701293945 nb_pixel_total : 29 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.006401777267456055 nb_pixel_total : 769 time to create 1 rle with old method : 0.0008759498596191406 time for calcul the mask position with numpy : 0.006376028060913086 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005040168762207031 time for calcul the mask position with numpy : 0.006662130355834961 nb_pixel_total : 112 time to create 1 rle with old method : 0.00015616416931152344 time for calcul the mask position with numpy : 0.00640869140625 nb_pixel_total : 661 time to create 1 rle with old method : 0.0007526874542236328 time for calcul the mask position with numpy : 0.006531476974487305 nb_pixel_total : 2459 time to create 1 rle with old method : 0.004041910171508789 time for calcul the mask position with numpy : 0.0072841644287109375 nb_pixel_total : 1129 time to create 1 rle with old method : 0.0019528865814208984 time for calcul the mask position with numpy : 0.007249355316162109 nb_pixel_total : 185 time to create 1 rle with old method : 0.0003273487091064453 time for calcul the mask position with numpy : 0.007246732711791992 nb_pixel_total : 995 time to create 1 rle with old method : 0.001672506332397461 time for calcul the mask position with numpy : 0.007233619689941406 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.006991863250732422 nb_pixel_total : 411 time to create 1 rle with old method : 0.0006935596466064453 time for calcul the mask position with numpy : 0.0072174072265625 nb_pixel_total : 502 time to create 1 rle with old method : 0.0008871555328369141 time for calcul the mask position with numpy : 0.007310152053833008 nb_pixel_total : 33 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.007653951644897461 nb_pixel_total : 105793 time to create 1 rle with old method : 0.11222600936889648 time for calcul the mask position with numpy : 0.006472349166870117 nb_pixel_total : 16 time to create 1 rle with old method : 4.1484832763671875e-05 time for calcul the mask position with numpy : 0.0061872005462646484 nb_pixel_total : 52 time to create 1 rle with old method : 7.557868957519531e-05 time for calcul the mask position with numpy : 0.006056547164916992 nb_pixel_total : 141 time to create 1 rle with old method : 0.00018715858459472656 time for calcul the mask position with numpy : 0.006102085113525391 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006246566772460938 time for calcul the mask position with numpy : 0.006047964096069336 nb_pixel_total : 164 time to create 1 rle with old method : 0.00020956993103027344 time for calcul the mask position with numpy : 0.006116628646850586 nb_pixel_total : 44303 time to create 1 rle with old method : 0.04608416557312012 time for calcul the mask position with numpy : 0.006247043609619141 nb_pixel_total : 3299 time to create 1 rle with old method : 0.003541707992553711 time for calcul the mask position with numpy : 0.006180286407470703 nb_pixel_total : 77 time to create 1 rle with old method : 0.00015211105346679688 time for calcul the mask position with numpy : 0.006165981292724609 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002846717834472656 time for calcul the mask position with numpy : 0.0061032772064208984 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002460479736328125 time for calcul the mask position with numpy : 0.00621485710144043 nb_pixel_total : 37 time to create 1 rle with old method : 6.222724914550781e-05 time for calcul the mask position with numpy : 0.006103038787841797 nb_pixel_total : 118 time to create 1 rle with old method : 0.00014281272888183594 time for calcul the mask position with numpy : 0.009522676467895508 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005147457122802734 time for calcul the mask position with numpy : 0.006276369094848633 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002512931823730469 time for calcul the mask position with numpy : 0.006388664245605469 nb_pixel_total : 172 time to create 1 rle with old method : 0.00020194053649902344 time for calcul the mask position with numpy : 0.0061740875244140625 nb_pixel_total : 126 time to create 1 rle with old method : 0.00015234947204589844 time for calcul the mask position with numpy : 0.006057024002075195 nb_pixel_total : 7 time to create 1 rle with old method : 2.9325485229492188e-05 time for calcul the mask position with numpy : 0.006173849105834961 nb_pixel_total : 2729 time to create 1 rle with old method : 0.0028963088989257812 time for calcul the mask position with numpy : 0.005945682525634766 nb_pixel_total : 709 time to create 1 rle with old method : 0.0007462501525878906 time for calcul the mask position with numpy : 0.005850076675415039 nb_pixel_total : 591 time to create 1 rle with old method : 0.0006766319274902344 time for calcul the mask position with numpy : 0.006051301956176758 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005190372467041016 time for calcul the mask position with numpy : 0.006022214889526367 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002620220184326172 time for calcul the mask position with numpy : 0.006105661392211914 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004172325134277344 time for calcul the mask position with numpy : 0.005872249603271484 nb_pixel_total : 808 time to create 1 rle with old method : 0.0009200572967529297 time for calcul the mask position with numpy : 0.005821943283081055 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003020763397216797 time for calcul the mask position with numpy : 0.006142616271972656 nb_pixel_total : 1466 time to create 1 rle with old method : 0.0016655921936035156 time for calcul the mask position with numpy : 0.00588226318359375 nb_pixel_total : 309 time to create 1 rle with old method : 0.00036144256591796875 time for calcul the mask position with numpy : 0.005642414093017578 nb_pixel_total : 447 time to create 1 rle with old method : 0.0005533695220947266 time for calcul the mask position with numpy : 0.0057086944580078125 nb_pixel_total : 288 time to create 1 rle with old method : 0.000347137451171875 time for calcul the mask position with numpy : 0.005875349044799805 nb_pixel_total : 17 time to create 1 rle with old method : 3.647804260253906e-05 time for calcul the mask position with numpy : 0.005884647369384766 nb_pixel_total : 570 time to create 1 rle with old method : 0.000698089599609375 time for calcul the mask position with numpy : 0.008205413818359375 nb_pixel_total : 77 time to create 1 rle with old method : 0.00010395050048828125 time for calcul the mask position with numpy : 0.008100748062133789 nb_pixel_total : 685 time to create 1 rle with old method : 0.0007741451263427734 time for calcul the mask position with numpy : 0.007988214492797852 nb_pixel_total : 1094 time to create 1 rle with old method : 0.0011327266693115234 time for calcul the mask position with numpy : 0.008066654205322266 nb_pixel_total : 782 time to create 1 rle with old method : 0.0009558200836181641 time for calcul the mask position with numpy : 0.007894515991210938 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006184577941894531 time for calcul the mask position with numpy : 0.008065223693847656 nb_pixel_total : 260 time to create 1 rle with old method : 0.00031685829162597656 time for calcul the mask position with numpy : 0.00790858268737793 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.007987499237060547 nb_pixel_total : 711 time to create 1 rle with old method : 0.00072479248046875 time for calcul the mask position with numpy : 0.00795292854309082 nb_pixel_total : 124 time to create 1 rle with old method : 0.00014328956604003906 time for calcul the mask position with numpy : 0.0077974796295166016 nb_pixel_total : 223 time to create 1 rle with old method : 0.00026607513427734375 time for calcul the mask position with numpy : 0.007626056671142578 nb_pixel_total : 202 time to create 1 rle with old method : 0.00021219253540039062 create new chi : 1.5688955783843994 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0012481212615966797 batch 1 Loaded 111 chid ids of type : 4230 Number RLEs to save : 9886 TO DO : save crop sub photo not yet done ! save time : 0.7331106662750244 nb_obj : 100 nb_hashtags : 7 time to prepare the origin masks : 1.4856550693511963 time for calcul the mask position with numpy : 0.02178478240966797 nb_pixel_total : 1769710 time to create 1 rle with new method : 0.0343165397644043 time for calcul the mask position with numpy : 0.006258726119995117 nb_pixel_total : 14179 time to create 1 rle with old method : 0.015685081481933594 time for calcul the mask position with numpy : 0.006189823150634766 nb_pixel_total : 7142 time to create 1 rle with old method : 0.008149147033691406 time for calcul the mask position with numpy : 0.00644683837890625 nb_pixel_total : 68581 time to create 1 rle with old method : 0.07732486724853516 time for calcul the mask position with numpy : 0.005807638168334961 nb_pixel_total : 904 time to create 1 rle with old method : 0.0010268688201904297 time for calcul the mask position with numpy : 0.005696773529052734 nb_pixel_total : 165 time to create 1 rle with old method : 0.00021219253540039062 time for calcul the mask position with numpy : 0.005677700042724609 nb_pixel_total : 12 time to create 1 rle with old method : 3.743171691894531e-05 time for calcul the mask position with numpy : 0.005876064300537109 nb_pixel_total : 67 time to create 1 rle with old method : 0.00010204315185546875 time for calcul the mask position with numpy : 0.00585627555847168 nb_pixel_total : 20 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.0058667659759521484 nb_pixel_total : 67 time to create 1 rle with old method : 9.965896606445312e-05 time for calcul the mask position with numpy : 0.0056781768798828125 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005588531494140625 time for calcul the mask position with numpy : 0.005810260772705078 nb_pixel_total : 45 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.006054878234863281 nb_pixel_total : 148 time to create 1 rle with old method : 0.00020503997802734375 time for calcul the mask position with numpy : 0.006083011627197266 nb_pixel_total : 140 time to create 1 rle with old method : 0.0001842975616455078 time for calcul the mask position with numpy : 0.005920886993408203 nb_pixel_total : 16 time to create 1 rle with old method : 4.839897155761719e-05 time for calcul the mask position with numpy : 0.0056231021881103516 nb_pixel_total : 145 time to create 1 rle with old method : 0.00021600723266601562 time for calcul the mask position with numpy : 0.006047725677490234 nb_pixel_total : 2398 time to create 1 rle with old method : 0.0028150081634521484 time for calcul the mask position with numpy : 0.006159543991088867 nb_pixel_total : 143 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.006237506866455078 nb_pixel_total : 40 time to create 1 rle with old method : 6.413459777832031e-05 time for calcul the mask position with numpy : 0.006281375885009766 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002589225769042969 time for calcul the mask position with numpy : 0.005795955657958984 nb_pixel_total : 823 time to create 1 rle with old method : 0.0009233951568603516 time for calcul the mask position with numpy : 0.00580596923828125 nb_pixel_total : 224 time to create 1 rle with old method : 0.00030303001403808594 time for calcul the mask position with numpy : 0.005956172943115234 nb_pixel_total : 2058 time to create 1 rle with old method : 0.0026946067810058594 time for calcul the mask position with numpy : 0.005875587463378906 nb_pixel_total : 146 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.005974769592285156 nb_pixel_total : 1105 time to create 1 rle with old method : 0.0016584396362304688 time for calcul the mask position with numpy : 0.007417440414428711 nb_pixel_total : 588 time to create 1 rle with old method : 0.0008261203765869141 time for calcul the mask position with numpy : 0.006865262985229492 nb_pixel_total : 9 time to create 1 rle with old method : 4.315376281738281e-05 time for calcul the mask position with numpy : 0.007048606872558594 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002257823944091797 time for calcul the mask position with numpy : 0.006340503692626953 nb_pixel_total : 1734 time to create 1 rle with old method : 0.0019903182983398438 time for calcul the mask position with numpy : 0.005998373031616211 nb_pixel_total : 1376 time to create 1 rle with old method : 0.0016286373138427734 time for calcul the mask position with numpy : 0.005829572677612305 nb_pixel_total : 728 time to create 1 rle with old method : 0.0008966922760009766 time for calcul the mask position with numpy : 0.006119489669799805 nb_pixel_total : 112 time to create 1 rle with old method : 0.00019860267639160156 time for calcul the mask position with numpy : 0.006439685821533203 nb_pixel_total : 734 time to create 1 rle with old method : 0.0009102821350097656 time for calcul the mask position with numpy : 0.006704568862915039 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003070831298828125 time for calcul the mask position with numpy : 0.007153034210205078 nb_pixel_total : 194 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.006850481033325195 nb_pixel_total : 1183 time to create 1 rle with old method : 0.0014722347259521484 time for calcul the mask position with numpy : 0.006972074508666992 nb_pixel_total : 8179 time to create 1 rle with old method : 0.01105499267578125 time for calcul the mask position with numpy : 0.006869077682495117 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003440380096435547 time for calcul the mask position with numpy : 0.007176399230957031 nb_pixel_total : 780 time to create 1 rle with old method : 0.001010894775390625 time for calcul the mask position with numpy : 0.0068743228912353516 nb_pixel_total : 1564 time to create 1 rle with old method : 0.0023174285888671875 time for calcul the mask position with numpy : 0.007028818130493164 nb_pixel_total : 1640 time to create 1 rle with old method : 0.0023126602172851562 time for calcul the mask position with numpy : 0.007315635681152344 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002086162567138672 time for calcul the mask position with numpy : 0.00705265998840332 nb_pixel_total : 1422 time to create 1 rle with old method : 0.0020651817321777344 time for calcul the mask position with numpy : 0.006869792938232422 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005137920379638672 time for calcul the mask position with numpy : 0.007100582122802734 nb_pixel_total : 418 time to create 1 rle with old method : 0.0006737709045410156 time for calcul the mask position with numpy : 0.007241249084472656 nb_pixel_total : 3707 time to create 1 rle with old method : 0.0049440860748291016 time for calcul the mask position with numpy : 0.007095813751220703 nb_pixel_total : 245 time to create 1 rle with old method : 0.00031876564025878906 time for calcul the mask position with numpy : 0.00685429573059082 nb_pixel_total : 1947 time to create 1 rle with old method : 0.0025207996368408203 time for calcul the mask position with numpy : 0.007027864456176758 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003960132598876953 time for calcul the mask position with numpy : 0.006832122802734375 nb_pixel_total : 536 time to create 1 rle with old method : 0.0006995201110839844 time for calcul the mask position with numpy : 0.0069942474365234375 nb_pixel_total : 666 time to create 1 rle with old method : 0.0008463859558105469 time for calcul the mask position with numpy : 0.006705760955810547 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008826255798339844 time for calcul the mask position with numpy : 0.006601095199584961 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001399517059326172 time for calcul the mask position with numpy : 0.0067501068115234375 nb_pixel_total : 2433 time to create 1 rle with old method : 0.0030908584594726562 time for calcul the mask position with numpy : 0.0069468021392822266 nb_pixel_total : 1106 time to create 1 rle with old method : 0.001546621322631836 time for calcul the mask position with numpy : 0.007139682769775391 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003247261047363281 time for calcul the mask position with numpy : 0.006933450698852539 nb_pixel_total : 1517 time to create 1 rle with old method : 0.002166271209716797 time for calcul the mask position with numpy : 0.007086038589477539 nb_pixel_total : 995 time to create 1 rle with old method : 0.0013360977172851562 time for calcul the mask position with numpy : 0.006830692291259766 nb_pixel_total : 226 time to create 1 rle with old method : 0.00033402442932128906 time for calcul the mask position with numpy : 0.006667375564575195 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005490779876708984 time for calcul the mask position with numpy : 0.006607770919799805 nb_pixel_total : 573 time to create 1 rle with old method : 0.0008552074432373047 time for calcul the mask position with numpy : 0.007111787796020508 nb_pixel_total : 682 time to create 1 rle with old method : 0.0010302066802978516 time for calcul the mask position with numpy : 0.0069882869720458984 nb_pixel_total : 62 time to create 1 rle with old method : 0.00010395050048828125 time for calcul the mask position with numpy : 0.007277727127075195 nb_pixel_total : 106667 time to create 1 rle with old method : 0.13547301292419434 time for calcul the mask position with numpy : 0.0065267086029052734 nb_pixel_total : 16 time to create 1 rle with old method : 4.38690185546875e-05 time for calcul the mask position with numpy : 0.006390094757080078 nb_pixel_total : 126 time to create 1 rle with old method : 0.00016736984252929688 time for calcul the mask position with numpy : 0.006352901458740234 nb_pixel_total : 174 time to create 1 rle with old method : 0.00020813941955566406 time for calcul the mask position with numpy : 0.0065724849700927734 nb_pixel_total : 1195 time to create 1 rle with old method : 0.001468658447265625 time for calcul the mask position with numpy : 0.0066051483154296875 nb_pixel_total : 2686 time to create 1 rle with old method : 0.003300189971923828 time for calcul the mask position with numpy : 0.006468534469604492 nb_pixel_total : 101 time to create 1 rle with old method : 0.00016045570373535156 time for calcul the mask position with numpy : 0.006513357162475586 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003643035888671875 time for calcul the mask position with numpy : 0.006330966949462891 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006628036499023438 time for calcul the mask position with numpy : 0.00632023811340332 nb_pixel_total : 9 time to create 1 rle with old method : 4.172325134277344e-05 time for calcul the mask position with numpy : 0.0064737796783447266 nb_pixel_total : 39635 time to create 1 rle with old method : 0.047019004821777344 time for calcul the mask position with numpy : 0.00647735595703125 nb_pixel_total : 2513 time to create 1 rle with old method : 0.0032024383544921875 time for calcul the mask position with numpy : 0.006373167037963867 nb_pixel_total : 513 time to create 1 rle with old method : 0.0006692409515380859 time for calcul the mask position with numpy : 0.006171703338623047 nb_pixel_total : 642 time to create 1 rle with old method : 0.0007727146148681641 time for calcul the mask position with numpy : 0.006410121917724609 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007085800170898438 time for calcul the mask position with numpy : 0.006240129470825195 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004756450653076172 time for calcul the mask position with numpy : 0.006197929382324219 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003349781036376953 time for calcul the mask position with numpy : 0.0064318180084228516 nb_pixel_total : 250 time to create 1 rle with old method : 0.00034046173095703125 time for calcul the mask position with numpy : 0.006401538848876953 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004551410675048828 time for calcul the mask position with numpy : 0.006135463714599609 nb_pixel_total : 1500 time to create 1 rle with old method : 0.001789093017578125 time for calcul the mask position with numpy : 0.005903482437133789 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001201629638671875 time for calcul the mask position with numpy : 0.005975246429443359 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003883838653564453 time for calcul the mask position with numpy : 0.0059719085693359375 nb_pixel_total : 431 time to create 1 rle with old method : 0.0005288124084472656 time for calcul the mask position with numpy : 0.005820035934448242 nb_pixel_total : 231 time to create 1 rle with old method : 0.0002677440643310547 time for calcul the mask position with numpy : 0.0060274600982666016 nb_pixel_total : 16 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.005851030349731445 nb_pixel_total : 1308 time to create 1 rle with old method : 0.001546621322631836 time for calcul the mask position with numpy : 0.005808115005493164 nb_pixel_total : 576 time to create 1 rle with old method : 0.0006666183471679688 time for calcul the mask position with numpy : 0.008162975311279297 nb_pixel_total : 14 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.009649038314819336 nb_pixel_total : 768 time to create 1 rle with old method : 0.0008809566497802734 time for calcul the mask position with numpy : 0.009801626205444336 nb_pixel_total : 987 time to create 1 rle with old method : 0.0011012554168701172 time for calcul the mask position with numpy : 0.009724617004394531 nb_pixel_total : 696 time to create 1 rle with old method : 0.0008394718170166016 time for calcul the mask position with numpy : 0.009778261184692383 nb_pixel_total : 488 time to create 1 rle with old method : 0.000591278076171875 time for calcul the mask position with numpy : 0.009944438934326172 nb_pixel_total : 502 time to create 1 rle with old method : 0.0005555152893066406 time for calcul the mask position with numpy : 0.010381221771240234 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005280971527099609 time for calcul the mask position with numpy : 0.010556936264038086 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003161430358886719 time for calcul the mask position with numpy : 0.009856939315795898 nb_pixel_total : 760 time to create 1 rle with old method : 0.0009922981262207031 time for calcul the mask position with numpy : 0.010274171829223633 nb_pixel_total : 35 time to create 1 rle with old method : 7.82012939453125e-05 time for calcul the mask position with numpy : 0.010201215744018555 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002608299255371094 create new chi : 1.1132771968841553 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014700889587402344 batch 1 Loaded 101 chid ids of type : 4230 Number RLEs to save : 9986 TO DO : save crop sub photo not yet done ! save time : 2.346247911453247 nb_obj : 96 nb_hashtags : 8 time to prepare the origin masks : 1.2790911197662354 time for calcul the mask position with numpy : 0.028878450393676758 nb_pixel_total : 1798994 time to create 1 rle with new method : 0.2489771842956543 time for calcul the mask position with numpy : 0.0064697265625 nb_pixel_total : 59905 time to create 1 rle with old method : 0.06425619125366211 time for calcul the mask position with numpy : 0.005910158157348633 nb_pixel_total : 36 time to create 1 rle with old method : 6.580352783203125e-05 time for calcul the mask position with numpy : 0.007038593292236328 nb_pixel_total : 888 time to create 1 rle with old method : 0.0015857219696044922 time for calcul the mask position with numpy : 0.0057201385498046875 nb_pixel_total : 50 time to create 1 rle with old method : 7.581710815429688e-05 time for calcul the mask position with numpy : 0.006162881851196289 nb_pixel_total : 55 time to create 1 rle with old method : 0.00011157989501953125 time for calcul the mask position with numpy : 0.00728917121887207 nb_pixel_total : 29 time to create 1 rle with old method : 8.821487426757812e-05 time for calcul the mask position with numpy : 0.0071332454681396484 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0013196468353271484 time for calcul the mask position with numpy : 0.005731105804443359 nb_pixel_total : 105 time to create 1 rle with old method : 0.00014829635620117188 time for calcul the mask position with numpy : 0.006269216537475586 nb_pixel_total : 8457 time to create 1 rle with old method : 0.009452342987060547 time for calcul the mask position with numpy : 0.005887269973754883 nb_pixel_total : 66 time to create 1 rle with old method : 0.00012564659118652344 time for calcul the mask position with numpy : 0.005900144577026367 nb_pixel_total : 2428 time to create 1 rle with old method : 0.0026078224182128906 time for calcul the mask position with numpy : 0.006612300872802734 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003261566162109375 time for calcul the mask position with numpy : 0.005750179290771484 nb_pixel_total : 21 time to create 1 rle with old method : 6.508827209472656e-05 time for calcul the mask position with numpy : 0.005826473236083984 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003981590270996094 time for calcul the mask position with numpy : 0.0058481693267822266 nb_pixel_total : 33 time to create 1 rle with old method : 5.888938903808594e-05 time for calcul the mask position with numpy : 0.005826234817504883 nb_pixel_total : 13 time to create 1 rle with old method : 5.1021575927734375e-05 time for calcul the mask position with numpy : 0.005543708801269531 nb_pixel_total : 152 time to create 1 rle with old method : 0.0001964569091796875 time for calcul the mask position with numpy : 0.0057392120361328125 nb_pixel_total : 234 time to create 1 rle with old method : 0.00027823448181152344 time for calcul the mask position with numpy : 0.00563359260559082 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004291534423828125 time for calcul the mask position with numpy : 0.00575709342956543 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011968612670898438 time for calcul the mask position with numpy : 0.0056073665618896484 nb_pixel_total : 793 time to create 1 rle with old method : 0.0008685588836669922 time for calcul the mask position with numpy : 0.0059757232666015625 nb_pixel_total : 11 time to create 1 rle with old method : 5.793571472167969e-05 time for calcul the mask position with numpy : 0.006009817123413086 nb_pixel_total : 3704 time to create 1 rle with old method : 0.004098176956176758 time for calcul the mask position with numpy : 0.005784034729003906 nb_pixel_total : 2257 time to create 1 rle with old method : 0.0026357173919677734 time for calcul the mask position with numpy : 0.0056722164154052734 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006060600280761719 time for calcul the mask position with numpy : 0.005678892135620117 nb_pixel_total : 136 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.005606651306152344 nb_pixel_total : 47 time to create 1 rle with old method : 9.775161743164062e-05 time for calcul the mask position with numpy : 0.005683183670043945 nb_pixel_total : 113 time to create 1 rle with old method : 0.00018286705017089844 time for calcul the mask position with numpy : 0.005917787551879883 nb_pixel_total : 1787 time to create 1 rle with old method : 0.002034425735473633 time for calcul the mask position with numpy : 0.0058956146240234375 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0013098716735839844 time for calcul the mask position with numpy : 0.005624294281005859 nb_pixel_total : 694 time to create 1 rle with old method : 0.0008044242858886719 time for calcul the mask position with numpy : 0.005506753921508789 nb_pixel_total : 309 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.0056285858154296875 nb_pixel_total : 819 time to create 1 rle with old method : 0.0009706020355224609 time for calcul the mask position with numpy : 0.005570650100708008 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0014197826385498047 time for calcul the mask position with numpy : 0.005879640579223633 nb_pixel_total : 8324 time to create 1 rle with old method : 0.009101152420043945 time for calcul the mask position with numpy : 0.0056798458099365234 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001914501190185547 time for calcul the mask position with numpy : 0.005926847457885742 nb_pixel_total : 804 time to create 1 rle with old method : 0.0009181499481201172 time for calcul the mask position with numpy : 0.006031513214111328 nb_pixel_total : 4395 time to create 1 rle with old method : 0.00508427619934082 time for calcul the mask position with numpy : 0.00566411018371582 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0014109611511230469 time for calcul the mask position with numpy : 0.0056955814361572266 nb_pixel_total : 655 time to create 1 rle with old method : 0.0007715225219726562 time for calcul the mask position with numpy : 0.0056476593017578125 nb_pixel_total : 1798 time to create 1 rle with old method : 0.002138376235961914 time for calcul the mask position with numpy : 0.0057337284088134766 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003418922424316406 time for calcul the mask position with numpy : 0.0060999393463134766 nb_pixel_total : 1399 time to create 1 rle with old method : 0.001737356185913086 time for calcul the mask position with numpy : 0.006288290023803711 nb_pixel_total : 306 time to create 1 rle with old method : 0.00038743019104003906 time for calcul the mask position with numpy : 0.00606536865234375 nb_pixel_total : 998 time to create 1 rle with old method : 0.0012030601501464844 time for calcul the mask position with numpy : 0.00590062141418457 nb_pixel_total : 752 time to create 1 rle with old method : 0.0007989406585693359 time for calcul the mask position with numpy : 0.006239891052246094 nb_pixel_total : 724 time to create 1 rle with old method : 0.0008409023284912109 time for calcul the mask position with numpy : 0.0062448978424072266 nb_pixel_total : 687 time to create 1 rle with old method : 0.0008664131164550781 time for calcul the mask position with numpy : 0.005868434906005859 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007042884826660156 time for calcul the mask position with numpy : 0.00592494010925293 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.006079196929931641 nb_pixel_total : 2545 time to create 1 rle with old method : 0.0027437210083007812 time for calcul the mask position with numpy : 0.005944252014160156 nb_pixel_total : 1091 time to create 1 rle with old method : 0.0012218952178955078 time for calcul the mask position with numpy : 0.006400346755981445 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002810955047607422 time for calcul the mask position with numpy : 0.005712985992431641 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002319812774658203 time for calcul the mask position with numpy : 0.005739688873291016 nb_pixel_total : 970 time to create 1 rle with old method : 0.0011420249938964844 time for calcul the mask position with numpy : 0.005867719650268555 nb_pixel_total : 126 time to create 1 rle with old method : 0.00022101402282714844 time for calcul the mask position with numpy : 0.005830526351928711 nb_pixel_total : 766 time to create 1 rle with old method : 0.0008151531219482422 time for calcul the mask position with numpy : 0.0059244632720947266 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005354881286621094 time for calcul the mask position with numpy : 0.005860805511474609 nb_pixel_total : 22 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.006490945816040039 nb_pixel_total : 106593 time to create 1 rle with old method : 0.11990237236022949 time for calcul the mask position with numpy : 0.007174968719482422 nb_pixel_total : 52 time to create 1 rle with old method : 0.00010943412780761719 time for calcul the mask position with numpy : 0.006451845169067383 nb_pixel_total : 66 time to create 1 rle with old method : 0.00011324882507324219 time for calcul the mask position with numpy : 0.007032632827758789 nb_pixel_total : 614 time to create 1 rle with old method : 0.0008165836334228516 time for calcul the mask position with numpy : 0.006291866302490234 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002803802490234375 time for calcul the mask position with numpy : 0.007027387619018555 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002415180206298828 time for calcul the mask position with numpy : 0.006234884262084961 nb_pixel_total : 172 time to create 1 rle with old method : 0.00034165382385253906 time for calcul the mask position with numpy : 0.0067484378814697266 nb_pixel_total : 3003 time to create 1 rle with old method : 0.0035462379455566406 time for calcul the mask position with numpy : 0.006916522979736328 nb_pixel_total : 257 time to create 1 rle with old method : 0.000362396240234375 time for calcul the mask position with numpy : 0.0065364837646484375 nb_pixel_total : 223 time to create 1 rle with old method : 0.00029921531677246094 time for calcul the mask position with numpy : 0.0067386627197265625 nb_pixel_total : 150 time to create 1 rle with old method : 0.0001914501190185547 time for calcul the mask position with numpy : 0.006253242492675781 nb_pixel_total : 511 time to create 1 rle with old method : 0.0007543563842773438 time for calcul the mask position with numpy : 0.007222175598144531 nb_pixel_total : 9 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.007002115249633789 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004611015319824219 time for calcul the mask position with numpy : 0.0068511962890625 nb_pixel_total : 34798 time to create 1 rle with old method : 0.03989291191101074 time for calcul the mask position with numpy : 0.006871461868286133 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002734661102294922 time for calcul the mask position with numpy : 0.006418943405151367 nb_pixel_total : 132 time to create 1 rle with old method : 0.00018739700317382812 time for calcul the mask position with numpy : 0.007059812545776367 nb_pixel_total : 654 time to create 1 rle with old method : 0.0009069442749023438 time for calcul the mask position with numpy : 0.006407976150512695 nb_pixel_total : 813 time to create 1 rle with old method : 0.0009732246398925781 time for calcul the mask position with numpy : 0.0059316158294677734 nb_pixel_total : 602 time to create 1 rle with old method : 0.0006701946258544922 time for calcul the mask position with numpy : 0.006135463714599609 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004239082336425781 time for calcul the mask position with numpy : 0.006006717681884766 nb_pixel_total : 236 time to create 1 rle with old method : 0.0002841949462890625 time for calcul the mask position with numpy : 0.006089210510253906 nb_pixel_total : 97 time to create 1 rle with old method : 0.00013637542724609375 time for calcul the mask position with numpy : 0.006059169769287109 nb_pixel_total : 1467 time to create 1 rle with old method : 0.0016484260559082031 time for calcul the mask position with numpy : 0.006227254867553711 nb_pixel_total : 288 time to create 1 rle with old method : 0.00034117698669433594 time for calcul the mask position with numpy : 0.00603032112121582 nb_pixel_total : 82 time to create 1 rle with old method : 0.00011229515075683594 time for calcul the mask position with numpy : 0.006007194519042969 nb_pixel_total : 258 time to create 1 rle with old method : 0.00029540061950683594 time for calcul the mask position with numpy : 0.006055355072021484 nb_pixel_total : 19 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.008253097534179688 nb_pixel_total : 230 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.007990837097167969 nb_pixel_total : 582 time to create 1 rle with old method : 0.0006849765777587891 time for calcul the mask position with numpy : 0.008034944534301758 nb_pixel_total : 759 time to create 1 rle with old method : 0.0008237361907958984 time for calcul the mask position with numpy : 0.008301019668579102 nb_pixel_total : 987 time to create 1 rle with old method : 0.0011014938354492188 time for calcul the mask position with numpy : 0.008419036865234375 nb_pixel_total : 1019 time to create 1 rle with old method : 0.001138448715209961 time for calcul the mask position with numpy : 0.008897542953491211 nb_pixel_total : 377 time to create 1 rle with old method : 0.0007157325744628906 time for calcul the mask position with numpy : 0.009189367294311523 nb_pixel_total : 260 time to create 1 rle with old method : 0.0002949237823486328 time for calcul the mask position with numpy : 0.008388042449951172 nb_pixel_total : 203 time to create 1 rle with old method : 0.00022840499877929688 time for calcul the mask position with numpy : 0.008382558822631836 nb_pixel_total : 200 time to create 1 rle with old method : 0.00022339820861816406 create new chi : 1.2077951431274414 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013370513916015625 batch 1 Loaded 97 chid ids of type : 4230 Number RLEs to save : 8768 TO DO : save crop sub photo not yet done ! save time : 1.4104149341583252 map_output_result : {1339366605: (0.0, 'Should be the crop_list due to order', 0.0), 1339366602: (0.0, 'Should be the crop_list due to order', 0.0), 1339366599: (0.0, 'Should be the crop_list due to order', 0.0), 1339366596: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1339366605, 1339366602, 1339366599, 1339366596] Looping around the photos to save general results len do output : 4 /1339366605.Didn't retrieve data . /1339366602.Didn't retrieve data . /1339366599.Didn't retrieve data . /1339366596.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366605', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366602', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366599', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366596', None, None, None, None, None, '2610482') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012233495712280273 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.736419439315796 time spend to save output : 0.012645959854125977 total time spend for step 4 : 16.749065399169922 step5:crop_condition Mon Feb 24 20:21:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 408 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 134 About to insert : list_path_to_insert length 134 new photo from crops ! About to upload 134 photos upload in portfolio : 4869462 init cache_photo without model_param we have 134 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740424887_2015922 we have uploaded 134 photos in the portfolio 4869462 time of upload the photos Elapsed time : 35.26644825935364 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 66 About to insert : list_path_to_insert length 66 new photo from crops ! About to upload 66 photos upload in portfolio : 4869462 init cache_photo without model_param we have 66 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740424923_2015922 we have uploaded 66 photos in the portfolio 4869462 time of upload the photos Elapsed time : 18.817898750305176 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740424942_2015922 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.759887218475342 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 61 About to insert : list_path_to_insert length 61 new photo from crops ! About to upload 61 photos upload in portfolio : 4869462 init cache_photo without model_param we have 61 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740424945_2015922 we have uploaded 61 photos in the portfolio 4869462 time of upload the photos Elapsed time : 15.897237777709961 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1339366605, 1339366602, 1339366599, 1339366596] Looping around the photos to save general results len do output : 270 /1339395775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339395999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339396437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366605', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366602', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366599', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366596', None, None, None, None, None, '2610482') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 814 time used for this insertion : 0.04409170150756836 save_final save missing photos in datou_result : time spend for datou_step_exec : 77.2283935546875 time spend to save output : 0.0524444580078125 total time spend for step 5 : 77.28083801269531 step6:thcl Mon Feb 24 20:22:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01905679702758789 time to convert the images to numpy array : 0.07933330535888672 time to import caffe and check if the image exist : 0.01810288429260254 time to convert the images to numpy array : 0.08686208724975586 time to import caffe and check if the image exist : 0.016333580017089844 time to convert the images to numpy array : 0.08881044387817383 time to import caffe and check if the image exist : 0.01828765869140625 time to convert the images to numpy array : 0.08790135383605957 time to import caffe and check if the image exist : 0.01635432243347168 time to convert the images to numpy array : 0.0901181697845459 time to import caffe and check if the image exist : 0.02187323570251465 time to convert the images to numpy array : 0.08887815475463867 time to import caffe and check if the image exist : 0.014616727828979492 time to convert the images to numpy array : 0.09875631332397461 time to import caffe and check if the image exist : 0.01858830451965332 time to convert the images to numpy array : 0.09479928016662598 time to import caffe and check if the image exist : 0.016820192337036133 time to convert the images to numpy array : 0.09667038917541504 time to import caffe and check if the image exist : 0.017054319381713867 time to convert the images to numpy array : 0.09682059288024902 total time to convert the images to numpy array : 0.32648205757141113 list photo_ids error: [] list photo_ids correct : [1339395775, 1339395777, 1339395779, 1339395781, 1339395783, 1339395785, 1339395787, 1339395790, 1339395792, 1339395794, 1339395796, 1339395799, 1339395800, 1339395802, 1339395804, 1339395806, 1339395808, 1339395810, 1339395813, 1339395815, 1339395817, 1339395819, 1339395821, 1339395823, 1339395825, 1339395827, 1339395829, 1339395831, 1339395833, 1339395835, 1339395837, 1339395839, 1339395841, 1339395843, 1339395845, 1339395847, 1339395849, 1339395851, 1339395853, 1339395855, 1339395857, 1339395859, 1339395861, 1339395863, 1339395865, 1339395867, 1339395869, 1339395871, 1339395873, 1339395875, 1339395877, 1339395879, 1339395881, 1339395883, 1339396145, 1339396146, 1339396147, 1339396148, 1339396149, 1339396150, 1339396151, 1339396152, 1339396153, 1339396154, 1339396155, 1339396193, 1339396196, 1339396201, 1339396206, 1339396211, 1339396216, 1339396221, 1339396226, 1339396231, 1339396348, 1339396349, 1339396350, 1339396351, 1339396352, 1339396353, 1339396354, 1339396040, 1339396041, 1339396042, 1339396043, 1339396044, 1339396046, 1339396049, 1339396051, 1339396053, 1339396055, 1339396057, 1339396059, 1339396061, 1339396063, 1339396065, 1339396067, 1339396069, 1339396071, 1339396073, 1339396075, 1339396077, 1339396079, 1339396082, 1339396084, 1339396086, 1339396088, 1339396090, 1339396355, 1339396356, 1339396357, 1339396358, 1339396359, 1339396360, 1339396361, 1339396362, 1339396363, 1339396364, 1339396365, 1339396366, 1339396367, 1339396368, 1339396369, 1339396370, 1339396371, 1339396372, 1339396373, 1339396374, 1339396375, 1339396376, 1339396377, 1339396378, 1339396379, 1339396380, 1339396381, 1339396092, 1339396094, 1339396096, 1339396098, 1339396100, 1339396102, 1339396104, 1339396106, 1339396108, 1339396110, 1339396112, 1339396114, 1339396116, 1339396118, 1339396120, 1339396122, 1339396124, 1339396126, 1339396128, 1339396130, 1339396132, 1339396134, 1339396136, 1339396138, 1339396140, 1339396142, 1339396144, 1339395995, 1339395997, 1339395999, 1339396001, 1339396003, 1339396004, 1339396005, 1339396006, 1339396007, 1339396008, 1339396009, 1339396010, 1339396011, 1339396012, 1339396013, 1339396014, 1339396015, 1339396016, 1339396017, 1339396018, 1339396019, 1339396020, 1339396021, 1339396022, 1339396023, 1339396024, 1339396039, 1339395885, 1339395887, 1339395889, 1339395891, 1339395893, 1339395895, 1339395897, 1339395899, 1339395901, 1339395903, 1339395905, 1339395907, 1339395909, 1339395911, 1339395913, 1339395915, 1339395917, 1339395919, 1339395921, 1339395923, 1339395925, 1339395927, 1339395929, 1339395931, 1339395933, 1339395935, 1339395937, 1339395939, 1339395941, 1339395943, 1339395945, 1339395947, 1339395949, 1339395951, 1339395953, 1339395955, 1339395957, 1339395959, 1339395961, 1339395963, 1339395965, 1339395967, 1339395969, 1339395971, 1339395973, 1339395975, 1339395977, 1339395979, 1339395981, 1339395983, 1339395985, 1339395988, 1339395990, 1339395992, 1339396382, 1339396383, 1339396384, 1339396385, 1339396386, 1339396387, 1339396388, 1339396389, 1339396390, 1339396391, 1339396392, 1339396393, 1339396394, 1339396395, 1339396396, 1339396397, 1339396398, 1339396401, 1339396405, 1339396409, 1339396413, 1339396417, 1339396421, 1339396425, 1339396429, 1339396433, 1339396437] number of photos to traite : 270 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9664 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5085 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.2357077598571777 time used to do the prediction : 0.9141013622283936 save descriptor for thcl : 3237 time to traite the descriptors : 1.455742597579956 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1339395775 To insert : 1339395777 To insert : 1339395779 To insert : 1339395781 To insert : 1339395783 To insert : 1339395785 To insert : 1339395787 To insert : 1339395790 To insert : 1339395792 To insert : 1339395794 To insert : 1339395796 To insert : 1339395799 To insert : 1339395800 To insert : 1339395802 To insert : 1339395804 To insert : 1339395806 To insert : 1339395808 To insert : 1339395810 To insert : 1339395813 To insert : 1339395815 To insert : 1339395817 To insert : 1339395819 To insert : 1339395821 To insert : 1339395823 To insert : 1339395825 To insert : 1339395827 To insert : 1339395829 To insert : 1339395831 To insert : 1339395833 To insert : 1339395835 To insert : 1339395837 To insert : 1339395839 To insert : 1339395841 To insert : 1339395843 To insert : 1339395845 To insert : 1339395847 To insert : 1339395849 To insert : 1339395851 To insert : 1339395853 To insert : 1339395855 To insert : 1339395857 To insert : 1339395859 To insert : 1339395861 To insert : 1339395863 To insert : 1339395865 To insert : 1339395867 To insert : 1339395869 To insert : 1339395871 To insert : 1339395873 To insert : 1339395875 To insert : 1339395877 To insert : 1339395879 To insert : 1339395881 To insert : 1339395883 To insert : 1339396145 To insert : 1339396146 To insert : 1339396147 To insert : 1339396148 To insert : 1339396149 To insert : 1339396150 To insert : 1339396151 To insert : 1339396152 To insert : 1339396153 To insert : 1339396154 To insert : 1339396155 To insert : 1339396193 To insert : 1339396196 To insert : 1339396201 To insert : 1339396206 To insert : 1339396211 To insert : 1339396216 To insert : 1339396221 To insert : 1339396226 To insert : 1339396231 To insert : 1339396348 To insert : 1339396349 To insert : 1339396350 To insert : 1339396351 To insert : 1339396352 To insert : 1339396353 To insert : 1339396354 To insert : 1339396040 To insert : 1339396041 To insert : 1339396042 To insert : 1339396043 To insert : 1339396044 To insert : 1339396046 To insert : 1339396049 To insert : 1339396051 To insert : 1339396053 To insert : 1339396055 To insert : 1339396057 To insert : 1339396059 To insert : 1339396061 To insert : 1339396063 To insert : 1339396065 To insert : 1339396067 To insert : 1339396069 To insert : 1339396071 To insert : 1339396073 To insert : 1339396075 To insert : 1339396077 To insert : 1339396079 To insert : 1339396082 To insert : 1339396084 To insert : 1339396086 To insert : 1339396088 To insert : 1339396090 To insert : 1339396355 To insert : 1339396356 To insert : 1339396357 To insert : 1339396358 To insert : 1339396359 To insert : 1339396360 To insert : 1339396361 To insert : 1339396362 To insert : 1339396363 To insert : 1339396364 To insert : 1339396365 To insert : 1339396366 To insert : 1339396367 To insert : 1339396368 To insert : 1339396369 To insert : 1339396370 To insert : 1339396371 To insert : 1339396372 To insert : 1339396373 To insert : 1339396374 To insert : 1339396375 To insert : 1339396376 To insert : 1339396377 To insert : 1339396378 To insert : 1339396379 To insert : 1339396380 To insert : 1339396381 To insert : 1339396092 To insert : 1339396094 To insert : 1339396096 To insert : 1339396098 To insert : 1339396100 To insert : 1339396102 To insert : 1339396104 To insert : 1339396106 To insert : 1339396108 To insert : 1339396110 To insert : 1339396112 To insert : 1339396114 To insert : 1339396116 To insert : 1339396118 To insert : 1339396120 To insert : 1339396122 To insert : 1339396124 To insert : 1339396126 To insert : 1339396128 To insert : 1339396130 To insert : 1339396132 To insert : 1339396134 To insert : 1339396136 To insert : 1339396138 To insert : 1339396140 To insert : 1339396142 To insert : 1339396144 To insert : 1339395995 To insert : 1339395997 To insert : 1339395999 To insert : 1339396001 To insert : 1339396003 To insert : 1339396004 To insert : 1339396005 To insert : 1339396006 To insert : 1339396007 To insert : 1339396008 To insert : 1339396009 To insert : 1339396010 To insert : 1339396011 To insert : 1339396012 To insert : 1339396013 To insert : 1339396014 To insert : 1339396015 To insert : 1339396016 To insert : 1339396017 To insert : 1339396018 To insert : 1339396019 To insert : 1339396020 To insert : 1339396021 To insert : 1339396022 To insert : 1339396023 To insert : 1339396024 To insert : 1339396039 To insert : 1339395885 To insert : 1339395887 To insert : 1339395889 To insert : 1339395891 To insert : 1339395893 To insert : 1339395895 To insert : 1339395897 To insert : 1339395899 To insert : 1339395901 To insert : 1339395903 To insert : 1339395905 To insert : 1339395907 To insert : 1339395909 To insert : 1339395911 To insert : 1339395913 To insert : 1339395915 To insert : 1339395917 To insert : 1339395919 To insert : 1339395921 To insert : 1339395923 To insert : 1339395925 To insert : 1339395927 To insert : 1339395929 To insert : 1339395931 To insert : 1339395933 To insert : 1339395935 To insert : 1339395937 To insert : 1339395939 To insert : 1339395941 To insert : 1339395943 To insert : 1339395945 To insert : 1339395947 To insert : 1339395949 To insert : 1339395951 To insert : 1339395953 To insert : 1339395955 To insert : 1339395957 To insert : 1339395959 To insert : 1339395961 To insert : 1339395963 To insert : 1339395965 To insert : 1339395967 To insert : 1339395969 To insert : 1339395971 To insert : 1339395973 To insert : 1339395975 To insert : 1339395977 To insert : 1339395979 To insert : 1339395981 To insert : 1339395983 To insert : 1339395985 To insert : 1339395988 To insert : 1339395990 To insert : 1339395992 To insert : 1339396382 To insert : 1339396383 To insert : 1339396384 To insert : 1339396385 To insert : 1339396386 To insert : 1339396387 To insert : 1339396388 To insert : 1339396389 To insert : 1339396390 To insert : 1339396391 To insert : 1339396392 To insert : 1339396393 To insert : 1339396394 To insert : 1339396395 To insert : 1339396396 To insert : 1339396397 To insert : 1339396398 To insert : 1339396401 To insert : 1339396405 To insert : 1339396409 To insert : 1339396413 To insert : 1339396417 To insert : 1339396421 To insert : 1339396425 To insert : 1339396429 To insert : 1339396433 To insert : 1339396437 time to insert the descriptors : 61.850050926208496 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 421 time used for this insertion : 0.029436111450195312 save missing photos in datou_result : time spend for datou_step_exec : 69.68590712547302 time spend to save output : 0.08045029640197754 total time spend for step 6 : 69.766357421875 step7:ventilate_hashtags_in_portfolio Mon Feb 24 20:23:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20779166 get user id for portfolio 20779166 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779166 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','Papier','papier','pet_clair','PEHD','environnement','pehd','refus','Carton','Film_plastique','Tetrapak','metal','PET_fonce','autre','mal_croppe','PET_clair','flou','pet_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779166 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','Papier','papier','pet_clair','PEHD','environnement','pehd','refus','Carton','Film_plastique','Tetrapak','metal','PET_fonce','autre','mal_croppe','PET_clair','flou','pet_fonce')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779166 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','Papier','papier','pet_clair','PEHD','environnement','pehd','refus','Carton','Film_plastique','Tetrapak','metal','PET_fonce','autre','mal_croppe','PET_clair','flou','pet_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779166 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','Papier','papier','pet_clair','PEHD','environnement','pehd','refus','Carton','Film_plastique','Tetrapak','metal','PET_fonce','autre','mal_croppe','PET_clair','flou','pet_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20781332,20781326,20781339,20781330,20781329,20781331,20781333,20781334,20781335,20781341,20781337,20781338,20781340?tags=carton,papier,pet_clair,pehd,environnement,refus,film_plastique,tetrapak,metal,pet_fonce,autre,mal_croppe,flou&datou_id_consolidate=4235&port_consolidate=20779166 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1339366605, 1339366602, 1339366599, 1339366596] Looping around the photos to save general results len do output : 1 /20779166. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366605', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366602', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366599', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366596', None, None, None, None, None, '2610482') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.15812420845031738 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.673588275909424 time spend to save output : 0.1584329605102539 total time spend for step 7 : 8.832021236419678 step8:final Mon Feb 24 20:24:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1339366605: ('0.2344766697681388',), 1339366602: ('0.2344766697681388',), 1339366599: ('0.2344766697681388',), 1339366596: ('0.2344766697681388',)} new output for save of step final : {1339366605: ('0.2344766697681388',), 1339366602: ('0.2344766697681388',), 1339366599: ('0.2344766697681388',), 1339366596: ('0.2344766697681388',)} [1339366605, 1339366602, 1339366599, 1339366596] Looping around the photos to save general results len do output : 4 /1339366605.Didn't retrieve data . /1339366602.Didn't retrieve data . /1339366599.Didn't retrieve data . /1339366596.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366605', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366602', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366599', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366596', None, None, None, None, None, '2610482') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014874696731567383 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11974000930786133 time spend to save output : 0.015180110931396484 total time spend for step 8 : 0.1349201202392578 step9:velours_tree Mon Feb 24 20:24:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20781332,20781326,20781339,20781330,20781329,20781331,20781333,20781334,20781335,20781341,20781337,20781338,20781340 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781332 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781326 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781339 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781330 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781329 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781331 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781333 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781334 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781335 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781341 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781337 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781338 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20781340 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 270 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 5 1 4 1 4 0 4 4 4 4 4 4 1 0 0 0 4 4 0 4 1 0 4 4 4 0 1 4 1 1 1 3 0 4 5 4 1 4 4 4 4 4 4 1 2 1 4 4 5 5 4 1 1 0 1 1 4 1 4 4 0 4 1 4 1 1 1 3 0 5 3 1 4 0 1 2 0 4 4 4 4 0 1 0 0 1 1 4 1 4 4 0 0 4 4 1 1 1 3 0 2 5 3 0 1 4 4 4 4 4 4 4 1 0 0 4 1 5 1 4 1 4 4 0 1 4 1 1 4 1 3 0 2 2 0 0 5 1 3 4 1 4 4 5 0 4 0 4 5 2 2 0 0 0 0 5 3 4 5 1 0 4 0 0 0 4 4 4 0 4 5 2 0 0 5 3 4 1 1 4 0 4 4 4 5 2 2 0 0 0 3 4 4 0 4 0 4 4 0 0 0 0 0 0 0 0 0 0 5 4 2 4 1 1 1 4 5 1 1 1 5 2 1 1 2 2 2 1 4 4 1 1 1 2 2 5 1 2 2 2 1 4 1 1 0 1 1 5 1 2 2 1 1 1 5 4 4 2 4 1 1 0 1 1 1 2 2 5 1] Elapsed time: 0.04346466064453125 graph_id used : 80108 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20781332,20781326,20781339,20781330,20781329,20781331,20781333,20781334,20781335,20781341,20781337,20781338,20781340?tags=carton,papier,pet_clair,pehd,environnement,refus,film_plastique,tetrapak,metal,pet_fonce,autre,mal_croppe,flou&datou_id_consolidate=4235&port_consolidate=20779166&tree_id=80108 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1339366605, 1339366602, 1339366599, 1339366596] Looping around the photos to save general results len do output : 1 /20779166Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366605', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366602', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366599', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366596', None, None, None, None, None, '2610482') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012542486190795898 save_final save missing photos in datou_result : time spend for datou_step_exec : 36.71158981323242 time spend to save output : 0.012814521789550781 total time spend for step 9 : 36.72440433502197 step10:send_mail_cod Mon Feb 24 20:24:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf 20781314 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207813141740425077 20781308 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207813081740425077 20781321 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207813211740425078 20781312 imagette207813121740425079 20781313 imagette207813131740425079 20781315 imagette207813151740425079 20781316 imagette207813161740425079 20781317 imagette207813171740425079 20781323 imagette207813231740425079 20781319 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207813191740425079 20781320 imagette207813201740425080 20781322 imagette207813221740425080 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20779166 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20781332,20781326,20781339,20781330,20781329,20781331,20781333,20781334,20781335,20781341,20781337,20781338,20781340?tags=carton,papier,pet_clair,pehd,environnement,refus,film_plastique,tetrapak,metal,pet_fonce,autre,mal_croppe,flou&datou_id_consolidate=4235&port_consolidate=20779166&tree_id=80108 your option no_mail is active, we will not send the real mail to your client args[1339366605] : ((1339366605, -7.389050871646514, 492609224), (1339366605, -0.6243371635886427, 501862349), '0.2344766697681388') We are sending mail with results at cod@fotonower.com args[1339366602] : ((1339366602, -7.38193246576138, 492609224), (1339366602, -0.6275312432606099, 501862349), '0.2344766697681388') We are sending mail with results at cod@fotonower.com args[1339366599] : ((1339366599, -7.392946213499503, 492609224), (1339366599, -0.6127635981347687, 501862349), '0.2344766697681388') We are sending mail with results at cod@fotonower.com args[1339366596] : ((1339366596, -7.373200792373475, 492609224), (1339366596, -0.6225100571016661, 501862349), '0.2344766697681388') We are sending mail with results at cod@fotonower.com refus_total : 0.2344766697681388 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779166 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20779166','results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf','pdf','','0.15','0.2344766697681388') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1339366605, 1339366602, 1339366599, 1339366596] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366605', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366602', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366599', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366596', None, None, None, None, None, '2610482') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012317419052124023 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.929361343383789 time spend to save output : 0.012592792510986328 total time spend for step 10 : 3.9419541358947754 step11:split_time_score Mon Feb 24 20:24:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24022025 20779166 Nombre de photos uploadées : 4 / 23040 (0%) 24022025 20779166 Nombre de photos taguées (types de déchets): 4 / 4 (100%) 24022025 20779166 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 1.049041748046875e-05 elapsed_time : order_list_meta_photo_and_scores 6.270408630371094e-05 ???? elapsed_time : fill_and_build_computed_from_old_data 0.002447843551635742 elapsed_time : insert_dashboard_record_day_entry 0.02285003662109375 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.12315286692610344 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20767926_24-02-2025_10_46_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20767926 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20767926 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769927 order by id desc limit 1 Qualite : 0.19192157647294192 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769928_24-02-2025_18_28_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769928 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769928 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769929 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769954 order by id desc limit 1 Qualite : 0.19472272069322913 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769955_24-02-2025_18_49_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769955 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769955 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769956 order by id desc limit 1 Qualite : 0.23355238148952678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769957_24-02-2025_18_55_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769957 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769957 AND mptpi.`type`=4230 To do Qualite : 0.19014267254990505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769958_24-02-2025_18_58_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769958 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769958 AND mptpi.`type`=4230 To do Qualite : 0.1833836220520911 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769983_24-02-2025_11_54_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769983 AND mptpi.`type`=4230 To do Qualite : 0.19665553106350908 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769984_24-02-2025_19_04_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769984 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769984 AND mptpi.`type`=4230 To do Qualite : 0.23731665410579766 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769985_24-02-2025_19_09_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769985 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769985 AND mptpi.`type`=4230 To do Qualite : 0.21937111169676032 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770547_24-02-2025_19_27_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770547 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770547 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770548 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770549 order by id desc limit 1 Qualite : 0.24072833978030664 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770550_24-02-2025_19_29_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770550 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770550 AND mptpi.`type`=4230 To do Qualite : 0.26387344144222896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770551_24-02-2025_19_32_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770551 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770551 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770552 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770553 order by id desc limit 1 Qualite : 0.23761633948862013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770554_24-02-2025_19_51_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770554 AND mptpi.`type`=4230 To do Qualite : 0.24234203905019133 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770555_24-02-2025_19_53_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770555 AND mptpi.`type`=4230 To do Qualite : 0.2550030691725577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770556_24-02-2025_20_15_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770556 AND mptpi.`type`=4230 To do Qualite : 0.2659923557004906 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20770557_24-02-2025_20_07_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770557 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20770557 AND mptpi.`type`=4230 To do Qualite : 0.2566031289772565 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771583_24-02-2025_20_13_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771583 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771583 AND mptpi.`type`=4230 To do Qualite : 0.2517094312879323 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771584_24-02-2025_20_18_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771584 AND mptpi.`type`=4230 To do Qualite : 0.18206223173915434 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771585_24-02-2025_20_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771585 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771585 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771586 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771589 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771590 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771591 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771592 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771593 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771594 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771595 order by id desc limit 1 Qualite : 0.24013689870139143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771596_24-02-2025_12_48_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771596 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771596 AND mptpi.`type`=4230 To do Qualite : 0.21094636630514205 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771597_24-02-2025_12_33_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771597 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771597 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771917 order by id desc limit 1 Qualite : 0.2472142555454651 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771918_24-02-2025_15_49_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771918 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771918 AND mptpi.`type`=4230 To do Qualite : 0.2654924659269221 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771919_24-02-2025_14_50_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771919 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771919 AND mptpi.`type`=4230 To do Qualite : 0.24347313754946903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771920_24-02-2025_13_48_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771920 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771920 AND mptpi.`type`=4230 To do Qualite : 0.25477322572762684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771921_24-02-2025_13_42_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771921 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774301 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774302 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774303 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774304 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774305 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774306 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774307 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774308 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774309 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774310 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774311 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774312 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774313 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774314 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774807 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774808 order by id desc limit 1 Qualite : 0.22512550723363015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774809_24-02-2025_16_32_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774809 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774809 AND mptpi.`type`=4230 To do Qualite : 0.2676980827896467 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774811_24-02-2025_16_17_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774811 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774811 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776130 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776132 order by id desc limit 1 Qualite : 0.2740202887306019 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776134_24-02-2025_17_34_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776134 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776134 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776137 order by id desc limit 1 Qualite : 0.15452677325102562 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776139_24-02-2025_16_50_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776139 AND mptpi.`type`=4230 To do Qualite : 0.26795604366198006 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20778556_24-02-2025_17_47_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20778556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20778556 AND mptpi.`type`=4230 To do Qualite : 0.2344766697681388 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779166_24-02-2025_20_24_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779166 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779166 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779167 order by id desc limit 1 Qualite : 0.1845385493439375 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779168_24-02-2025_18_36_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779168 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779168 AND mptpi.`type`=4230 To do Qualite : 0.19892543137470436 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779169 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779169 AND mptpi.`type`=4230 To do Qualite : 0.22153100249252605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779170_24-02-2025_18_17_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779170 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779170 AND mptpi.`type`=4230 To do Qualite : 0.19899965223646818 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779577_24-02-2025_19_32_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779577 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779577 AND mptpi.`type`=4230 To do Qualite : 0.20246425862176948 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779578_24-02-2025_19_53_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779578 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779578 AND mptpi.`type`=4230 To do Qualite : 0.2461702807893893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779579_24-02-2025_18_48_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779579 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779579 AND mptpi.`type`=4230 To do Qualite : 0.19850863879984906 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779993_24-02-2025_19_23_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779993 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24022025': {'nb_upload': 4, 'nb_taggue_class': 4, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1339366605, 1339366602, 1339366599, 1339366596] Looping around the photos to save general results len do output : 1 /20779166Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366605', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366602', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366599', None, None, None, None, None, '2610482') ('4234', None, None, None, None, None, None, None, '2610482') ('4234', '20779166', '1339366596', None, None, None, None, None, '2610482') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013646602630615234 save_final save missing photos in datou_result : time spend for datou_step_exec : 32.60883951187134 time spend to save output : 0.013798952102661133 total time spend for step 11 : 32.622638463974 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 50.17user 29.96system 4:47.93elapsed 27%CPU (0avgtext+0avgdata 2526584maxresident)k 12408inputs+17168outputs (141major+2453945minor)pagefaults 0swaps