python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3831515 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2654853'] with mtr_portfolio_ids : ['21228031'] and first list_photo_ids : [] new path : /proc/3831515/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.26347780227661133 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 10 17:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9930 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-10 17:20:34.952156: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-10 17:20:34.987151: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-10 17:20:34.990162: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f89e8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-10 17:20:34.990234: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-10 17:20:34.996363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-10 17:20:35.263145: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x40009620 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-10 17:20:35.263199: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-10 17:20:35.265311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 17:20:35.266879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 17:20:35.293989: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 17:20:35.318147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 17:20:35.321079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 17:20:35.362057: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 17:20:35.367815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 17:20:35.435872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 17:20:35.437516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 17:20:35.438123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 17:20:35.439376: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 17:20:35.439395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 17:20:35.439405: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 17:20:35.441813: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9192 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-10 17:20:35.863463: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 17:20:35.863569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 17:20:35.863599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 17:20:35.863627: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 17:20:35.863652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 17:20:35.863677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 17:20:35.863701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 17:20:35.863726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 17:20:35.865437: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 17:20:35.866839: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 17:20:35.866880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 17:20:35.866915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 17:20:35.867231: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 17:20:35.867321: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 17:20:35.867366: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 17:20:35.867408: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 17:20:35.867452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 17:20:35.869501: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 17:20:35.869556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 17:20:35.869570: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 17:20:35.869582: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 17:20:35.871211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9192 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-10 17:20:46.251567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 17:20:46.476692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.21953 max: 145.71719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00025534629821777344 length of segment : 14 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 32 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0006422996520996094 length of segment : 36 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.001325845718383789 length of segment : 47 time for calcul the mask position with numpy : 0.00013709068298339844 nb_pixel_total : 504 time to create 1 rle with old method : 0.0011699199676513672 length of segment : 45 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 2232 time to create 1 rle with old method : 0.004155158996582031 length of segment : 30 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0014629364013671875 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.96172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 4223 time to create 1 rle with old method : 0.0071985721588134766 length of segment : 64 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 3244 time to create 1 rle with old method : 0.00551915168762207 length of segment : 58 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 791 time to create 1 rle with old method : 0.0014171600341796875 length of segment : 34 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.001547098159790039 length of segment : 41 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1174 time to create 1 rle with old method : 0.0021009445190429688 length of segment : 34 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 1143 time to create 1 rle with old method : 0.002109050750732422 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -92.72344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 1491 time to create 1 rle with old method : 0.0023047924041748047 length of segment : 98 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.80938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0010743141174316406 length of segment : 24 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 729 time to create 1 rle with old method : 0.0015480518341064453 length of segment : 82 time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 2872 time to create 1 rle with old method : 0.008111000061035156 length of segment : 104 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0009894371032714844 length of segment : 34 time for calcul the mask position with numpy : 0.00031375885009765625 nb_pixel_total : 7347 time to create 1 rle with old method : 0.013396739959716797 length of segment : 136 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.25625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 398 time to create 1 rle with old method : 0.0009233951568603516 length of segment : 12 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 1027 time to create 1 rle with old method : 0.0013132095336914062 length of segment : 99 time for calcul the mask position with numpy : 0.0008635520935058594 nb_pixel_total : 69611 time to create 1 rle with old method : 0.08939909934997559 length of segment : 384 Processing 1 images image shape: (400, 400, 3) min: 12.00000 max: 212.00000 molded_images shape: (1, 640, 640, 3) min: -93.38359 max: 74.77187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.93047 max: 147.32266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.002290010452270508 length of segment : 35 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 8942 time to create 1 rle with old method : 0.015018463134765625 length of segment : 152 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0007278919219970703 length of segment : 23 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 3156 time to create 1 rle with old method : 0.0054547786712646484 length of segment : 65 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 1692 time to create 1 rle with old method : 0.003054380416870117 length of segment : 47 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.00044345855712890625 length of segment : 22 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005064010620117188 length of segment : 22 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003147125244140625 length of segment : 26 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0016372203826904297 length of segment : 32 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 678 time to create 1 rle with old method : 0.0009801387786865234 length of segment : 24 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 2325 time to create 1 rle with old method : 0.0028166770935058594 length of segment : 71 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 2406 time to create 1 rle with old method : 0.0029938220977783203 length of segment : 76 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 3180 time to create 1 rle with old method : 0.0037262439727783203 length of segment : 65 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00044035911560058594 length of segment : 23 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004229545593261719 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.73906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.0011191368103027344 length of segment : 38 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1880 time to create 1 rle with old method : 0.0024390220642089844 length of segment : 50 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003540515899658203 length of segment : 18 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1034 time to create 1 rle with old method : 0.0013599395751953125 length of segment : 33 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1830 time to create 1 rle with old method : 0.0037741661071777344 length of segment : 57 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0009219646453857422 length of segment : 50 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008080005645751953 length of segment : 33 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 791 time to create 1 rle with old method : 0.0010898113250732422 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.94219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007739067077636719 length of segment : 21 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1376 time to create 1 rle with old method : 0.0017249584197998047 length of segment : 43 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1391 time to create 1 rle with old method : 0.002371072769165039 length of segment : 48 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.00030541419982910156 length of segment : 25 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 3486 time to create 1 rle with old method : 0.004155158996582031 length of segment : 164 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 830 time to create 1 rle with old method : 0.00106048583984375 length of segment : 37 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 3147 time to create 1 rle with old method : 0.0037627220153808594 length of segment : 135 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.95937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 1407 time to create 1 rle with old method : 0.0018639564514160156 length of segment : 154 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0019233226776123047 length of segment : 74 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007781982421875 length of segment : 39 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 756 time to create 1 rle with old method : 0.0011026859283447266 length of segment : 45 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00036978721618652344 length of segment : 33 time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 4944 time to create 1 rle with old method : 0.007162570953369141 length of segment : 230 time for calcul the mask position with numpy : 0.0002257823944091797 nb_pixel_total : 4039 time to create 1 rle with old method : 0.005002737045288086 length of segment : 202 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007495880126953125 length of segment : 40 Processing 1 images image shape: (280, 400, 3) min: 15.00000 max: 195.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 78.15469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012438297271728516 nb_pixel_total : 103170 time to create 1 rle with old method : 0.1707761287689209 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002970695495605469 length of segment : 16 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004551410675048828 length of segment : 22 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1215 time to create 1 rle with old method : 0.0015211105346679688 length of segment : 46 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.000988006591796875 length of segment : 43 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005388259887695312 length of segment : 25 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003123283386230469 length of segment : 22 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015735626220703125 length of segment : 9 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 809 time to create 1 rle with old method : 0.0012450218200683594 length of segment : 24 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.0001690387725830078 length of segment : 12 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00045108795166015625 length of segment : 38 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 926 time to create 1 rle with old method : 0.0011382102966308594 length of segment : 49 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0016007423400878906 length of segment : 77 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0008876323699951172 length of segment : 42 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.00112152099609375 length of segment : 47 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0005886554718017578 length of segment : 12 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0007295608520507812 length of segment : 21 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003426074981689453 length of segment : 25 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0008256435394287109 length of segment : 23 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 592 time to create 1 rle with old method : 0.0008022785186767578 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.66641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 40 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 939 time to create 1 rle with old method : 0.0014202594757080078 length of segment : 34 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0015726089477539062 length of segment : 55 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006501674652099609 length of segment : 27 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.000514984130859375 length of segment : 29 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006999969482421875 length of segment : 18 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001881122589111328 length of segment : 11 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0007112026214599609 length of segment : 29 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1297 time to create 1 rle with old method : 0.00182342529296875 length of segment : 41 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001671314239501953 length of segment : 8 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006043910980224609 length of segment : 26 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007922649383544922 length of segment : 19 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0006396770477294922 length of segment : 18 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004687309265136719 length of segment : 29 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.0010390281677246094 length of segment : 38 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0008852481842041016 length of segment : 26 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 3067 time to create 1 rle with old method : 0.004118204116821289 length of segment : 61 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.00043654441833496094 length of segment : 33 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0006966590881347656 length of segment : 30 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0014567375183105469 length of segment : 38 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 24 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00016498565673828125 length of segment : 12 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0007712841033935547 length of segment : 34 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 824 time to create 1 rle with old method : 0.0012164115905761719 length of segment : 44 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1460 time to create 1 rle with old method : 0.001878976821899414 length of segment : 44 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.00031280517578125 length of segment : 20 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.00039958953857421875 length of segment : 28 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1655 time to create 1 rle with old method : 0.0021944046020507812 length of segment : 47 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006704330444335938 length of segment : 28 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0006089210510253906 length of segment : 19 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002410411834716797 length of segment : 13 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00016760826110839844 length of segment : 10 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004906654357910156 length of segment : 12 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.00045609474182128906 length of segment : 26 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00033926963806152344 length of segment : 10 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.000431060791015625 length of segment : 11 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2010 time to create 1 rle with old method : 0.0028743743896484375 length of segment : 63 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0005328655242919922 length of segment : 15 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 1525 time to create 1 rle with old method : 0.0022389888763427734 length of segment : 60 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1286 time to create 1 rle with old method : 0.0018334388732910156 length of segment : 44 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.00040793418884277344 length of segment : 20 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.13906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00036454200744628906 length of segment : 20 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006406307220458984 length of segment : 27 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0006275177001953125 length of segment : 29 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00019431114196777344 length of segment : 11 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002532005310058594 length of segment : 30 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.0012154579162597656 length of segment : 29 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0005102157592773438 length of segment : 28 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007677078247070312 length of segment : 27 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003752708435058594 length of segment : 29 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 536 time to create 1 rle with old method : 0.0007581710815429688 length of segment : 26 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.000484466552734375 length of segment : 28 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.0010941028594970703 length of segment : 39 time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 32589 time to create 1 rle with old method : 0.037017107009887695 length of segment : 211 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.0010433197021484375 length of segment : 116 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.62578 max: 145.36953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.00045680999755859375 length of segment : 26 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00021719932556152344 length of segment : 27 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0008015632629394531 length of segment : 54 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0008053779602050781 length of segment : 51 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.00010347366333007812 length of segment : 10 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 50 time to create 1 rle with old method : 9.5367431640625e-05 length of segment : 15 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 2252 time to create 1 rle with old method : 0.0028862953186035156 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.31719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0014531612396240234 length of segment : 42 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.0010199546813964844 length of segment : 37 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0017018318176269531 length of segment : 33 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 756 time to create 1 rle with old method : 0.0009906291961669922 length of segment : 34 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 2431 time to create 1 rle with old method : 0.003167867660522461 length of segment : 47 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 743 time to create 1 rle with old method : 0.0009965896606445312 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -80.74688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 595 time to create 1 rle with old method : 0.0011560916900634766 length of segment : 32 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1188 time to create 1 rle with old method : 0.0020723342895507812 length of segment : 35 time for calcul the mask position with numpy : 0.0063555240631103516 nb_pixel_total : 3090 time to create 1 rle with old method : 0.005339622497558594 length of segment : 104 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.13359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0011835098266601562 length of segment : 27 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0012578964233398438 length of segment : 29 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 3133 time to create 1 rle with old method : 0.0059888362884521484 length of segment : 115 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0010378360748291016 length of segment : 80 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 3171 time to create 1 rle with old method : 0.0060656070709228516 length of segment : 133 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.39297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0010979175567626953 length of segment : 14 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.001922607421875 length of segment : 93 time for calcul the mask position with numpy : 0.0008666515350341797 nb_pixel_total : 55485 time to create 1 rle with old method : 0.10374832153320312 length of segment : 323 time for calcul the mask position with numpy : 0.0008661746978759766 nb_pixel_total : 70574 time to create 1 rle with old method : 0.07860445976257324 length of segment : 354 Processing 1 images image shape: (400, 400, 3) min: 15.00000 max: 210.00000 molded_images shape: (1, 640, 640, 3) min: -95.26250 max: 83.64687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.86406 max: 150.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0009071826934814453 length of segment : 24 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 17 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003790855407714844 length of segment : 14 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 889 time to create 1 rle with old method : 0.0012936592102050781 length of segment : 23 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.00012230873107910156 length of segment : 8 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 3200 time to create 1 rle with old method : 0.003904581069946289 length of segment : 64 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 6669 time to create 1 rle with old method : 0.008037805557250977 length of segment : 171 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002849102020263672 length of segment : 12 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 3185 time to create 1 rle with old method : 0.003957509994506836 length of segment : 65 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.00010418891906738281 length of segment : 6 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.55938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1567 time to create 1 rle with old method : 0.00196075439453125 length of segment : 39 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002772808074951172 length of segment : 17 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001766681671142578 length of segment : 7 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00028133392333984375 length of segment : 15 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0009121894836425781 length of segment : 56 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.000949859619140625 length of segment : 20 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 861 time to create 1 rle with old method : 0.001554250717163086 length of segment : 35 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0010101795196533203 length of segment : 33 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 996 time to create 1 rle with old method : 0.0014033317565917969 length of segment : 36 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0012848377227783203 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.83672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00010943412780761719 nb_pixel_total : 4191 time to create 1 rle with old method : 0.004958629608154297 length of segment : 159 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007748603820800781 length of segment : 20 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00030040740966796875 length of segment : 26 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0017628669738769531 length of segment : 46 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.0010199546813964844 length of segment : 35 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1391 time to create 1 rle with old method : 0.0017185211181640625 length of segment : 43 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.001046895980834961 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.43984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0019321441650390625 length of segment : 165 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 1394 time to create 1 rle with old method : 0.0017633438110351562 length of segment : 80 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005528926849365234 length of segment : 36 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 1787 time to create 1 rle with old method : 0.002295255661010742 length of segment : 152 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 4641 time to create 1 rle with old method : 0.005493640899658203 length of segment : 225 time for calcul the mask position with numpy : 0.00029921531677246094 nb_pixel_total : 4009 time to create 1 rle with old method : 0.0062713623046875 length of segment : 200 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 849 time to create 1 rle with old method : 0.0011386871337890625 length of segment : 41 Processing 1 images image shape: (280, 400, 3) min: 13.00000 max: 198.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 79.92812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009200572967529297 nb_pixel_total : 103725 time to create 1 rle with old method : 0.1334547996520996 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1207 time to create 1 rle with old method : 0.0015408992767333984 length of segment : 48 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 21 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0004096031188964844 length of segment : 26 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0012421607971191406 length of segment : 66 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004878044128417969 length of segment : 23 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006558895111083984 length of segment : 22 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 860 time to create 1 rle with old method : 0.0011050701141357422 length of segment : 38 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.0010766983032226562 length of segment : 24 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0009679794311523438 length of segment : 67 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1780 time to create 1 rle with old method : 0.0022597312927246094 length of segment : 162 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004978179931640625 length of segment : 34 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0008826255798339844 length of segment : 22 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0002276897430419922 length of segment : 16 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 847 time to create 1 rle with old method : 0.0010533332824707031 length of segment : 48 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 787 time to create 1 rle with old method : 0.0009970664978027344 length of segment : 54 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 43 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.000446319580078125 length of segment : 29 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006296634674072266 length of segment : 29 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007145404815673828 length of segment : 47 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005962848663330078 length of segment : 18 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 615 time to create 1 rle with old method : 0.0008082389831542969 length of segment : 44 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007078647613525391 length of segment : 28 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1248 time to create 1 rle with old method : 0.0023279190063476562 length of segment : 51 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0016605854034423828 length of segment : 88 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00013637542724609375 length of segment : 9 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 19 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0016283988952636719 length of segment : 57 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006532669067382812 length of segment : 34 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005092620849609375 length of segment : 26 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0015001296997070312 length of segment : 54 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00018286705017089844 length of segment : 12 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 2196 time to create 1 rle with old method : 0.0028083324432373047 length of segment : 76 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0008652210235595703 length of segment : 28 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1011 time to create 1 rle with old method : 0.0013270378112792969 length of segment : 47 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003352165222167969 length of segment : 10 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.0008471012115478516 length of segment : 19 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.00102996826171875 length of segment : 35 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.00047397613525390625 length of segment : 15 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.00030922889709472656 length of segment : 20 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1784 time to create 1 rle with old method : 0.002202272415161133 length of segment : 48 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 1673 time to create 1 rle with old method : 0.0021104812622070312 length of segment : 67 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004277229309082031 length of segment : 27 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 18 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00039005279541015625 length of segment : 18 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00016379356384277344 length of segment : 9 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00045299530029296875 length of segment : 13 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1250 time to create 1 rle with old method : 0.0015742778778076172 length of segment : 41 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003998279571533203 length of segment : 24 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 68 time to create 1 rle with old method : 0.00013637542724609375 length of segment : 8 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004048347473144531 length of segment : 25 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1968 time to create 1 rle with old method : 0.0024056434631347656 length of segment : 62 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0010755062103271484 length of segment : 69 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004715919494628906 length of segment : 17 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0017006397247314453 length of segment : 48 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001690387725830078 length of segment : 12 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1228 time to create 1 rle with old method : 0.0014696121215820312 length of segment : 63 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 14 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00021767616271972656 length of segment : 13 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00015544891357421875 length of segment : 10 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.11562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00033593177795410156 length of segment : 22 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006091594696044922 length of segment : 29 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005939006805419922 length of segment : 32 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0011186599731445312 length of segment : 24 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004220008850097656 length of segment : 26 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.0002777576446533203 length of segment : 31 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006704330444335938 length of segment : 22 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005981922149658203 length of segment : 34 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003733634948730469 length of segment : 29 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0010428428649902344 length of segment : 36 time for calcul the mask position with numpy : 0.00039577484130859375 nb_pixel_total : 26107 time to create 1 rle with old method : 0.030589818954467773 length of segment : 218 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.000301361083984375 length of segment : 42 Detection mask done ! Trying to reset tf kernel 3832868 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4641 tf kernel not reseted sub process len(results) : 264 len(list_Values) 264 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 264 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9930 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 264 chid ids of type : 4228 Number RLEs to save : 13099 save missing photos in datou_result : time spend for datou_step_exec : 29.10288906097412 time spend to save output : 3.6461267471313477 total time spend for step 1 : 32.74901580810547 step2:brightness Mon Mar 10 17:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741623630_3831515_1342567206_05c53bb22d79731a873cb2524d6f5d4f.jpg treat image : temp/1741623630_3831515_1342567140_d15e9fa2e109e07cc460387ea4f2135d.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.013576984405517578 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.015012502670288086 save missing photos in datou_result : time spend for datou_step_exec : 0.6839802265167236 time spend to save output : 0.033477783203125 total time spend for step 2 : 0.7174580097198486 step3:blur_detection Mon Mar 10 17:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741623630_3831515_1342567206_05c53bb22d79731a873cb2524d6f5d4f.jpg resize: (1080, 1920) 1342567206 -7.545225880986211 treat image : temp/1741623630_3831515_1342567140_d15e9fa2e109e07cc460387ea4f2135d.jpg resize: (1080, 1920) 1342567140 -7.631828528708044 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.022168636322021484 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.012543678283691406 save missing photos in datou_result : time spend for datou_step_exec : 1.8976337909698486 time spend to save output : 0.03996133804321289 total time spend for step 3 : 1.9375951290130615 step4:rle_unique_nms_with_priority Mon Mar 10 17:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 264 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 134 nb_hashtags : 8 time to prepare the origin masks : 1.2587227821350098 time for calcul the mask position with numpy : 0.09638619422912598 nb_pixel_total : 1760290 time to create 1 rle with new method : 0.2391369342803955 time for calcul the mask position with numpy : 0.008867979049682617 nb_pixel_total : 69611 time to create 1 rle with old method : 0.09320378303527832 time for calcul the mask position with numpy : 0.010239839553833008 nb_pixel_total : 1491 time to create 1 rle with old method : 0.002161264419555664 time for calcul the mask position with numpy : 0.008634090423583984 nb_pixel_total : 29 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.008687734603881836 nb_pixel_total : 1174 time to create 1 rle with old method : 0.0013799667358398438 time for calcul the mask position with numpy : 0.010613441467285156 nb_pixel_total : 66 time to create 1 rle with old method : 0.0001571178436279297 time for calcul the mask position with numpy : 0.009037494659423828 nb_pixel_total : 120 time to create 1 rle with old method : 0.00018644332885742188 time for calcul the mask position with numpy : 0.009404182434082031 nb_pixel_total : 82 time to create 1 rle with old method : 0.0001575946807861328 time for calcul the mask position with numpy : 0.009443044662475586 nb_pixel_total : 2232 time to create 1 rle with old method : 0.002847433090209961 time for calcul the mask position with numpy : 0.009465217590332031 nb_pixel_total : 791 time to create 1 rle with old method : 0.0009229183197021484 time for calcul the mask position with numpy : 0.008679389953613281 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007534027099609375 time for calcul the mask position with numpy : 0.010169029235839844 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002067089080810547 time for calcul the mask position with numpy : 0.010662078857421875 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004696846008300781 time for calcul the mask position with numpy : 0.008836030960083008 nb_pixel_total : 17 time to create 1 rle with old method : 9.083747863769531e-05 time for calcul the mask position with numpy : 0.008604049682617188 nb_pixel_total : 4223 time to create 1 rle with old method : 0.0047571659088134766 time for calcul the mask position with numpy : 0.008495569229125977 nb_pixel_total : 729 time to create 1 rle with old method : 0.0008528232574462891 time for calcul the mask position with numpy : 0.008536100387573242 nb_pixel_total : 77 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.010007143020629883 nb_pixel_total : 491 time to create 1 rle with old method : 0.0005850791931152344 time for calcul the mask position with numpy : 0.008562326431274414 nb_pixel_total : 490 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.008567094802856445 nb_pixel_total : 1027 time to create 1 rle with old method : 0.0012056827545166016 time for calcul the mask position with numpy : 0.008618593215942383 nb_pixel_total : 2872 time to create 1 rle with old method : 0.003276824951171875 time for calcul the mask position with numpy : 0.008599281311035156 nb_pixel_total : 7347 time to create 1 rle with old method : 0.008346319198608398 time for calcul the mask position with numpy : 0.008538007736206055 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004730224609375 time for calcul the mask position with numpy : 0.008638381958007812 nb_pixel_total : 3147 time to create 1 rle with old method : 0.005358695983886719 time for calcul the mask position with numpy : 0.00853586196899414 nb_pixel_total : 3486 time to create 1 rle with old method : 0.003976583480834961 time for calcul the mask position with numpy : 0.009227275848388672 nb_pixel_total : 830 time to create 1 rle with old method : 0.0015151500701904297 time for calcul the mask position with numpy : 0.011030197143554688 nb_pixel_total : 8942 time to create 1 rle with old method : 0.01042485237121582 time for calcul the mask position with numpy : 0.008449316024780273 nb_pixel_total : 1376 time to create 1 rle with old method : 0.0015716552734375 time for calcul the mask position with numpy : 0.008523702621459961 nb_pixel_total : 756 time to create 1 rle with old method : 0.0008602142333984375 time for calcul the mask position with numpy : 0.008425474166870117 nb_pixel_total : 194 time to create 1 rle with old method : 0.00023794174194335938 time for calcul the mask position with numpy : 0.008424043655395508 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006673336029052734 time for calcul the mask position with numpy : 0.008391141891479492 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006358623504638672 time for calcul the mask position with numpy : 0.008403539657592773 nb_pixel_total : 1692 time to create 1 rle with old method : 0.0019283294677734375 time for calcul the mask position with numpy : 0.008429288864135742 nb_pixel_total : 35 time to create 1 rle with old method : 8.368492126464844e-05 time for calcul the mask position with numpy : 0.008276700973510742 nb_pixel_total : 4944 time to create 1 rle with old method : 0.005623817443847656 time for calcul the mask position with numpy : 0.008426904678344727 nb_pixel_total : 793 time to create 1 rle with old method : 0.0009784698486328125 time for calcul the mask position with numpy : 0.008504390716552734 nb_pixel_total : 33 time to create 1 rle with old method : 0.00010371208190917969 time for calcul the mask position with numpy : 0.008709430694580078 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007114410400390625 time for calcul the mask position with numpy : 0.008440971374511719 nb_pixel_total : 233 time to create 1 rle with old method : 0.00027871131896972656 time for calcul the mask position with numpy : 0.008355140686035156 nb_pixel_total : 1407 time to create 1 rle with old method : 0.0016629695892333984 time for calcul the mask position with numpy : 0.00838780403137207 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0014002323150634766 time for calcul the mask position with numpy : 0.008390188217163086 nb_pixel_total : 1034 time to create 1 rle with old method : 0.0012013912200927734 time for calcul the mask position with numpy : 0.008516311645507812 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002601146697998047 time for calcul the mask position with numpy : 0.008414983749389648 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003333091735839844 time for calcul the mask position with numpy : 0.008444547653198242 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0014204978942871094 time for calcul the mask position with numpy : 0.008445978164672852 nb_pixel_total : 1391 time to create 1 rle with old method : 0.0016160011291503906 time for calcul the mask position with numpy : 0.008390188217163086 nb_pixel_total : 1830 time to create 1 rle with old method : 0.0020895004272460938 time for calcul the mask position with numpy : 0.008441448211669922 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003657341003417969 time for calcul the mask position with numpy : 0.008367300033569336 nb_pixel_total : 47 time to create 1 rle with old method : 0.00016069412231445312 time for calcul the mask position with numpy : 0.00834965705871582 nb_pixel_total : 3156 time to create 1 rle with old method : 0.0035376548767089844 time for calcul the mask position with numpy : 0.008611917495727539 nb_pixel_total : 17 time to create 1 rle with old method : 5.602836608886719e-05 time for calcul the mask position with numpy : 0.008571386337280273 nb_pixel_total : 303 time to create 1 rle with old method : 0.0003859996795654297 time for calcul the mask position with numpy : 0.008626461029052734 nb_pixel_total : 678 time to create 1 rle with old method : 0.0008392333984375 time for calcul the mask position with numpy : 0.010668277740478516 nb_pixel_total : 1372 time to create 1 rle with old method : 0.002519845962524414 time for calcul the mask position with numpy : 0.008655786514282227 nb_pixel_total : 622 time to create 1 rle with old method : 0.0007781982421875 time for calcul the mask position with numpy : 0.008612632751464844 nb_pixel_total : 2325 time to create 1 rle with old method : 0.002667665481567383 time for calcul the mask position with numpy : 0.008673429489135742 nb_pixel_total : 185 time to create 1 rle with old method : 0.00023484230041503906 time for calcul the mask position with numpy : 0.010315418243408203 nb_pixel_total : 11 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.010885477066040039 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005817413330078125 time for calcul the mask position with numpy : 0.01069784164428711 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003910064697265625 time for calcul the mask position with numpy : 0.008790731430053711 nb_pixel_total : 1880 time to create 1 rle with old method : 0.0021827220916748047 time for calcul the mask position with numpy : 0.009380817413330078 nb_pixel_total : 103170 time to create 1 rle with old method : 0.1431572437286377 time for calcul the mask position with numpy : 0.008737325668334961 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001308917999267578 time for calcul the mask position with numpy : 0.009564399719238281 nb_pixel_total : 324 time to create 1 rle with old method : 0.00041604042053222656 time for calcul the mask position with numpy : 0.010426759719848633 nb_pixel_total : 75 time to create 1 rle with old method : 0.00016689300537109375 time for calcul the mask position with numpy : 0.009927511215209961 nb_pixel_total : 309 time to create 1 rle with old method : 0.0003867149353027344 time for calcul the mask position with numpy : 0.009607315063476562 nb_pixel_total : 311 time to create 1 rle with old method : 0.0006122589111328125 time for calcul the mask position with numpy : 0.009778022766113281 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002052783966064453 time for calcul the mask position with numpy : 0.008675098419189453 nb_pixel_total : 29 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.008659839630126953 nb_pixel_total : 67 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.008603811264038086 nb_pixel_total : 174 time to create 1 rle with old method : 0.00023221969604492188 time for calcul the mask position with numpy : 0.008472681045532227 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003120899200439453 time for calcul the mask position with numpy : 0.008555173873901367 nb_pixel_total : 824 time to create 1 rle with old method : 0.0009877681732177734 time for calcul the mask position with numpy : 0.008807659149169922 nb_pixel_total : 341 time to create 1 rle with old method : 0.00042891502380371094 time for calcul the mask position with numpy : 0.00857234001159668 nb_pixel_total : 1215 time to create 1 rle with old method : 0.001417398452758789 time for calcul the mask position with numpy : 0.008531332015991211 nb_pixel_total : 780 time to create 1 rle with old method : 0.0009353160858154297 time for calcul the mask position with numpy : 0.009821414947509766 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006515979766845703 time for calcul the mask position with numpy : 0.008768558502197266 nb_pixel_total : 97 time to create 1 rle with old method : 0.00014519691467285156 time for calcul the mask position with numpy : 0.008565425872802734 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0012998580932617188 time for calcul the mask position with numpy : 0.008575201034545898 nb_pixel_total : 99 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.011394977569580078 nb_pixel_total : 926 time to create 1 rle with old method : 0.0023093223571777344 time for calcul the mask position with numpy : 0.008731365203857422 nb_pixel_total : 1297 time to create 1 rle with old method : 0.001924276351928711 time for calcul the mask position with numpy : 0.00898599624633789 nb_pixel_total : 495 time to create 1 rle with old method : 0.0005962848663330078 time for calcul the mask position with numpy : 0.00899362564086914 nb_pixel_total : 13 time to create 1 rle with old method : 7.009506225585938e-05 time for calcul the mask position with numpy : 0.008786678314208984 nb_pixel_total : 1 time to create 1 rle with old method : 2.6226043701171875e-05 time for calcul the mask position with numpy : 0.008637428283691406 nb_pixel_total : 190 time to create 1 rle with old method : 0.00024199485778808594 time for calcul the mask position with numpy : 0.008491992950439453 nb_pixel_total : 809 time to create 1 rle with old method : 0.0009508132934570312 time for calcul the mask position with numpy : 0.00880885124206543 nb_pixel_total : 31890 time to create 1 rle with old method : 0.03749394416809082 time for calcul the mask position with numpy : 0.008920907974243164 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005176067352294922 time for calcul the mask position with numpy : 0.010037899017333984 nb_pixel_total : 317 time to create 1 rle with old method : 0.00042748451232910156 time for calcul the mask position with numpy : 0.009268522262573242 nb_pixel_total : 10 time to create 1 rle with old method : 5.364418029785156e-05 time for calcul the mask position with numpy : 0.009291887283325195 nb_pixel_total : 666 time to create 1 rle with old method : 0.0008306503295898438 time for calcul the mask position with numpy : 0.009420156478881836 nb_pixel_total : 3067 time to create 1 rle with old method : 0.003679037094116211 time for calcul the mask position with numpy : 0.009973526000976562 nb_pixel_total : 190 time to create 1 rle with old method : 0.00039768218994140625 time for calcul the mask position with numpy : 0.011244535446166992 nb_pixel_total : 483 time to create 1 rle with old method : 0.0008711814880371094 time for calcul the mask position with numpy : 0.009840965270996094 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003650188446044922 time for calcul the mask position with numpy : 0.010536432266235352 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002803802490234375 time for calcul the mask position with numpy : 0.009701728820800781 nb_pixel_total : 12 time to create 1 rle with old method : 4.38690185546875e-05 time for calcul the mask position with numpy : 0.008654117584228516 nb_pixel_total : 77 time to create 1 rle with old method : 0.00020456314086914062 time for calcul the mask position with numpy : 0.008789777755737305 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005910396575927734 time for calcul the mask position with numpy : 0.009994745254516602 nb_pixel_total : 48 time to create 1 rle with old method : 0.0001513957977294922 time for calcul the mask position with numpy : 0.008863449096679688 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0014941692352294922 time for calcul the mask position with numpy : 0.008758783340454102 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005002021789550781 time for calcul the mask position with numpy : 0.010131359100341797 nb_pixel_total : 22 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.008835315704345703 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002560615539550781 time for calcul the mask position with numpy : 0.009073972702026367 nb_pixel_total : 24 time to create 1 rle with old method : 0.00010752677917480469 time for calcul the mask position with numpy : 0.010313272476196289 nb_pixel_total : 698 time to create 1 rle with old method : 0.0008118152618408203 time for calcul the mask position with numpy : 0.009001493453979492 nb_pixel_total : 417 time to create 1 rle with old method : 0.0007245540618896484 time for calcul the mask position with numpy : 0.008594036102294922 nb_pixel_total : 189 time to create 1 rle with old method : 0.00024819374084472656 time for calcul the mask position with numpy : 0.010383844375610352 nb_pixel_total : 622 time to create 1 rle with old method : 0.0012469291687011719 time for calcul the mask position with numpy : 0.010352134704589844 nb_pixel_total : 470 time to create 1 rle with old method : 0.0007843971252441406 time for calcul the mask position with numpy : 0.008502721786499023 nb_pixel_total : 105 time to create 1 rle with old method : 0.00015163421630859375 time for calcul the mask position with numpy : 0.009384632110595703 nb_pixel_total : 1655 time to create 1 rle with old method : 0.002040386199951172 time for calcul the mask position with numpy : 0.008512020111083984 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005345344543457031 time for calcul the mask position with numpy : 0.008527040481567383 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005033016204833984 time for calcul the mask position with numpy : 0.008535385131835938 nb_pixel_total : 1524 time to create 1 rle with old method : 0.0028603076934814453 time for calcul the mask position with numpy : 0.013518095016479492 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0027036666870117188 time for calcul the mask position with numpy : 0.020495176315307617 nb_pixel_total : 770 time to create 1 rle with old method : 0.001539468765258789 time for calcul the mask position with numpy : 0.018462419509887695 nb_pixel_total : 537 time to create 1 rle with old method : 0.0010972023010253906 time for calcul the mask position with numpy : 0.018506288528442383 nb_pixel_total : 1460 time to create 1 rle with old method : 0.002834796905517578 time for calcul the mask position with numpy : 0.012829303741455078 nb_pixel_total : 15 time to create 1 rle with old method : 7.987022399902344e-05 time for calcul the mask position with numpy : 0.020630598068237305 nb_pixel_total : 4 time to create 1 rle with old method : 3.504753112792969e-05 time for calcul the mask position with numpy : 0.013674736022949219 nb_pixel_total : 779 time to create 1 rle with old method : 0.0015442371368408203 time for calcul the mask position with numpy : 0.013463973999023438 nb_pixel_total : 308 time to create 1 rle with old method : 0.0005583763122558594 time for calcul the mask position with numpy : 0.010612964630126953 nb_pixel_total : 699 time to create 1 rle with old method : 0.0008444786071777344 time for calcul the mask position with numpy : 0.00853276252746582 nb_pixel_total : 2010 time to create 1 rle with old method : 0.0023386478424072266 time for calcul the mask position with numpy : 0.008767366409301758 nb_pixel_total : 376 time to create 1 rle with old method : 0.00044918060302734375 time for calcul the mask position with numpy : 0.008438587188720703 nb_pixel_total : 238 time to create 1 rle with old method : 0.0002894401550292969 time for calcul the mask position with numpy : 0.008440017700195312 nb_pixel_total : 313 time to create 1 rle with old method : 0.00037217140197753906 time for calcul the mask position with numpy : 0.008449792861938477 nb_pixel_total : 939 time to create 1 rle with old method : 0.0010755062103271484 time for calcul the mask position with numpy : 0.008473396301269531 nb_pixel_total : 547 time to create 1 rle with old method : 0.0006330013275146484 time for calcul the mask position with numpy : 0.008417844772338867 nb_pixel_total : 283 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.00970458984375 nb_pixel_total : 392 time to create 1 rle with old method : 0.0007052421569824219 time for calcul the mask position with numpy : 0.009843111038208008 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001399517059326172 time for calcul the mask position with numpy : 0.008445501327514648 nb_pixel_total : 72 time to create 1 rle with old method : 9.870529174804688e-05 create new chi : 2.0413286685943604 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.005573749542236328 batch 1 Loaded 135 chid ids of type : 4230 Number RLEs to save : 12586 TO DO : save crop sub photo not yet done ! save time : 5.230002403259277 nb_obj : 130 nb_hashtags : 8 time to prepare the origin masks : 3.445547580718994 time for calcul the mask position with numpy : 0.05120205879211426 nb_pixel_total : 1774960 time to create 1 rle with new method : 0.22319436073303223 time for calcul the mask position with numpy : 0.017105579376220703 nb_pixel_total : 3090 time to create 1 rle with old method : 0.005705118179321289 time for calcul the mask position with numpy : 0.016729116439819336 nb_pixel_total : 19411 time to create 1 rle with old method : 0.024325847625732422 time for calcul the mask position with numpy : 0.007012605667114258 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0014910697937011719 time for calcul the mask position with numpy : 0.007157564163208008 nb_pixel_total : 23 time to create 1 rle with old method : 8.344650268554688e-05 time for calcul the mask position with numpy : 0.007257699966430664 nb_pixel_total : 765 time to create 1 rle with old method : 0.0009751319885253906 time for calcul the mask position with numpy : 0.007577419281005859 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006694793701171875 time for calcul the mask position with numpy : 0.0071032047271728516 nb_pixel_total : 2252 time to create 1 rle with old method : 0.0025119781494140625 time for calcul the mask position with numpy : 0.0072629451751708984 nb_pixel_total : 24 time to create 1 rle with old method : 8.416175842285156e-05 time for calcul the mask position with numpy : 0.007136821746826172 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002262592315673828 time for calcul the mask position with numpy : 0.007243633270263672 nb_pixel_total : 146 time to create 1 rle with old method : 0.0001900196075439453 time for calcul the mask position with numpy : 0.006809234619140625 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003674030303955078 time for calcul the mask position with numpy : 0.007347583770751953 nb_pixel_total : 55485 time to create 1 rle with old method : 0.0635685920715332 time for calcul the mask position with numpy : 0.006787300109863281 nb_pixel_total : 2431 time to create 1 rle with old method : 0.0027458667755126953 time for calcul the mask position with numpy : 0.006921052932739258 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006477832794189453 time for calcul the mask position with numpy : 0.0075147151947021484 nb_pixel_total : 1167 time to create 1 rle with old method : 0.00145721435546875 time for calcul the mask position with numpy : 0.006986856460571289 nb_pixel_total : 54 time to create 1 rle with old method : 8.368492126464844e-05 time for calcul the mask position with numpy : 0.006982326507568359 nb_pixel_total : 602 time to create 1 rle with old method : 0.0007050037384033203 time for calcul the mask position with numpy : 0.007743358612060547 nb_pixel_total : 595 time to create 1 rle with old method : 0.0007281303405761719 time for calcul the mask position with numpy : 0.006869316101074219 nb_pixel_total : 560 time to create 1 rle with old method : 0.0006458759307861328 time for calcul the mask position with numpy : 0.007026195526123047 nb_pixel_total : 986 time to create 1 rle with old method : 0.0012819766998291016 time for calcul the mask position with numpy : 0.006954669952392578 nb_pixel_total : 3133 time to create 1 rle with old method : 0.003547191619873047 time for calcul the mask position with numpy : 0.007450103759765625 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005664825439453125 time for calcul the mask position with numpy : 0.007625579833984375 nb_pixel_total : 1188 time to create 1 rle with old method : 0.0014050006866455078 time for calcul the mask position with numpy : 0.007408857345581055 nb_pixel_total : 50 time to create 1 rle with old method : 8.0108642578125e-05 time for calcul the mask position with numpy : 0.0071370601654052734 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005662441253662109 time for calcul the mask position with numpy : 0.007150173187255859 nb_pixel_total : 400 time to create 1 rle with old method : 0.000476837158203125 time for calcul the mask position with numpy : 0.007433414459228516 nb_pixel_total : 4191 time to create 1 rle with old method : 0.0060253143310546875 time for calcul the mask position with numpy : 0.008977174758911133 nb_pixel_total : 803 time to create 1 rle with old method : 0.0011467933654785156 time for calcul the mask position with numpy : 0.00884556770324707 nb_pixel_total : 70 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.00847172737121582 nb_pixel_total : 1391 time to create 1 rle with old method : 0.0019648075103759766 time for calcul the mask position with numpy : 0.008557558059692383 nb_pixel_total : 6669 time to create 1 rle with old method : 0.009823799133300781 time for calcul the mask position with numpy : 0.009688138961791992 nb_pixel_total : 537 time to create 1 rle with old method : 0.0009868144989013672 time for calcul the mask position with numpy : 0.010217905044555664 nb_pixel_total : 494 time to create 1 rle with old method : 0.000919342041015625 time for calcul the mask position with numpy : 0.011373519897460938 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0024335384368896484 time for calcul the mask position with numpy : 0.01061105728149414 nb_pixel_total : 4641 time to create 1 rle with old method : 0.009111404418945312 time for calcul the mask position with numpy : 0.011648178100585938 nb_pixel_total : 668 time to create 1 rle with old method : 0.0010294914245605469 time for calcul the mask position with numpy : 0.008564472198486328 nb_pixel_total : 709 time to create 1 rle with old method : 0.000881195068359375 time for calcul the mask position with numpy : 0.011710405349731445 nb_pixel_total : 112 time to create 1 rle with old method : 0.0002491474151611328 time for calcul the mask position with numpy : 0.00860285758972168 nb_pixel_total : 889 time to create 1 rle with old method : 0.001341104507446289 time for calcul the mask position with numpy : 0.006974220275878906 nb_pixel_total : 142 time to create 1 rle with old method : 0.00023245811462402344 time for calcul the mask position with numpy : 0.006995201110839844 nb_pixel_total : 861 time to create 1 rle with old method : 0.0010306835174560547 time for calcul the mask position with numpy : 0.00856781005859375 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002715587615966797 time for calcul the mask position with numpy : 0.006775856018066406 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0015399456024169922 time for calcul the mask position with numpy : 0.00658416748046875 nb_pixel_total : 61 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.0072460174560546875 nb_pixel_total : 3200 time to create 1 rle with old method : 0.0036847591400146484 time for calcul the mask position with numpy : 0.007454872131347656 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003445148468017578 time for calcul the mask position with numpy : 0.007569074630737305 nb_pixel_total : 90 time to create 1 rle with old method : 0.00016117095947265625 time for calcul the mask position with numpy : 0.007230997085571289 nb_pixel_total : 179 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.012046575546264648 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0013484954833984375 time for calcul the mask position with numpy : 0.013576745986938477 nb_pixel_total : 664 time to create 1 rle with old method : 0.0009605884552001953 time for calcul the mask position with numpy : 0.013106584548950195 nb_pixel_total : 1394 time to create 1 rle with old method : 0.0017752647399902344 time for calcul the mask position with numpy : 0.010335445404052734 nb_pixel_total : 57 time to create 1 rle with old method : 9.417533874511719e-05 time for calcul the mask position with numpy : 0.009607553482055664 nb_pixel_total : 1 time to create 1 rle with old method : 2.002716064453125e-05 time for calcul the mask position with numpy : 0.009151458740234375 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002243518829345703 time for calcul the mask position with numpy : 0.008140325546264648 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007338523864746094 time for calcul the mask position with numpy : 0.00865626335144043 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.011098623275756836 nb_pixel_total : 1567 time to create 1 rle with old method : 0.0017824172973632812 time for calcul the mask position with numpy : 0.007062196731567383 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006296634674072266 time for calcul the mask position with numpy : 0.007947206497192383 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003044605255126953 time for calcul the mask position with numpy : 0.008141279220581055 nb_pixel_total : 103725 time to create 1 rle with old method : 0.1371440887451172 time for calcul the mask position with numpy : 0.008888483047485352 nb_pixel_total : 818 time to create 1 rle with old method : 0.0010662078857421875 time for calcul the mask position with numpy : 0.010071039199829102 nb_pixel_total : 271 time to create 1 rle with old method : 0.000400543212890625 time for calcul the mask position with numpy : 0.01233053207397461 nb_pixel_total : 68 time to create 1 rle with old method : 0.00012445449829101562 time for calcul the mask position with numpy : 0.011284112930297852 nb_pixel_total : 169 time to create 1 rle with old method : 0.00027370452880859375 time for calcul the mask position with numpy : 0.012256145477294922 nb_pixel_total : 208 time to create 1 rle with old method : 0.00029850006103515625 time for calcul the mask position with numpy : 0.01784515380859375 nb_pixel_total : 197 time to create 1 rle with old method : 0.00025272369384765625 time for calcul the mask position with numpy : 0.011325836181640625 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005383491516113281 time for calcul the mask position with numpy : 0.012263774871826172 nb_pixel_total : 5 time to create 1 rle with old method : 3.8623809814453125e-05 time for calcul the mask position with numpy : 0.011389493942260742 nb_pixel_total : 101 time to create 1 rle with old method : 0.00015664100646972656 time for calcul the mask position with numpy : 0.01287388801574707 nb_pixel_total : 615 time to create 1 rle with old method : 0.000827789306640625 time for calcul the mask position with numpy : 0.010315895080566406 nb_pixel_total : 1207 time to create 1 rle with old method : 0.0013976097106933594 time for calcul the mask position with numpy : 0.010185718536376953 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004439353942871094 time for calcul the mask position with numpy : 0.009931564331054688 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003883838653564453 time for calcul the mask position with numpy : 0.01003575325012207 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006046295166015625 time for calcul the mask position with numpy : 0.0113983154296875 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002696514129638672 time for calcul the mask position with numpy : 0.01060175895690918 nb_pixel_total : 94 time to create 1 rle with old method : 0.00012421607971191406 time for calcul the mask position with numpy : 0.009395599365234375 nb_pixel_total : 144 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.010056018829345703 nb_pixel_total : 1248 time to create 1 rle with old method : 0.0014188289642333984 time for calcul the mask position with numpy : 0.011127471923828125 nb_pixel_total : 175 time to create 1 rle with old method : 0.00036406517028808594 time for calcul the mask position with numpy : 0.011335134506225586 nb_pixel_total : 9 time to create 1 rle with old method : 5.1975250244140625e-05 time for calcul the mask position with numpy : 0.010121345520019531 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002970695495605469 time for calcul the mask position with numpy : 0.010084390640258789 nb_pixel_total : 1076 time to create 1 rle with old method : 0.001245737075805664 time for calcul the mask position with numpy : 0.010149717330932617 nb_pixel_total : 1228 time to create 1 rle with old method : 0.00139617919921875 time for calcul the mask position with numpy : 0.010022878646850586 nb_pixel_total : 120 time to create 1 rle with old method : 0.00017642974853515625 time for calcul the mask position with numpy : 0.010962247848510742 nb_pixel_total : 802 time to create 1 rle with old method : 0.001062631607055664 time for calcul the mask position with numpy : 0.01466059684753418 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004687309265136719 time for calcul the mask position with numpy : 0.010426044464111328 nb_pixel_total : 11 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.010161399841308594 nb_pixel_total : 315 time to create 1 rle with old method : 0.00037479400634765625 time for calcul the mask position with numpy : 0.01071786880493164 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0016167163848876953 time for calcul the mask position with numpy : 0.011277914047241211 nb_pixel_total : 1673 time to create 1 rle with old method : 0.001912832260131836 time for calcul the mask position with numpy : 0.010433197021484375 nb_pixel_total : 25465 time to create 1 rle with old method : 0.029308557510375977 time for calcul the mask position with numpy : 0.011057853698730469 nb_pixel_total : 2196 time to create 1 rle with old method : 0.0025942325592041016 time for calcul the mask position with numpy : 0.011080503463745117 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007264614105224609 time for calcul the mask position with numpy : 0.011110782623291016 nb_pixel_total : 280 time to create 1 rle with old method : 0.00034332275390625 time for calcul the mask position with numpy : 0.011864900588989258 nb_pixel_total : 1780 time to create 1 rle with old method : 0.002305746078491211 time for calcul the mask position with numpy : 0.011003971099853516 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003185272216796875 time for calcul the mask position with numpy : 0.01042795181274414 nb_pixel_total : 757 time to create 1 rle with old method : 0.0008726119995117188 time for calcul the mask position with numpy : 0.010260343551635742 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003693103790283203 time for calcul the mask position with numpy : 0.010586977005004883 nb_pixel_total : 489 time to create 1 rle with old method : 0.000579833984375 time for calcul the mask position with numpy : 0.011599540710449219 nb_pixel_total : 1784 time to create 1 rle with old method : 0.0020599365234375 time for calcul the mask position with numpy : 0.014508247375488281 nb_pixel_total : 19 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.011362075805664062 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005207061767578125 time for calcul the mask position with numpy : 0.015659570693969727 nb_pixel_total : 316 time to create 1 rle with old method : 0.000385284423828125 time for calcul the mask position with numpy : 0.011836767196655273 nb_pixel_total : 520 time to create 1 rle with old method : 0.0006132125854492188 time for calcul the mask position with numpy : 0.010223388671875 nb_pixel_total : 135 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.012448549270629883 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004899501800537109 time for calcul the mask position with numpy : 0.012731075286865234 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006074905395507812 time for calcul the mask position with numpy : 0.013499259948730469 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006868839263916016 time for calcul the mask position with numpy : 0.012476682662963867 nb_pixel_total : 1334 time to create 1 rle with old method : 0.001524209976196289 time for calcul the mask position with numpy : 0.009723901748657227 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007162094116210938 time for calcul the mask position with numpy : 0.009510040283203125 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009222030639648438 time for calcul the mask position with numpy : 0.009874820709228516 nb_pixel_total : 815 time to create 1 rle with old method : 0.0010266304016113281 time for calcul the mask position with numpy : 0.009697675704956055 nb_pixel_total : 834 time to create 1 rle with old method : 0.001081705093383789 time for calcul the mask position with numpy : 0.008414745330810547 nb_pixel_total : 1250 time to create 1 rle with old method : 0.0014755725860595703 time for calcul the mask position with numpy : 0.008103609085083008 nb_pixel_total : 381 time to create 1 rle with old method : 0.0004546642303466797 time for calcul the mask position with numpy : 0.009323835372924805 nb_pixel_total : 18 time to create 1 rle with old method : 7.081031799316406e-05 time for calcul the mask position with numpy : 0.009666204452514648 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006737709045410156 time for calcul the mask position with numpy : 0.009278535842895508 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003821849822998047 time for calcul the mask position with numpy : 0.009494543075561523 nb_pixel_total : 644 time to create 1 rle with old method : 0.0007762908935546875 time for calcul the mask position with numpy : 0.010141372680664062 nb_pixel_total : 152 time to create 1 rle with old method : 0.00021386146545410156 time for calcul the mask position with numpy : 0.010351181030273438 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006644725799560547 time for calcul the mask position with numpy : 0.010520696640014648 nb_pixel_total : 1964 time to create 1 rle with old method : 0.002239227294921875 time for calcul the mask position with numpy : 0.010915279388427734 nb_pixel_total : 237 time to create 1 rle with old method : 0.00034880638122558594 time for calcul the mask position with numpy : 0.011136293411254883 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004291534423828125 time for calcul the mask position with numpy : 0.011178016662597656 nb_pixel_total : 7 time to create 1 rle with old method : 4.9114227294921875e-05 time for calcul the mask position with numpy : 0.01368570327758789 nb_pixel_total : 1011 time to create 1 rle with old method : 0.001230001449584961 time for calcul the mask position with numpy : 0.01064300537109375 nb_pixel_total : 549 time to create 1 rle with old method : 0.0006561279296875 time for calcul the mask position with numpy : 0.010558128356933594 nb_pixel_total : 230 time to create 1 rle with old method : 0.00029277801513671875 time for calcul the mask position with numpy : 0.010507822036743164 nb_pixel_total : 108 time to create 1 rle with old method : 0.000148773193359375 time for calcul the mask position with numpy : 0.011314153671264648 nb_pixel_total : 74 time to create 1 rle with old method : 0.00012540817260742188 create new chi : 1.9471104145050049 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0031366348266601562 batch 1 Loaded 131 chid ids of type : 4230 Number RLEs to save : 12782 TO DO : save crop sub photo not yet done ! save time : 1.5833253860473633 map_output_result : {1342567206: (0.0, 'Should be the crop_list due to order', 0.0), 1342567140: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1342567206, 1342567140] Looping around the photos to save general results len do output : 2 /1342567206.Didn't retrieve data . /1342567140.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567206', None, None, None, None, None, '2654853') ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567140', None, None, None, None, None, '2654853') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.018062829971313477 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.02993869781494 time spend to save output : 0.0183868408203125 total time spend for step 4 : 16.048325538635254 step5:crop_condition Mon Mar 10 17:21:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 266 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 86 About to insert : list_path_to_insert length 86 new photo from crops ! About to upload 86 photos upload in portfolio : 4869462 init cache_photo without model_param we have 86 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741623683_3831515 we have uploaded 86 photos in the portfolio 4869462 time of upload the photos Elapsed time : 24.474178552627563 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 4869462 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741623708_3831515 we have uploaded 31 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.546057224273682 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 4869462 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741623720_3831515 we have uploaded 17 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.30679965019226 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 4869462 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741623729_3831515 we have uploaded 28 photos in the portfolio 4869462 time of upload the photos Elapsed time : 10.291614770889282 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741623739_3831515 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.9160399436950684 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741623742_3831515 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8722717761993408 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1342567206, 1342567140] Looping around the photos to save general results len do output : 164 /1342582787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342582998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342583140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567206', None, None, None, None, None, '2654853') ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567140', None, None, None, None, None, '2654853') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 494 time used for this insertion : 0.1415555477142334 save_final save missing photos in datou_result : time spend for datou_step_exec : 60.81080722808838 time spend to save output : 0.1452770233154297 total time spend for step 5 : 60.95608425140381 step6:thcl Mon Mar 10 17:22:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.008049249649047852 time to convert the images to numpy array : 0.04007101058959961 time to import caffe and check if the image exist : 0.010880231857299805 time to convert the images to numpy array : 0.04235076904296875 time to import caffe and check if the image exist : 0.015526771545410156 time to convert the images to numpy array : 0.04229474067687988 time to import caffe and check if the image exist : 0.012528657913208008 time to convert the images to numpy array : 0.04518008232116699 time to import caffe and check if the image exist : 0.013599157333374023 time to convert the images to numpy array : 0.046765804290771484 time to import caffe and check if the image exist : 0.013329267501831055 time to convert the images to numpy array : 0.0480349063873291 time to import caffe and check if the image exist : 0.016463279724121094 time to convert the images to numpy array : 0.05037879943847656 time to import caffe and check if the image exist : 0.00915670394897461 time to convert the images to numpy array : 0.057633399963378906 time to import caffe and check if the image exist : 0.020120620727539062 time to convert the images to numpy array : 0.047434091567993164 time to import caffe and check if the image exist : 0.03830838203430176 time to convert the images to numpy array : 0.029832839965820312 total time to convert the images to numpy array : 0.365825891494751 list photo_ids error: [] list photo_ids correct : [1342583120, 1342583121, 1342583122, 1342583123, 1342583125, 1342583126, 1342583127, 1342583128, 1342583129, 1342583131, 1342583140, 1342582864, 1342582865, 1342582867, 1342582869, 1342582871, 1342582873, 1342582874, 1342582875, 1342582877, 1342582878, 1342582879, 1342582881, 1342582882, 1342582884, 1342582885, 1342582886, 1342582888, 1342582889, 1342582890, 1342582893, 1342582894, 1342582895, 1342582897, 1342582898, 1342582899, 1342582901, 1342582902, 1342582904, 1342582905, 1342582906, 1342582908, 1342582909, 1342582910, 1342582912, 1342582986, 1342582987, 1342582988, 1342582990, 1342582991, 1342582993, 1342582994, 1342582995, 1342582997, 1342582998, 1342583000, 1342583001, 1342583003, 1342583005, 1342583006, 1342583036, 1342583038, 1342582787, 1342582788, 1342582790, 1342582791, 1342582792, 1342582794, 1342582795, 1342582796, 1342582798, 1342582799, 1342582800, 1342582802, 1342582804, 1342582805, 1342582807, 1342582808, 1342582809, 1342582913, 1342582963, 1342582964, 1342582966, 1342582967, 1342582968, 1342582970, 1342582971, 1342582972, 1342582974, 1342582975, 1342582976, 1342582978, 1342582979, 1342582981, 1342582983, 1342582984, 1342582837, 1342582840, 1342582841, 1342582844, 1342582845, 1342582846, 1342582849, 1342582850, 1342582852, 1342582853, 1342582854, 1342582856, 1342582857, 1342582859, 1342582860, 1342582861, 1342582863, 1342583095, 1342583098, 1342583099, 1342583101, 1342583102, 1342583103, 1342583104, 1342583107, 1342583108, 1342583109, 1342583110, 1342583111, 1342583113, 1342583114, 1342583116, 1342583118, 1342583119, 1342582811, 1342582812, 1342582813, 1342582815, 1342582816, 1342582817, 1342582819, 1342582820, 1342582821, 1342582823, 1342582824, 1342582825, 1342582828, 1342582829, 1342582832, 1342582834, 1342582835, 1342583039, 1342583041, 1342583043, 1342583045, 1342583047, 1342583049, 1342583051, 1342583053, 1342583054, 1342583056, 1342583058, 1342583060, 1342583061, 1342583063, 1342583064, 1342583091, 1342583094] number of photos to traite : 164 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10151 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9932 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 0.8413753509521484 time used to do the prediction : 0.6891953945159912 save descriptor for thcl : 3237 time to traite the descriptors : 1.142211675643921 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1342583120 To insert : 1342583121 To insert : 1342583122 To insert : 1342583123 To insert : 1342583125 To insert : 1342583126 To insert : 1342583127 To insert : 1342583128 To insert : 1342583129 To insert : 1342583131 To insert : 1342583140 To insert : 1342582864 To insert : 1342582865 To insert : 1342582867 To insert : 1342582869 To insert : 1342582871 To insert : 1342582873 To insert : 1342582874 To insert : 1342582875 To insert : 1342582877 To insert : 1342582878 To insert : 1342582879 To insert : 1342582881 To insert : 1342582882 To insert : 1342582884 To insert : 1342582885 To insert : 1342582886 To insert : 1342582888 To insert : 1342582889 To insert : 1342582890 To insert : 1342582893 To insert : 1342582894 To insert : 1342582895 To insert : 1342582897 To insert : 1342582898 To insert : 1342582899 To insert : 1342582901 To insert : 1342582902 To insert : 1342582904 To insert : 1342582905 To insert : 1342582906 To insert : 1342582908 To insert : 1342582909 To insert : 1342582910 To insert : 1342582912 To insert : 1342582986 To insert : 1342582987 To insert : 1342582988 To insert : 1342582990 To insert : 1342582991 To insert : 1342582993 To insert : 1342582994 To insert : 1342582995 To insert : 1342582997 To insert : 1342582998 To insert : 1342583000 To insert : 1342583001 To insert : 1342583003 To insert : 1342583005 To insert : 1342583006 To insert : 1342583036 To insert : 1342583038 To insert : 1342582787 To insert : 1342582788 To insert : 1342582790 To insert : 1342582791 To insert : 1342582792 To insert : 1342582794 To insert : 1342582795 To insert : 1342582796 To insert : 1342582798 To insert : 1342582799 To insert : 1342582800 To insert : 1342582802 To insert : 1342582804 To insert : 1342582805 To insert : 1342582807 To insert : 1342582808 To insert : 1342582809 To insert : 1342582913 To insert : 1342582963 To insert : 1342582964 To insert : 1342582966 To insert : 1342582967 To insert : 1342582968 To insert : 1342582970 To insert : 1342582971 To insert : 1342582972 To insert : 1342582974 To insert : 1342582975 To insert : 1342582976 To insert : 1342582978 To insert : 1342582979 To insert : 1342582981 To insert : 1342582983 To insert : 1342582984 To insert : 1342582837 To insert : 1342582840 To insert : 1342582841 To insert : 1342582844 To insert : 1342582845 To insert : 1342582846 To insert : 1342582849 To insert : 1342582850 To insert : 1342582852 To insert : 1342582853 To insert : 1342582854 To insert : 1342582856 To insert : 1342582857 To insert : 1342582859 To insert : 1342582860 To insert : 1342582861 To insert : 1342582863 To insert : 1342583095 To insert : 1342583098 To insert : 1342583099 To insert : 1342583101 To insert : 1342583102 To insert : 1342583103 To insert : 1342583104 To insert : 1342583107 To insert : 1342583108 To insert : 1342583109 To insert : 1342583110 To insert : 1342583111 To insert : 1342583113 To insert : 1342583114 To insert : 1342583116 To insert : 1342583118 To insert : 1342583119 To insert : 1342582811 To insert : 1342582812 To insert : 1342582813 To insert : 1342582815 To insert : 1342582816 To insert : 1342582817 To insert : 1342582819 To insert : 1342582820 To insert : 1342582821 To insert : 1342582823 To insert : 1342582824 To insert : 1342582825 To insert : 1342582828 To insert : 1342582829 To insert : 1342582832 To insert : 1342582834 To insert : 1342582835 To insert : 1342583039 To insert : 1342583041 To insert : 1342583043 To insert : 1342583045 To insert : 1342583047 To insert : 1342583049 To insert : 1342583051 To insert : 1342583053 To insert : 1342583054 To insert : 1342583056 To insert : 1342583058 To insert : 1342583060 To insert : 1342583061 To insert : 1342583063 To insert : 1342583064 To insert : 1342583091 To insert : 1342583094 time to insert the descriptors : 31.204596996307373 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 248 time used for this insertion : 0.14966058731079102 save missing photos in datou_result : time spend for datou_step_exec : 38.93403911590576 time spend to save output : 0.20479059219360352 total time spend for step 6 : 39.138829708099365 step7:ventilate_hashtags_in_portfolio Mon Mar 10 17:23:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21228031 get user id for portfolio 21228031 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228031 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_fonce','Carton','Tetrapak','PEHD','papier','flou','metal','Film_plastique','PET_clair','PET_fonce','carton','autre','pehd','refus','pet_clair','Papier','mal_croppe')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228031 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_fonce','Carton','Tetrapak','PEHD','papier','flou','metal','Film_plastique','PET_clair','PET_fonce','carton','autre','pehd','refus','pet_clair','Papier','mal_croppe')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228031 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_fonce','Carton','Tetrapak','PEHD','papier','flou','metal','Film_plastique','PET_clair','PET_fonce','carton','autre','pehd','refus','pet_clair','Papier','mal_croppe')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228031 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pet_fonce','Carton','Tetrapak','PEHD','papier','flou','metal','Film_plastique','PET_clair','PET_fonce','carton','autre','pehd','refus','pet_clair','Papier','mal_croppe')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21229895,21229910,21229911,21229900,21229914,21229918,21229904,21229906,21229907,21229917,21229912,21229915,21229920?tags=environnement,pet_fonce,carton,tetrapak,pehd,papier,flou,metal,film_plastique,pet_clair,autre,refus,mal_croppe&datou_id_consolidate=4235&port_consolidate=21228031 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1342567206, 1342567140] Looping around the photos to save general results len do output : 1 /21228031. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567206', None, None, None, None, None, '2654853') ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567140', None, None, None, None, None, '2654853') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01472020149230957 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.494052171707153 time spend to save output : 0.015186548233032227 total time spend for step 7 : 10.509238719940186 step8:final Mon Mar 10 17:23:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1342567206: ('0.24677055739511408',), 1342567140: ('0.24677055739511408',)} new output for save of step final : {1342567206: ('0.24677055739511408',), 1342567140: ('0.24677055739511408',)} [1342567206, 1342567140] Looping around the photos to save general results len do output : 2 /1342567206.Didn't retrieve data . /1342567140.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567206', None, None, None, None, None, '2654853') ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567140', None, None, None, None, None, '2654853') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.019513845443725586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13267970085144043 time spend to save output : 0.01978754997253418 total time spend for step 8 : 0.1524672508239746 step9:velours_tree Mon Mar 10 17:23:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21229895,21229910,21229911,21229900,21229914,21229918,21229904,21229906,21229907,21229917,21229912,21229915,21229920 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229895 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229910 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229911 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229900 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229914 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229918 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229904 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229906 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229907 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229917 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229912 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229915 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21229920 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 164 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 3 0 4 5 0 0 0 2 2 1 1 1 0 0 0 0 0 2 1 1 0 0 1 2 2 2 5 0 0 2 2 2 1 1 1 1 2 2 0 2 1 3 0 0 2 2 0 4 5 2 2 2 2 1 0 1 5 0 0 2 0 1 5 5 1 1 2 0 2 0 5 2 2 2 0 1 1 1 2 2 2 1 3 0 2 0 2 2 2 0 2 0 2 0 1 1 2 5 0 0 0 2 3 0 2 2 2 1 2 2 2 2 1 5 0 0 0 5 5 0 1 0 5 0 0 0 2 0 2 0 0 0 0 3 2 3 0 4 0 5 1 2 0 3 0 1 0 0 0 2 3 4 0 0 1 2 0 3 1 0 0 2 2] Elapsed time: 0.02765655517578125 graph_id used : 82510 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21229895,21229910,21229911,21229900,21229914,21229918,21229904,21229906,21229907,21229917,21229912,21229915,21229920?tags=environnement,pet_fonce,carton,tetrapak,pehd,papier,flou,metal,film_plastique,pet_clair,autre,refus,mal_croppe&datou_id_consolidate=4235&port_consolidate=21228031&tree_id=82510 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1342567206, 1342567140] Looping around the photos to save general results len do output : 1 /21228031Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567206', None, None, None, None, None, '2654853') ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567140', None, None, None, None, None, '2654853') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.04534268379211426 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.427059412002563 time spend to save output : 0.0456390380859375 total time spend for step 9 : 26.4726984500885 step10:send_mail_cod Mon Mar 10 17:23:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21228031_10-03-2025_17_23_39.pdf 21229885 change filename to text .imagette212298851741623819 21229886 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212298861741623819 21229878 imagette212298781741623820 21229888 change filename to text .imagette212298881741623820 21229891 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212298911741623820 21229881 imagette212298811741623821 21229882 imagette212298821741623821 21229883 imagette212298831741623821 21229890 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212298901741623821 21229887 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212298871741623822 21229889 imagette212298891741623823 21229892 imagette212298921741623823 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21228031 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21229895,21229910,21229911,21229900,21229914,21229918,21229904,21229906,21229907,21229917,21229912,21229915,21229920?tags=environnement,pet_fonce,carton,tetrapak,pehd,papier,flou,metal,film_plastique,pet_clair,autre,refus,mal_croppe&datou_id_consolidate=4235&port_consolidate=21228031&tree_id=82510 your option no_mail is active, we will not send the real mail to your client args[1342567206] : ((1342567206, -7.545225880986211, 492609224), (1342567206, -0.39402664466532666, 496442774), '0.24677055739511408') We are sending mail with results at cod@fotonower.com args[1342567140] : ((1342567140, -7.631828528708044, 492609224), (1342567140, -0.37211496859372784, 496442774), '0.24677055739511408') We are sending mail with results at cod@fotonower.com refus_total : 0.24677055739511408 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21228031 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228031_10-03-2025_17_23_39.pdf results_Qualipapia_P21228031_10-03-2025_17_23_39.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228031_10-03-2025_17_23_39.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21228031','results_Qualipapia_P21228031_10-03-2025_17_23_39.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228031_10-03-2025_17_23_39.pdf','pdf','','0.16','0.24677055739511408') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1342567206, 1342567140] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567206', None, None, None, None, None, '2654853') ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567140', None, None, None, None, None, '2654853') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.03580427169799805 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.028226852416992 time spend to save output : 0.03597068786621094 total time spend for step 10 : 5.064197540283203 step11:split_time_score Mon Mar 10 17:23:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10032025 21228031 Nombre de photos uploadées : 2 / 23040 (0%) 10032025 21228031 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 10032025 21228031 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 8.58306884765625e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00018477439880371094 elapsed_time : insert_dashboard_record_day_entry 0.16917634010314941 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.22149212909081842 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228756_10-03-2025_17_07_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228756 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228756 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21227996 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21227997 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21227998 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21227999 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228000 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228001 order by id desc limit 1 Qualite : 0.2269882658297269 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228002_10-03-2025_16_51_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228002 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228002 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225722 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225725 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225727 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225729 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225730 order by id desc limit 1 Qualite : 0.22583614925806508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21225731_10-03-2025_16_05_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225731 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21225731 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224373 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224374 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224375 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224376 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224377 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224378 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222441 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222442 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222444 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222445 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222446 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222447 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222448 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222449 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222466 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222483 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222484 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222485 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222486 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222487 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222489 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222490 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222491 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222493 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221311 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221312 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221313 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221314 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221315 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221316 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221317 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221319 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221321 order by id desc limit 1 Qualite : 0.21046428553265062 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221322_10-03-2025_14_57_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221322 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221322 AND mptpi.`type`=4230 To do Qualite : 0.2463029070088356 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221123_10-03-2025_14_21_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221123 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221123 AND mptpi.`type`=4230 To do Qualite : 0.2287247994172867 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221324_10-03-2025_14_56_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221324 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221324 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221326 order by id desc limit 1 Qualite : 0.23017781634605472 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221327_10-03-2025_14_53_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221327 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221327 AND mptpi.`type`=4230 To do Qualite : 0.2392766488331622 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221329_10-03-2025_14_48_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221329 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221329 AND mptpi.`type`=4230 To do Qualite : 0.2416098495827734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221331_10-03-2025_14_47_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221331 AND mptpi.`type`=4230 To do Qualite : 0.21151262987772793 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221332_10-03-2025_14_47_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221332 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221332 AND mptpi.`type`=4230 To do Qualite : 0.1866215700653093 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221333_10-03-2025_14_45_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221333 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221333 AND mptpi.`type`=4230 To do Qualite : 0.2476384769968913 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221334_10-03-2025_14_47_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221334 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221334 AND mptpi.`type`=4230 To do Qualite : 0.22266474871535327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221335_10-03-2025_14_51_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221335 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221335 AND mptpi.`type`=4230 To do Qualite : 0.21282245175539322 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21221337_10-03-2025_14_36_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21221337 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21221337 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222498 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222501 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222502 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222503 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222504 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222505 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222508 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222511 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222514 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222517 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222519 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222522 order by id desc limit 1 Qualite : 0.213978209235516 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21222525_10-03-2025_15_32_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222525 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222525 AND mptpi.`type`=4230 To do Qualite : 0.2041695679450676 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21222528_10-03-2025_15_07_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222528 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222528 AND mptpi.`type`=4230 To do Qualite : 0.20450723112275113 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21222534_10-03-2025_15_18_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222534 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222534 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222539 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224380 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224381 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224382 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224383 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224384 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224385 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224386 order by id desc limit 1 Qualite : 0.13829442059756816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21224387_10-03-2025_16_03_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224387 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21224387 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224388 order by id desc limit 1 Qualite : 0.19934454301638904 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21224389_10-03-2025_15_51_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21224389 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21224389 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225744 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225745 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225746 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225754 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225760 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225761 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225762 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225787 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225788 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225790 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225792 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225793 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225795 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225796 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225798 order by id desc limit 1 Qualite : 0.20258369881784766 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21225799_10-03-2025_16_45_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225799 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21225799 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225800 order by id desc limit 1 Qualite : 0.20266772831754704 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21225802_10-03-2025_16_23_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225802 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21225802 AND mptpi.`type`=4230 To do Qualite : 0.19192355879717435 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21225803_10-03-2025_16_50_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21225803 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21225803 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228003 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228004 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228005 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228006 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228007 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228008 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228009 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228011 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228013 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228016 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228017 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228019 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228022 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228024 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228027 order by id desc limit 1 Qualite : 0.24714998010253056 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228028_10-03-2025_16_57_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228028 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228028 AND mptpi.`type`=4230 To do Qualite : 0.24677055739511408 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228031_10-03-2025_17_23_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228031 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228031 AND mptpi.`type`=4230 To do Qualite : 0.19817195614234814 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228033_10-03-2025_17_18_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228033 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228033 AND mptpi.`type`=4230 To do Qualite : 0.19040405547223285 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21228765_10-03-2025_17_05_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21228765 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21228765 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10032025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1342567206, 1342567140] Looping around the photos to save general results len do output : 1 /21228031Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567206', None, None, None, None, None, '2654853') ('4234', None, None, None, None, None, None, None, '2654853') ('4234', '21228031', '1342567140', None, None, None, None, None, '2654853') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.040483951568603516 save_final save missing photos in datou_result : time spend for datou_step_exec : 94.88569664955139 time spend to save output : 0.04073071479797363 total time spend for step 11 : 94.92642736434937 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 37.86user 25.51system 4:54.15elapsed 21%CPU (0avgtext+0avgdata 2637452maxresident)k 2436480inputs+12416outputs (8404major+2643098minor)pagefaults 0swaps