python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 223917 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 6>5 please execute split_portfolio.py -i 20421981 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2574023'] with mtr_portfolio_ids : ['20421981'] and first list_photo_ids : [] new path : /proc/223917/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.6361260414123535 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Feb 10 23:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-10 23:20:32.202217: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-10 23:20:32.227115: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-10 23:20:32.229052: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc1e8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-10 23:20:32.229098: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-10 23:20:32.232610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-10 23:20:32.456805: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1da4a570 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-10 23:20:32.456847: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-10 23:20:32.458236: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-10 23:20:32.458611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-10 23:20:32.461302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-10 23:20:32.463906: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-10 23:20:32.464309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-10 23:20:32.466742: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-10 23:20:32.467952: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-10 23:20:32.472782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-10 23:20:32.474486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-10 23:20:32.474552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-10 23:20:32.475481: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-10 23:20:32.475501: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-10 23:20:32.475512: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-10 23:20:32.476934: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-10 23:20:32.726255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-10 23:20:32.726365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-10 23:20:32.726401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-10 23:20:32.726434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-10 23:20:32.726466: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-10 23:20:32.726499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-10 23:20:32.726533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-10 23:20:32.726569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-10 23:20:32.728689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-10 23:20:32.730084: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-10 23:20:32.730134: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-10 23:20:32.730157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-10 23:20:32.730177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-10 23:20:32.730197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-10 23:20:32.730217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-10 23:20:32.730237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-10 23:20:32.730256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-10 23:20:32.731807: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-10 23:20:32.731837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-10 23:20:32.731846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-10 23:20:32.731854: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-10 23:20:32.733188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-10 23:20:39.159743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-10 23:20:39.340637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.63359 max: 149.51797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 534 time to create 1 rle with old method : 0.0012784004211425781 length of segment : 48 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0004832744598388672 length of segment : 17 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0005257129669189453 length of segment : 40 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0010826587677001953 length of segment : 32 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 37 time to create 1 rle with old method : 0.00013256072998046875 length of segment : 14 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00012540817260742188 length of segment : 35 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 2 time to create 1 rle with old method : 2.193450927734375e-05 length of segment : 1 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 26 time to create 1 rle with old method : 5.221366882324219e-05 length of segment : 14 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0007534027099609375 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.27031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1859 time to create 1 rle with old method : 0.002383708953857422 length of segment : 57 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1020 time to create 1 rle with old method : 0.0013375282287597656 length of segment : 48 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0010952949523925781 length of segment : 58 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003960132598876953 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -91.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00020647048950195312 nb_pixel_total : 6178 time to create 1 rle with old method : 0.007626056671142578 length of segment : 115 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 577 time to create 1 rle with old method : 0.0007956027984619141 length of segment : 24 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 2616 time to create 1 rle with old method : 0.0032434463500976562 length of segment : 106 time for calcul the mask position with numpy : 0.00018477439880371094 nb_pixel_total : 4467 time to create 1 rle with old method : 0.005459785461425781 length of segment : 45 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 2680 time to create 1 rle with old method : 0.003481149673461914 length of segment : 127 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.26641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00046825408935546875 length of segment : 21 time for calcul the mask position with numpy : 0.0001590251922607422 nb_pixel_total : 8762 time to create 1 rle with old method : 0.010593175888061523 length of segment : 104 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 2666 time to create 1 rle with old method : 0.003390789031982422 length of segment : 65 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0008482933044433594 length of segment : 29 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 3601 time to create 1 rle with old method : 0.0044956207275390625 length of segment : 64 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 37 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002677440643310547 length of segment : 28 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 10520 time to create 1 rle with old method : 0.012059450149536133 length of segment : 101 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 242.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 105.86562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0007138252258300781 length of segment : 18 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 2240 time to create 1 rle with old method : 0.0026657581329345703 length of segment : 136 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 2113 time to create 1 rle with old method : 0.002630949020385742 length of segment : 73 time for calcul the mask position with numpy : 0.0006868839263916016 nb_pixel_total : 64603 time to create 1 rle with old method : 0.0721750259399414 length of segment : 262 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 185.00000 molded_images shape: (1, 640, 640, 3) min: -93.47813 max: 55.48516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -104.44609 max: 136.93047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006260871887207031 length of segment : 20 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 2039 time to create 1 rle with old method : 0.002736330032348633 length of segment : 32 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0006108283996582031 length of segment : 17 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1073 time to create 1 rle with old method : 0.00140380859375 length of segment : 43 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0010683536529541016 length of segment : 32 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00014662742614746094 length of segment : 8 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006206035614013672 length of segment : 28 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006773471832275391 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -99.12266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00043773651123046875 length of segment : 23 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0014710426330566406 length of segment : 50 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 583 time to create 1 rle with old method : 0.0008876323699951172 length of segment : 29 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001537799835205078 length of segment : 11 time for calcul the mask position with numpy : 0.0002613067626953125 nb_pixel_total : 17658 time to create 1 rle with old method : 0.020206451416015625 length of segment : 157 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00022125244140625 length of segment : 19 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008723735809326172 length of segment : 38 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 676 time to create 1 rle with old method : 0.001010894775390625 length of segment : 33 time for calcul the mask position with numpy : 0.00025534629821777344 nb_pixel_total : 8511 time to create 1 rle with old method : 0.010241270065307617 length of segment : 247 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0010232925415039062 length of segment : 31 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0005488395690917969 length of segment : 23 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 2369 time to create 1 rle with old method : 0.0037064552307128906 length of segment : 85 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004470348358154297 length of segment : 21 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.0009298324584960938 length of segment : 46 time for calcul the mask position with numpy : 0.0002486705780029297 nb_pixel_total : 12922 time to create 1 rle with old method : 0.015299797058105469 length of segment : 255 time for calcul the mask position with numpy : 0.0002942085266113281 nb_pixel_total : 17229 time to create 1 rle with old method : 0.01988077163696289 length of segment : 201 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.35234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 2202 time to create 1 rle with old method : 0.002675294876098633 length of segment : 139 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1234 time to create 1 rle with old method : 0.001720428466796875 length of segment : 44 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0010120868682861328 length of segment : 23 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1312 time to create 1 rle with old method : 0.0017216205596923828 length of segment : 40 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1363 time to create 1 rle with old method : 0.0017480850219726562 length of segment : 41 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010962486267089844 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 243.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 112.24688 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.00044465065002441406 length of segment : 34 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.00044465065002441406 length of segment : 34 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 977 time to create 1 rle with old method : 0.0013175010681152344 length of segment : 139 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.00030922889709472656 length of segment : 25 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1267 time to create 1 rle with old method : 0.0016372203826904297 length of segment : 68 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.00099945068359375 length of segment : 39 time for calcul the mask position with numpy : 0.0001735687255859375 nb_pixel_total : 4085 time to create 1 rle with old method : 0.004858255386352539 length of segment : 197 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 46.25859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009391307830810547 nb_pixel_total : 106125 time to create 1 rle with old method : 0.1179194450378418 length of segment : 278 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.66250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006072521209716797 length of segment : 28 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 3196 time to create 1 rle with old method : 0.003973960876464844 length of segment : 53 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0008282661437988281 length of segment : 41 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.00041556358337402344 length of segment : 21 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003867149353027344 length of segment : 19 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005583763122558594 length of segment : 24 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.57656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.00091552734375 length of segment : 25 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00035691261291503906 length of segment : 17 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0005896091461181641 length of segment : 35 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00018095970153808594 length of segment : 8 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00035262107849121094 length of segment : 29 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0003581047058105469 length of segment : 16 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 36 time to create 1 rle with old method : 9.465217590332031e-05 length of segment : 13 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011587142944335938 length of segment : 21 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002460479736328125 length of segment : 14 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001583099365234375 length of segment : 9 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00024247169494628906 length of segment : 21 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.88750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.95391 max: 149.74062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002532005310058594 length of segment : 32 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003604888916015625 length of segment : 17 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 745 time to create 1 rle with old method : 0.0010304450988769531 length of segment : 38 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 729 time to create 1 rle with old method : 0.0010066032409667969 length of segment : 27 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00012636184692382812 length of segment : 12 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.001016378402709961 length of segment : 37 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 11 time to create 1 rle with old method : 3.4332275390625e-05 length of segment : 8 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 44 time to create 1 rle with old method : 8.034706115722656e-05 length of segment : 17 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 5 time to create 1 rle with old method : 3.2901763916015625e-05 length of segment : 1 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001590251922607422 length of segment : 31 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0004162788391113281 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.72344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 2320 time to create 1 rle with old method : 0.005135059356689453 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -92.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0002620220184326172 nb_pixel_total : 10344 time to create 1 rle with old method : 0.01317286491394043 length of segment : 136 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.60625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0007560253143310547 length of segment : 28 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.00048089027404785156 length of segment : 29 time for calcul the mask position with numpy : 0.00014662742614746094 nb_pixel_total : 10642 time to create 1 rle with old method : 0.013026952743530273 length of segment : 87 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003139972686767578 length of segment : 23 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004734992980957031 length of segment : 32 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 3324 time to create 1 rle with old method : 0.004263877868652344 length of segment : 84 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 245.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 119.66250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0008761882781982422 length of segment : 18 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 2216 time to create 1 rle with old method : 0.0027060508728027344 length of segment : 160 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00018644332885742188 length of segment : 8 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 2303 time to create 1 rle with old method : 0.0028052330017089844 length of segment : 84 time for calcul the mask position with numpy : 0.0007634162902832031 nb_pixel_total : 70707 time to create 1 rle with old method : 0.07954835891723633 length of segment : 313 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -97.34531 max: 54.23359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -104.28594 max: 136.61406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006840229034423828 length of segment : 22 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1965 time to create 1 rle with old method : 0.002850770950317383 length of segment : 35 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 847 time to create 1 rle with old method : 0.0011875629425048828 length of segment : 31 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 14 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0014700889587402344 length of segment : 38 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0011138916015625 length of segment : 29 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0008454322814941406 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -97.51328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.00047206878662109375 length of segment : 23 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0019724369049072266 length of segment : 55 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00019359588623046875 length of segment : 14 time for calcul the mask position with numpy : 0.0002872943878173828 nb_pixel_total : 7102 time to create 1 rle with old method : 0.010670661926269531 length of segment : 175 time for calcul the mask position with numpy : 0.0001976490020751953 nb_pixel_total : 4269 time to create 1 rle with old method : 0.006131410598754883 length of segment : 156 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004749298095703125 length of segment : 26 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001761913299560547 length of segment : 12 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0007123947143554688 length of segment : 21 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0011799335479736328 length of segment : 31 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.0001590251922607422 length of segment : 12 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 657 time to create 1 rle with old method : 0.0013022422790527344 length of segment : 30 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0005466938018798828 length of segment : 17 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0008111000061035156 length of segment : 19 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 11717 time to create 1 rle with old method : 0.02147221565246582 length of segment : 169 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0012090206146240234 length of segment : 33 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.001051187515258789 length of segment : 23 time for calcul the mask position with numpy : 0.00032067298889160156 nb_pixel_total : 8115 time to create 1 rle with old method : 0.013171195983886719 length of segment : 173 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 2059 time to create 1 rle with old method : 0.004109621047973633 length of segment : 135 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0025260448455810547 length of segment : 41 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 68 time to create 1 rle with old method : 0.00020360946655273438 length of segment : 23 time for calcul the mask position with numpy : 0.00023293495178222656 nb_pixel_total : 751 time to create 1 rle with old method : 0.0017676353454589844 length of segment : 77 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 1329 time to create 1 rle with old method : 0.0028498172760009766 length of segment : 48 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1378 time to create 1 rle with old method : 0.002808809280395508 length of segment : 40 time for calcul the mask position with numpy : 0.0004611015319824219 nb_pixel_total : 12714 time to create 1 rle with old method : 0.018882274627685547 length of segment : 355 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 243.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 112.24688 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0005400180816650391 length of segment : 32 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0017466545104980469 length of segment : 85 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010690689086914062 length of segment : 37 time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 4561 time to create 1 rle with old method : 0.005394697189331055 length of segment : 229 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1489 time to create 1 rle with old method : 0.002680540084838867 length of segment : 73 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 53.20000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009484291076660156 nb_pixel_total : 107019 time to create 1 rle with old method : 0.12059783935546875 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 3200 time to create 1 rle with old method : 0.003920555114746094 length of segment : 55 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006508827209472656 length of segment : 29 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 4012 time to create 1 rle with old method : 0.0049724578857421875 length of segment : 109 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0014634132385253906 length of segment : 64 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.00047707557678222656 length of segment : 18 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 2140 time to create 1 rle with old method : 0.0028533935546875 length of segment : 57 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007266998291015625 length of segment : 44 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0004482269287109375 length of segment : 20 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007936954498291016 length of segment : 34 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 918 time to create 1 rle with old method : 0.0012066364288330078 length of segment : 29 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005340576171875 length of segment : 23 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009534358978271484 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.70156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.00040149688720703125 length of segment : 43 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002758502960205078 length of segment : 17 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0007696151733398438 length of segment : 26 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007042884826660156 length of segment : 25 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003402233123779297 length of segment : 16 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0004582405090332031 length of segment : 20 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.00015783309936523438 length of segment : 8 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00030159950256347656 length of segment : 11 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002224445343017578 length of segment : 11 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002872943878173828 length of segment : 23 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002295970916748047 length of segment : 17 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002903938293457031 length of segment : 35 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.00054931640625 length of segment : 24 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00025391578674316406 length of segment : 28 length of segment : 0 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002987384796142578 length of segment : 27 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.76250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.20000 max: 148.50625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001666545867919922 length of segment : 18 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.00013136863708496094 length of segment : 26 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 828 time to create 1 rle with old method : 0.0011110305786132812 length of segment : 32 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0005426406860351562 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 1 time to create 1 rle with old method : 1.9311904907226562e-05 length of segment : 1 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 18 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 25 time to create 1 rle with old method : 7.748603820800781e-05 length of segment : 7 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 46 time to create 1 rle with old method : 8.463859558105469e-05 length of segment : 16 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009968280792236328 length of segment : 35 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.0010461807250976562 length of segment : 27 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 2 time to create 1 rle with old method : 2.384185791015625e-05 length of segment : 1 time for calcul the mask position with numpy : 2.5272369384765625e-05 nb_pixel_total : 6 time to create 1 rle with old method : 7.581710815429688e-05 length of segment : 3 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00013327598571777344 length of segment : 30 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 18 time to create 1 rle with old method : 5.602836608886719e-05 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.68047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 length of segment : 0 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 40 time to create 1 rle with old method : 0.00010204315185546875 length of segment : 9 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 3520 time to create 1 rle with old method : 0.004407167434692383 length of segment : 65 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 3107 time to create 1 rle with old method : 0.0035741329193115234 length of segment : 86 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -104.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 15029 time to create 1 rle with old method : 0.01645636558532715 length of segment : 162 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1149 time to create 1 rle with old method : 0.0014495849609375 length of segment : 35 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 1569 time to create 1 rle with old method : 0.002038717269897461 length of segment : 73 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 2621 time to create 1 rle with old method : 0.003239154815673828 length of segment : 66 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 976 time to create 1 rle with old method : 0.0012679100036621094 length of segment : 47 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 2596 time to create 1 rle with old method : 0.003201723098754883 length of segment : 82 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.49688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0008366107940673828 length of segment : 29 time for calcul the mask position with numpy : 0.00017881393432617188 nb_pixel_total : 10267 time to create 1 rle with old method : 0.012569189071655273 length of segment : 85 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0002200603485107422 length of segment : 15 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002808570861816406 length of segment : 22 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 237.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 106.74453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0007054805755615234 length of segment : 21 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 2431 time to create 1 rle with old method : 0.0027174949645996094 length of segment : 152 time for calcul the mask position with numpy : 0.0005993843078613281 nb_pixel_total : 61556 time to create 1 rle with old method : 0.07044434547424316 length of segment : 247 time for calcul the mask position with numpy : 0.0005521774291992188 nb_pixel_total : 49345 time to create 1 rle with old method : 0.06030917167663574 length of segment : 246 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 180.00000 molded_images shape: (1, 640, 640, 3) min: -98.02891 max: 53.95000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.15703 max: 136.58281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0006320476531982422 length of segment : 21 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 2034 time to create 1 rle with old method : 0.002578258514404297 length of segment : 32 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 878 time to create 1 rle with old method : 0.0011730194091796875 length of segment : 32 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0013551712036132812 length of segment : 37 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003352165222167969 length of segment : 18 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007064342498779297 length of segment : 24 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006232261657714844 length of segment : 18 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007059574127197266 length of segment : 27 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006597042083740234 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -96.77109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004436969757080078 length of segment : 23 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0011584758758544922 length of segment : 64 time for calcul the mask position with numpy : 0.0002849102020263672 nb_pixel_total : 11006 time to create 1 rle with old method : 0.013250350952148438 length of segment : 169 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 822 time to create 1 rle with old method : 0.001331329345703125 length of segment : 34 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0009350776672363281 length of segment : 31 time for calcul the mask position with numpy : 0.00020360946655273438 nb_pixel_total : 4991 time to create 1 rle with old method : 0.006566762924194336 length of segment : 134 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 746 time to create 1 rle with old method : 0.0009884834289550781 length of segment : 39 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004818439483642578 length of segment : 18 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0007696151733398438 length of segment : 26 time for calcul the mask position with numpy : 0.0002682209014892578 nb_pixel_total : 7840 time to create 1 rle with old method : 0.009671926498413086 length of segment : 171 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005321502685546875 length of segment : 19 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006279945373535156 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.50859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1348 time to create 1 rle with old method : 0.0019221305847167969 length of segment : 44 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 1604 time to create 1 rle with old method : 0.0020666122436523438 length of segment : 116 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 717 time to create 1 rle with old method : 0.0009887218475341797 length of segment : 23 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1139 time to create 1 rle with old method : 0.0016660690307617188 length of segment : 41 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0007262229919433594 length of segment : 53 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1299 time to create 1 rle with old method : 0.001651763916015625 length of segment : 40 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0002067089080810547 length of segment : 26 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.001054525375366211 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 242.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 112.12578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0006542205810546875 length of segment : 33 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0004413127899169922 length of segment : 39 time for calcul the mask position with numpy : 0.00013113021850585938 nb_pixel_total : 719 time to create 1 rle with old method : 0.0013875961303710938 length of segment : 94 Processing 1 images image shape: (280, 400, 3) min: 5.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 47.99531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013740062713623047 nb_pixel_total : 107495 time to create 1 rle with old method : 0.16754698753356934 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.43203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 3193 time to create 1 rle with old method : 0.003922700881958008 length of segment : 55 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0007066726684570312 length of segment : 28 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 2134 time to create 1 rle with old method : 0.0027272701263427734 length of segment : 80 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.00047588348388671875 length of segment : 19 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0008041858673095703 length of segment : 39 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00042247772216796875 length of segment : 19 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 2348 time to create 1 rle with old method : 0.0028123855590820312 length of segment : 66 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005681514739990234 length of segment : 23 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 2675 time to create 1 rle with old method : 0.003370046615600586 length of segment : 48 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 1760 time to create 1 rle with old method : 0.002155303955078125 length of segment : 133 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003521442413330078 length of segment : 12 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 42 time to create 1 rle with old method : 8.916854858398438e-05 length of segment : 9 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.0009357929229736328 length of segment : 29 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00029540061950683594 length of segment : 10 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.52578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00026154518127441406 length of segment : 17 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0007038116455078125 length of segment : 25 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 925 time to create 1 rle with old method : 0.0012159347534179688 length of segment : 35 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.18594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0006539821624755859 length of segment : 61 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00018668174743652344 length of segment : 24 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003299713134765625 length of segment : 11 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002503395080566406 length of segment : 13 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00023818016052246094 length of segment : 12 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001595020294189453 length of segment : 10 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.00022101402282714844 length of segment : 25 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002732276916503906 length of segment : 22 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.31719 max: 147.35391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 34 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 18 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 785 time to create 1 rle with old method : 0.0010917186737060547 length of segment : 33 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 20 time to create 1 rle with old method : 6.961822509765625e-05 length of segment : 10 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009348392486572266 length of segment : 28 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 56 time to create 1 rle with old method : 0.00011944770812988281 length of segment : 16 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 2 time to create 1 rle with old method : 3.0994415283203125e-05 length of segment : 2 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0003287792205810547 length of segment : 21 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 2 time to create 1 rle with old method : 2.193450927734375e-05 length of segment : 1 time for calcul the mask position with numpy : 2.6226043701171875e-05 nb_pixel_total : 1 time to create 1 rle with old method : 1.5974044799804688e-05 length of segment : 1 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.64922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1410 time to create 1 rle with old method : 0.0018124580383300781 length of segment : 33 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00016117095947265625 length of segment : 24 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1805 time to create 1 rle with old method : 0.002448558807373047 length of segment : 71 time for calcul the mask position with numpy : 9.202957153320312e-05 nb_pixel_total : 3245 time to create 1 rle with old method : 0.0040624141693115234 length of segment : 76 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0010175704956054688 length of segment : 33 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 985 time to create 1 rle with old method : 0.0012965202331542969 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -98.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.0001468658447265625 nb_pixel_total : 5726 time to create 1 rle with old method : 0.007258176803588867 length of segment : 100 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 4133 time to create 1 rle with old method : 0.005049228668212891 length of segment : 125 time for calcul the mask position with numpy : 0.0004792213439941406 nb_pixel_total : 24231 time to create 1 rle with old method : 0.02798008918762207 length of segment : 320 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1892 time to create 1 rle with old method : 0.0024459362030029297 length of segment : 97 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 2850 time to create 1 rle with old method : 0.0035598278045654297 length of segment : 107 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.00469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.001359701156616211 length of segment : 26 time for calcul the mask position with numpy : 0.0002448558807373047 nb_pixel_total : 10354 time to create 1 rle with old method : 0.012131929397583008 length of segment : 85 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002658367156982422 length of segment : 26 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.00032019615173339844 length of segment : 21 time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 9202 time to create 1 rle with old method : 0.011201143264770508 length of segment : 78 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 225.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 98.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0010197162628173828 length of segment : 18 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 2755 time to create 1 rle with old method : 0.004572391510009766 length of segment : 171 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 2111 time to create 1 rle with old method : 0.0026564598083496094 length of segment : 105 time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 44749 time to create 1 rle with old method : 0.05099225044250488 length of segment : 224 time for calcul the mask position with numpy : 0.0007193088531494141 nb_pixel_total : 69918 time to create 1 rle with old method : 0.07805752754211426 length of segment : 308 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 177.00000 molded_images shape: (1, 640, 640, 3) min: -91.98203 max: 50.50859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.20781 max: 134.50469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0009398460388183594 length of segment : 22 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1961 time to create 1 rle with old method : 0.003493785858154297 length of segment : 33 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1140 time to create 1 rle with old method : 0.0020813941955566406 length of segment : 41 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 892 time to create 1 rle with old method : 0.0016417503356933594 length of segment : 32 time for calcul the mask position with numpy : 0.00015044212341308594 nb_pixel_total : 6924 time to create 1 rle with old method : 0.008256196975708008 length of segment : 111 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.0007083415985107422 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -87.59453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0004253387451171875 length of segment : 23 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 11255 time to create 1 rle with old method : 0.013161659240722656 length of segment : 174 time for calcul the mask position with numpy : 0.00013017654418945312 nb_pixel_total : 4400 time to create 1 rle with old method : 0.005348920822143555 length of segment : 155 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.00010991096496582031 length of segment : 8 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 835 time to create 1 rle with old method : 0.0011196136474609375 length of segment : 53 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0008559226989746094 length of segment : 31 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 566 time to create 1 rle with old method : 0.0008387565612792969 length of segment : 21 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00015735626220703125 length of segment : 12 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005879402160644531 length of segment : 22 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00018143653869628906 length of segment : 13 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003123283386230469 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.89141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 2168 time to create 1 rle with old method : 0.002634286880493164 length of segment : 137 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1336 time to create 1 rle with old method : 0.0016934871673583984 length of segment : 43 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0009472370147705078 length of segment : 38 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1143 time to create 1 rle with old method : 0.0016474723815917969 length of segment : 44 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0013790130615234375 length of segment : 33 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007998943328857422 length of segment : 20 time for calcul the mask position with numpy : 0.00018787384033203125 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006561279296875 length of segment : 44 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0018894672393798828 length of segment : 48 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1265 time to create 1 rle with old method : 0.0016109943389892578 length of segment : 40 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 238.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 107.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0007493495941162109 length of segment : 36 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0012962818145751953 length of segment : 54 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1382 time to create 1 rle with old method : 0.0024716854095458984 length of segment : 71 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 4232 time to create 1 rle with old method : 0.008708477020263672 length of segment : 211 time for calcul the mask position with numpy : 0.00011920928955078125 nb_pixel_total : 2087 time to create 1 rle with old method : 0.0025756359100341797 length of segment : 150 time for calcul the mask position with numpy : 0.000164031982421875 nb_pixel_total : 4025 time to create 1 rle with old method : 0.004831552505493164 length of segment : 197 Processing 1 images image shape: (280, 400, 3) min: 5.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 47.75078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009508132934570312 nb_pixel_total : 105764 time to create 1 rle with old method : 0.12366485595703125 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.51797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 3210 time to create 1 rle with old method : 0.003907442092895508 length of segment : 54 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 3581 time to create 1 rle with old method : 0.004531145095825195 length of segment : 91 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0006225109100341797 length of segment : 28 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.00046443939208984375 length of segment : 19 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1501 time to create 1 rle with old method : 0.0019609928131103516 length of segment : 31 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.0007371902465820312 length of segment : 36 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00035643577575683594 length of segment : 19 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005421638488769531 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.83437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00027561187744140625 length of segment : 21 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006716251373291016 length of segment : 25 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.00025653839111328125 length of segment : 12 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 26 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001609325408935547 length of segment : 11 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 37 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.0009922981262207031 length of segment : 35 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00010752677917480469 length of segment : 6 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 12 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004589557647705078 length of segment : 38 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003936290740966797 length of segment : 22 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002601146697998047 length of segment : 14 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00028896331787109375 length of segment : 15 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002655982971191406 length of segment : 25 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.54766 max: 147.90469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 17 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003814697265625 length of segment : 40 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 782 time to create 1 rle with old method : 0.0010347366333007812 length of segment : 44 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 36 time to create 1 rle with old method : 9.870529174804688e-05 length of segment : 11 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 14627 time to create 1 rle with old method : 0.017780780792236328 length of segment : 136 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 16 time to create 1 rle with old method : 8.678436279296875e-05 length of segment : 3 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.001018524169921875 length of segment : 37 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 38 time to create 1 rle with old method : 8.463859558105469e-05 length of segment : 17 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 12 time to create 1 rle with old method : 8.58306884765625e-05 length of segment : 4 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001742839813232422 length of segment : 36 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006957054138183594 length of segment : 39 time for calcul the mask position with numpy : 0.00044608116149902344 nb_pixel_total : 16621 time to create 1 rle with old method : 0.018960952758789062 length of segment : 124 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.93047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 41 time to create 1 rle with old method : 7.939338684082031e-05 length of segment : 7 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 3201 time to create 1 rle with old method : 0.003898143768310547 length of segment : 63 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 3980 time to create 1 rle with old method : 0.00504302978515625 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -90.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 18239 time to create 1 rle with old method : 0.021895170211791992 length of segment : 147 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.000812530517578125 length of segment : 25 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1792 time to create 1 rle with old method : 0.002257823944091797 length of segment : 95 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1615 time to create 1 rle with old method : 0.0021615028381347656 length of segment : 32 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 2701 time to create 1 rle with old method : 0.0033893585205078125 length of segment : 91 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1590 time to create 1 rle with old method : 0.001972198486328125 length of segment : 34 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1722 time to create 1 rle with old method : 0.002221345901489258 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.14531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006866455078125 length of segment : 26 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 23 time for calcul the mask position with numpy : 0.00017213821411132812 nb_pixel_total : 10199 time to create 1 rle with old method : 0.011481523513793945 length of segment : 84 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 3065 time to create 1 rle with old method : 0.00561070442199707 length of segment : 68 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 242.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 105.48672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0007405281066894531 length of segment : 18 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 2609 time to create 1 rle with old method : 0.003133058547973633 length of segment : 151 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1986 time to create 1 rle with old method : 0.0023953914642333984 length of segment : 66 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1926 time to create 1 rle with old method : 0.002305746078491211 length of segment : 61 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 177.00000 molded_images shape: (1, 640, 640, 3) min: -92.06797 max: 47.25859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -99.53672 max: 136.94766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2017 time to create 1 rle with old method : 0.002460002899169922 length of segment : 31 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006577968597412109 length of segment : 21 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 839 time to create 1 rle with old method : 0.001088857650756836 length of segment : 32 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005257129669189453 length of segment : 15 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004291534423828125 length of segment : 30 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 1047 time to create 1 rle with old method : 0.0013072490692138672 length of segment : 39 time for calcul the mask position with numpy : 0.00023674964904785156 nb_pixel_total : 4719 time to create 1 rle with old method : 0.00943899154663086 length of segment : 132 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -83.58281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 22 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.001001596450805664 length of segment : 33 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0009360313415527344 length of segment : 31 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 4664 time to create 1 rle with old method : 0.005639791488647461 length of segment : 138 time for calcul the mask position with numpy : 0.00022912025451660156 nb_pixel_total : 13509 time to create 1 rle with old method : 0.01544642448425293 length of segment : 191 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0008056163787841797 length of segment : 28 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00030875205993652344 length of segment : 28 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.001237630844116211 length of segment : 40 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 922 time to create 1 rle with old method : 0.0011281967163085938 length of segment : 50 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.0007736682891845703 length of segment : 35 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0015339851379394531 length of segment : 39 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.000576019287109375 length of segment : 23 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003135204315185547 length of segment : 20 time for calcul the mask position with numpy : 0.0002224445343017578 nb_pixel_total : 15006 time to create 1 rle with old method : 0.016567230224609375 length of segment : 206 time for calcul the mask position with numpy : 0.00011849403381347656 nb_pixel_total : 5957 time to create 1 rle with old method : 0.006440401077270508 length of segment : 135 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006890296936035156 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.75469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 2047 time to create 1 rle with old method : 0.0025522708892822266 length of segment : 132 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1371 time to create 1 rle with old method : 0.0016021728515625 length of segment : 43 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007684230804443359 length of segment : 79 time for calcul the mask position with numpy : 0.0003485679626464844 nb_pixel_total : 15477 time to create 1 rle with old method : 0.017421245574951172 length of segment : 466 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1232 time to create 1 rle with old method : 0.0014777183532714844 length of segment : 38 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1207 time to create 1 rle with old method : 0.0015881061553955078 length of segment : 44 time for calcul the mask position with numpy : 0.0002872943878173828 nb_pixel_total : 8746 time to create 1 rle with old method : 0.010128974914550781 length of segment : 245 time for calcul the mask position with numpy : 0.0002841949462890625 nb_pixel_total : 7753 time to create 1 rle with old method : 0.008725166320800781 length of segment : 283 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 230.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 98.73672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.00048089027404785156 length of segment : 34 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1406 time to create 1 rle with old method : 0.0018105506896972656 length of segment : 70 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.00047588348388671875 length of segment : 32 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 1544 time to create 1 rle with old method : 0.0020859241485595703 length of segment : 142 time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 4559 time to create 1 rle with old method : 0.005316734313964844 length of segment : 225 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 932 time to create 1 rle with old method : 0.0012161731719970703 length of segment : 118 Processing 1 images image shape: (280, 400, 3) min: 7.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 49.10859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008649826049804688 nb_pixel_total : 106475 time to create 1 rle with old method : 0.12204647064208984 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.99062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 3165 time to create 1 rle with old method : 0.003876924514770508 length of segment : 54 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006210803985595703 length of segment : 28 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004241466522216797 length of segment : 20 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 4357 time to create 1 rle with old method : 0.005245208740234375 length of segment : 94 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0008122920989990234 length of segment : 36 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004985332489013672 length of segment : 22 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004448890686035156 length of segment : 20 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003764629364013672 length of segment : 19 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 436 time to create 1 rle with old method : 0.0006222724914550781 length of segment : 24 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002872943878173828 length of segment : 18 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00030350685119628906 length of segment : 24 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006818771362304688 length of segment : 24 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.00040531158447265625 length of segment : 36 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00030350685119628906 length of segment : 21 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002689361572265625 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.0017750263214111328 length of segment : 88 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0006444454193115234 length of segment : 21 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0004298686981201172 length of segment : 20 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0007631778717041016 length of segment : 28 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0005819797515869141 length of segment : 34 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 36090 time to create 1 rle with old method : 0.04120206832885742 length of segment : 212 Detection mask done ! Trying to reset tf kernel 224345 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 tf kernel not reseted sub process len(results) : 439 len(list_Values) 439 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 439 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10774 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 439 chid ids of type : 4228 Number RLEs to save : 25036 save missing photos in datou_result : time spend for datou_step_exec : 30.319028854370117 time spend to save output : 1.6641268730163574 total time spend for step 1 : 31.983155727386475 step2:brightness Mon Feb 10 23:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739226028_223917_1336563185_6d8f924abab7d668cd8bf9414e37bcb6.jpg treat image : temp/1739226028_223917_1336563147_76c6eea736f56aded97057c5b0ba449e.jpg treat image : temp/1739226028_223917_1336563145_2afbc496eac53bf7f469c5732c9a54f0.jpg treat image : temp/1739226028_223917_1336563141_ecaecaad011f72d9bebe8c65adc2c27c.jpg treat image : temp/1739226028_223917_1336563138_bccf755ca00beaabffa934d16f5c04b5.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.011531352996826172 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.011205196380615234 save missing photos in datou_result : time spend for datou_step_exec : 1.1727659702301025 time spend to save output : 0.02733135223388672 total time spend for step 2 : 1.2000973224639893 step3:blur_detection Mon Feb 10 23:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739226028_223917_1336563185_6d8f924abab7d668cd8bf9414e37bcb6.jpg resize: (1080, 1920) 1336563185 -7.269224027403639 treat image : temp/1739226028_223917_1336563147_76c6eea736f56aded97057c5b0ba449e.jpg resize: (1080, 1920) 1336563147 -7.298242748840134 treat image : temp/1739226028_223917_1336563145_2afbc496eac53bf7f469c5732c9a54f0.jpg resize: (1080, 1920) 1336563145 -7.284518525982637 treat image : temp/1739226028_223917_1336563141_ecaecaad011f72d9bebe8c65adc2c27c.jpg resize: (1080, 1920) 1336563141 -7.217178822409085 treat image : temp/1739226028_223917_1336563138_bccf755ca00beaabffa934d16f5c04b5.jpg resize: (1080, 1920) 1336563138 -7.160021230007483 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.012160062789916992 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.01392221450805664 save missing photos in datou_result : time spend for datou_step_exec : 3.9571728706359863 time spend to save output : 0.031022310256958008 total time spend for step 3 : 3.9881951808929443 step4:rle_unique_nms_with_priority Mon Feb 10 23:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 439 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 85 nb_hashtags : 6 time to prepare the origin masks : 0.9910662174224854 time for calcul the mask position with numpy : 0.025516748428344727 nb_pixel_total : 1799058 time to create 1 rle with new method : 0.04241299629211426 time for calcul the mask position with numpy : 0.007879495620727539 nb_pixel_total : 6178 time to create 1 rle with old method : 0.00646662712097168 time for calcul the mask position with numpy : 0.007776737213134766 nb_pixel_total : 2240 time to create 1 rle with old method : 0.0023822784423828125 time for calcul the mask position with numpy : 0.007658958435058594 nb_pixel_total : 196 time to create 1 rle with old method : 0.00021123886108398438 time for calcul the mask position with numpy : 0.007954120635986328 nb_pixel_total : 64603 time to create 1 rle with old method : 0.0670480728149414 time for calcul the mask position with numpy : 0.008048057556152344 nb_pixel_total : 53 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.007991552352905273 nb_pixel_total : 274 time to create 1 rle with old method : 0.00029349327087402344 time for calcul the mask position with numpy : 0.007582664489746094 nb_pixel_total : 277 time to create 1 rle with old method : 0.00031948089599609375 time for calcul the mask position with numpy : 0.007985591888427734 nb_pixel_total : 37 time to create 1 rle with old method : 5.507469177246094e-05 time for calcul the mask position with numpy : 0.007817268371582031 nb_pixel_total : 228 time to create 1 rle with old method : 0.0002536773681640625 time for calcul the mask position with numpy : 0.007716655731201172 nb_pixel_total : 800 time to create 1 rle with old method : 0.0008666515350341797 time for calcul the mask position with numpy : 0.007573843002319336 nb_pixel_total : 534 time to create 1 rle with old method : 0.0005736351013183594 time for calcul the mask position with numpy : 0.007517814636230469 nb_pixel_total : 494 time to create 1 rle with old method : 0.0005300045013427734 time for calcul the mask position with numpy : 0.007749319076538086 nb_pixel_total : 1859 time to create 1 rle with old method : 0.0020294189453125 time for calcul the mask position with numpy : 0.007745265960693359 nb_pixel_total : 2 time to create 1 rle with old method : 8.344650268554688e-06 time for calcul the mask position with numpy : 0.007902860641479492 nb_pixel_total : 1 time to create 1 rle with old method : 6.4373016357421875e-06 time for calcul the mask position with numpy : 0.007604122161865234 nb_pixel_total : 207 time to create 1 rle with old method : 0.00023508071899414062 time for calcul the mask position with numpy : 0.00776219367980957 nb_pixel_total : 198 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.007904291152954102 nb_pixel_total : 1020 time to create 1 rle with old method : 0.0011935234069824219 time for calcul the mask position with numpy : 0.008074283599853516 nb_pixel_total : 4324 time to create 1 rle with old method : 0.004738569259643555 time for calcul the mask position with numpy : 0.007881879806518555 nb_pixel_total : 577 time to create 1 rle with old method : 0.0006339550018310547 time for calcul the mask position with numpy : 0.0077342987060546875 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006012916564941406 time for calcul the mask position with numpy : 0.007812738418579102 nb_pixel_total : 2616 time to create 1 rle with old method : 0.0029282569885253906 time for calcul the mask position with numpy : 0.007776975631713867 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005891323089599609 time for calcul the mask position with numpy : 0.00781869888305664 nb_pixel_total : 190 time to create 1 rle with old method : 0.00020885467529296875 time for calcul the mask position with numpy : 0.007615566253662109 nb_pixel_total : 8762 time to create 1 rle with old method : 0.009025812149047852 time for calcul the mask position with numpy : 0.007809877395629883 nb_pixel_total : 1842 time to create 1 rle with old method : 0.0020868778228759766 time for calcul the mask position with numpy : 0.007756233215332031 nb_pixel_total : 2113 time to create 1 rle with old method : 0.0022072792053222656 time for calcul the mask position with numpy : 0.0075855255126953125 nb_pixel_total : 2666 time to create 1 rle with old method : 0.0028367042541503906 time for calcul the mask position with numpy : 0.0077381134033203125 nb_pixel_total : 1108 time to create 1 rle with old method : 0.0012466907501220703 time for calcul the mask position with numpy : 0.007598400115966797 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005643367767333984 time for calcul the mask position with numpy : 0.007670164108276367 nb_pixel_total : 4102 time to create 1 rle with old method : 0.004852294921875 time for calcul the mask position with numpy : 0.007782459259033203 nb_pixel_total : 8098 time to create 1 rle with old method : 0.008788824081420898 time for calcul the mask position with numpy : 0.007874727249145508 nb_pixel_total : 977 time to create 1 rle with old method : 0.0011398792266845703 time for calcul the mask position with numpy : 0.008028745651245117 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0012493133544921875 time for calcul the mask position with numpy : 0.008137226104736328 nb_pixel_total : 716 time to create 1 rle with old method : 0.0009174346923828125 time for calcul the mask position with numpy : 0.008297204971313477 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010209083557128906 time for calcul the mask position with numpy : 0.008049488067626953 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001437664031982422 time for calcul the mask position with numpy : 0.008009672164916992 nb_pixel_total : 1312 time to create 1 rle with old method : 0.0014300346374511719 time for calcul the mask position with numpy : 0.007970809936523438 nb_pixel_total : 214 time to create 1 rle with old method : 0.00024962425231933594 time for calcul the mask position with numpy : 0.008098363876342773 nb_pixel_total : 815 time to create 1 rle with old method : 0.0008900165557861328 time for calcul the mask position with numpy : 0.008051395416259766 nb_pixel_total : 744 time to create 1 rle with old method : 0.0008931159973144531 time for calcul the mask position with numpy : 0.007952213287353516 nb_pixel_total : 6 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.0076961517333984375 nb_pixel_total : 326 time to create 1 rle with old method : 0.0003604888916015625 time for calcul the mask position with numpy : 0.007591962814331055 nb_pixel_total : 676 time to create 1 rle with old method : 0.0007550716400146484 time for calcul the mask position with numpy : 0.007470846176147461 nb_pixel_total : 4085 time to create 1 rle with old method : 0.004197120666503906 time for calcul the mask position with numpy : 0.007536411285400391 nb_pixel_total : 2202 time to create 1 rle with old method : 0.0022864341735839844 time for calcul the mask position with numpy : 0.00786447525024414 nb_pixel_total : 737 time to create 1 rle with old method : 0.0008058547973632812 time for calcul the mask position with numpy : 0.00772547721862793 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0011506080627441406 time for calcul the mask position with numpy : 0.007742404937744141 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004189014434814453 time for calcul the mask position with numpy : 0.007581233978271484 nb_pixel_total : 107 time to create 1 rle with old method : 0.00015544891357421875 time for calcul the mask position with numpy : 0.0075762271881103516 nb_pixel_total : 583 time to create 1 rle with old method : 0.0006616115570068359 time for calcul the mask position with numpy : 0.007611513137817383 nb_pixel_total : 150 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.007636070251464844 nb_pixel_total : 847 time to create 1 rle with old method : 0.001001119613647461 time for calcul the mask position with numpy : 0.007536411285400391 nb_pixel_total : 17259 time to create 1 rle with old method : 0.01843094825744629 time for calcul the mask position with numpy : 0.0076863765716552734 nb_pixel_total : 670 time to create 1 rle with old method : 0.0007240772247314453 time for calcul the mask position with numpy : 0.0077931880950927734 nb_pixel_total : 73 time to create 1 rle with old method : 9.012222290039062e-05 time for calcul the mask position with numpy : 0.007578849792480469 nb_pixel_total : 1234 time to create 1 rle with old method : 0.001340627670288086 time for calcul the mask position with numpy : 0.0075147151947021484 nb_pixel_total : 2297 time to create 1 rle with old method : 0.0024814605712890625 time for calcul the mask position with numpy : 0.007868289947509766 nb_pixel_total : 20 time to create 1 rle with old method : 3.719329833984375e-05 time for calcul the mask position with numpy : 0.007966995239257812 nb_pixel_total : 334 time to create 1 rle with old method : 0.00036025047302246094 time for calcul the mask position with numpy : 0.00782322883605957 nb_pixel_total : 1267 time to create 1 rle with old method : 0.001344919204711914 time for calcul the mask position with numpy : 0.007921934127807617 nb_pixel_total : 306 time to create 1 rle with old method : 0.00033020973205566406 time for calcul the mask position with numpy : 0.007844924926757812 nb_pixel_total : 432 time to create 1 rle with old method : 0.00047588348388671875 time for calcul the mask position with numpy : 0.007611751556396484 nb_pixel_total : 70 time to create 1 rle with old method : 9.322166442871094e-05 time for calcul the mask position with numpy : 0.007853031158447266 nb_pixel_total : 2039 time to create 1 rle with old method : 0.002182483673095703 time for calcul the mask position with numpy : 0.007574319839477539 nb_pixel_total : 93 time to create 1 rle with old method : 0.00010609626770019531 time for calcul the mask position with numpy : 0.0077667236328125 nb_pixel_total : 432 time to create 1 rle with old method : 0.00047397613525390625 time for calcul the mask position with numpy : 0.008090496063232422 nb_pixel_total : 106125 time to create 1 rle with old method : 0.11067605018615723 time for calcul the mask position with numpy : 0.008193016052246094 nb_pixel_total : 3196 time to create 1 rle with old method : 0.0037555694580078125 time for calcul the mask position with numpy : 0.008342504501342773 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005664825439453125 time for calcul the mask position with numpy : 0.008218050003051758 nb_pixel_total : 73 time to create 1 rle with old method : 0.00010848045349121094 time for calcul the mask position with numpy : 0.00825357437133789 nb_pixel_total : 256 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.009735584259033203 nb_pixel_total : 454 time to create 1 rle with old method : 0.0009188652038574219 time for calcul the mask position with numpy : 0.013150215148925781 nb_pixel_total : 605 time to create 1 rle with old method : 0.0006992816925048828 time for calcul the mask position with numpy : 0.00798797607421875 nb_pixel_total : 78 time to create 1 rle with old method : 9.632110595703125e-05 time for calcul the mask position with numpy : 0.007984161376953125 nb_pixel_total : 249 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.008026599884033203 nb_pixel_total : 59 time to create 1 rle with old method : 7.62939453125e-05 time for calcul the mask position with numpy : 0.008114337921142578 nb_pixel_total : 6 time to create 1 rle with old method : 1.5497207641601562e-05 time for calcul the mask position with numpy : 0.008228302001953125 nb_pixel_total : 36 time to create 1 rle with old method : 5.459785461425781e-05 time for calcul the mask position with numpy : 0.008039236068725586 nb_pixel_total : 394 time to create 1 rle with old method : 0.0004878044128417969 time for calcul the mask position with numpy : 0.007921695709228516 nb_pixel_total : 324 time to create 1 rle with old method : 0.0003578662872314453 time for calcul the mask position with numpy : 0.007976770401000977 nb_pixel_total : 150 time to create 1 rle with old method : 0.00019407272338867188 time for calcul the mask position with numpy : 0.007971525192260742 nb_pixel_total : 177 time to create 1 rle with old method : 0.00023889541625976562 time for calcul the mask position with numpy : 0.008007049560546875 nb_pixel_total : 174 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.008034229278564453 nb_pixel_total : 293 time to create 1 rle with old method : 0.0003147125244140625 create new chi : 1.0393426418304443 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.005481243133544922 batch 1 Loaded 86 chid ids of type : 4230 Number RLEs to save : 9754 TO DO : save crop sub photo not yet done ! save time : 1.2135632038116455 nb_obj : 88 nb_hashtags : 7 time to prepare the origin masks : 1.8214764595031738 time for calcul the mask position with numpy : 0.021625995635986328 nb_pixel_total : 1782541 time to create 1 rle with new method : 0.043503761291503906 time for calcul the mask position with numpy : 0.005987882614135742 nb_pixel_total : 10344 time to create 1 rle with old method : 0.01062917709350586 time for calcul the mask position with numpy : 0.005517005920410156 nb_pixel_total : 2216 time to create 1 rle with old method : 0.0023183822631835938 time for calcul the mask position with numpy : 0.005871295928955078 nb_pixel_total : 70707 time to create 1 rle with old method : 0.07437515258789062 time for calcul the mask position with numpy : 0.005620002746582031 nb_pixel_total : 46 time to create 1 rle with old method : 8.273124694824219e-05 time for calcul the mask position with numpy : 0.006119489669799805 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003008842468261719 time for calcul the mask position with numpy : 0.005718708038330078 nb_pixel_total : 5 time to create 1 rle with old method : 4.00543212890625e-05 time for calcul the mask position with numpy : 0.005662679672241211 nb_pixel_total : 61 time to create 1 rle with old method : 0.00015473365783691406 time for calcul the mask position with numpy : 0.005674600601196289 nb_pixel_total : 745 time to create 1 rle with old method : 0.0008645057678222656 time for calcul the mask position with numpy : 0.005772590637207031 nb_pixel_total : 55 time to create 1 rle with old method : 9.322166442871094e-05 time for calcul the mask position with numpy : 0.005623817443847656 nb_pixel_total : 78 time to create 1 rle with old method : 0.00012946128845214844 time for calcul the mask position with numpy : 0.005660295486450195 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002219676971435547 time for calcul the mask position with numpy : 0.005524873733520508 nb_pixel_total : 20 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.00549626350402832 nb_pixel_total : 2320 time to create 1 rle with old method : 0.0026018619537353516 time for calcul the mask position with numpy : 0.00547480583190918 nb_pixel_total : 5 time to create 1 rle with old method : 2.574920654296875e-05 time for calcul the mask position with numpy : 0.005687236785888672 nb_pixel_total : 11 time to create 1 rle with old method : 3.0040740966796875e-05 time for calcul the mask position with numpy : 0.0056345462799072266 nb_pixel_total : 353 time to create 1 rle with old method : 0.00042176246643066406 time for calcul the mask position with numpy : 0.0057561397552490234 nb_pixel_total : 226 time to create 1 rle with old method : 0.00028443336486816406 time for calcul the mask position with numpy : 0.005753517150878906 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.005807161331176758 nb_pixel_total : 349 time to create 1 rle with old method : 0.00038814544677734375 time for calcul the mask position with numpy : 0.007086038589477539 nb_pixel_total : 10642 time to create 1 rle with old method : 0.012059211730957031 time for calcul the mask position with numpy : 0.005720376968383789 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.005722999572753906 nb_pixel_total : 2303 time to create 1 rle with old method : 0.002505064010620117 time for calcul the mask position with numpy : 0.005808115005493164 nb_pixel_total : 3324 time to create 1 rle with old method : 0.003976583480834961 time for calcul the mask position with numpy : 0.0058155059814453125 nb_pixel_total : 493 time to create 1 rle with old method : 0.0005655288696289062 time for calcul the mask position with numpy : 0.005774974822998047 nb_pixel_total : 6351 time to create 1 rle with old method : 0.007258892059326172 time for calcul the mask position with numpy : 0.005785942077636719 nb_pixel_total : 4269 time to create 1 rle with old method : 0.00489354133605957 time for calcul the mask position with numpy : 0.005554914474487305 nb_pixel_total : 3821 time to create 1 rle with old method : 0.004153728485107422 time for calcul the mask position with numpy : 0.005514383316040039 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0014505386352539062 time for calcul the mask position with numpy : 0.005799531936645508 nb_pixel_total : 12323 time to create 1 rle with old method : 0.01381373405456543 time for calcul the mask position with numpy : 0.006148099899291992 nb_pixel_total : 68 time to create 1 rle with old method : 0.00010156631469726562 time for calcul the mask position with numpy : 0.005883455276489258 nb_pixel_total : 751 time to create 1 rle with old method : 0.0009453296661376953 time for calcul the mask position with numpy : 0.005782604217529297 nb_pixel_total : 395 time to create 1 rle with old method : 0.0004730224609375 time for calcul the mask position with numpy : 0.005841970443725586 nb_pixel_total : 1301 time to create 1 rle with old method : 0.001489877700805664 time for calcul the mask position with numpy : 0.005800008773803711 nb_pixel_total : 106 time to create 1 rle with old method : 0.00018143653869628906 time for calcul the mask position with numpy : 0.005802631378173828 nb_pixel_total : 847 time to create 1 rle with old method : 0.0010526180267333984 time for calcul the mask position with numpy : 0.005881071090698242 nb_pixel_total : 7 time to create 1 rle with old method : 4.553794860839844e-05 time for calcul the mask position with numpy : 0.009367704391479492 nb_pixel_total : 831 time to create 1 rle with old method : 0.0009303092956542969 time for calcul the mask position with numpy : 0.009324789047241211 nb_pixel_total : 4561 time to create 1 rle with old method : 0.005170345306396484 time for calcul the mask position with numpy : 0.009215354919433594 nb_pixel_total : 586 time to create 1 rle with old method : 0.00072479248046875 time for calcul the mask position with numpy : 0.009386301040649414 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0015230178833007812 time for calcul the mask position with numpy : 0.0095672607421875 nb_pixel_total : 2059 time to create 1 rle with old method : 0.002246856689453125 time for calcul the mask position with numpy : 0.009546041488647461 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0011949539184570312 time for calcul the mask position with numpy : 0.009472370147705078 nb_pixel_total : 57 time to create 1 rle with old method : 0.0001327991485595703 time for calcul the mask position with numpy : 0.009589433670043945 nb_pixel_total : 238 time to create 1 rle with old method : 0.00034689903259277344 time for calcul the mask position with numpy : 0.009300947189331055 nb_pixel_total : 657 time to create 1 rle with old method : 0.0007598400115966797 time for calcul the mask position with numpy : 0.009086370468139648 nb_pixel_total : 10832 time to create 1 rle with old method : 0.011607646942138672 time for calcul the mask position with numpy : 0.009257078170776367 nb_pixel_total : 1329 time to create 1 rle with old method : 0.0015099048614501953 time for calcul the mask position with numpy : 0.009241580963134766 nb_pixel_total : 351 time to create 1 rle with old method : 0.00042700767517089844 time for calcul the mask position with numpy : 0.009651422500610352 nb_pixel_total : 256 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.009681224822998047 nb_pixel_total : 395 time to create 1 rle with old method : 0.00048351287841796875 time for calcul the mask position with numpy : 0.009138107299804688 nb_pixel_total : 1489 time to create 1 rle with old method : 0.0015583038330078125 time for calcul the mask position with numpy : 0.005701303482055664 nb_pixel_total : 310 time to create 1 rle with old method : 0.00038814544677734375 time for calcul the mask position with numpy : 0.00588536262512207 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005950927734375 time for calcul the mask position with numpy : 0.0058727264404296875 nb_pixel_total : 91 time to create 1 rle with old method : 0.00011730194091796875 time for calcul the mask position with numpy : 0.005818367004394531 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006189346313476562 time for calcul the mask position with numpy : 0.00585484504699707 nb_pixel_total : 264 time to create 1 rle with old method : 0.00030732154846191406 time for calcul the mask position with numpy : 0.005806446075439453 nb_pixel_total : 13 time to create 1 rle with old method : 3.147125244140625e-05 time for calcul the mask position with numpy : 0.005777597427368164 nb_pixel_total : 101 time to create 1 rle with old method : 0.00012111663818359375 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 1965 time to create 1 rle with old method : 0.002161741256713867 time for calcul the mask position with numpy : 0.005925893783569336 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005757808685302734 time for calcul the mask position with numpy : 0.006177663803100586 nb_pixel_total : 107019 time to create 1 rle with old method : 0.1116800308227539 time for calcul the mask position with numpy : 0.00574040412902832 nb_pixel_total : 3200 time to create 1 rle with old method : 0.003280162811279297 time for calcul the mask position with numpy : 0.005547285079956055 nb_pixel_total : 533 time to create 1 rle with old method : 0.0005645751953125 time for calcul the mask position with numpy : 0.005457162857055664 nb_pixel_total : 1 time to create 1 rle with old method : 2.3365020751953125e-05 time for calcul the mask position with numpy : 0.005457878112792969 nb_pixel_total : 302 time to create 1 rle with old method : 0.0003552436828613281 time for calcul the mask position with numpy : 0.005446672439575195 nb_pixel_total : 594 time to create 1 rle with old method : 0.000640869140625 time for calcul the mask position with numpy : 0.005928516387939453 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005209445953369141 time for calcul the mask position with numpy : 0.005881547927856445 nb_pixel_total : 482 time to create 1 rle with old method : 0.000579833984375 time for calcul the mask position with numpy : 0.005781412124633789 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0012400150299072266 time for calcul the mask position with numpy : 0.00586700439453125 nb_pixel_total : 219 time to create 1 rle with old method : 0.00024175643920898438 time for calcul the mask position with numpy : 0.005759000778198242 nb_pixel_total : 2140 time to create 1 rle with old method : 0.002519845962524414 time for calcul the mask position with numpy : 0.0058786869049072266 nb_pixel_total : 4012 time to create 1 rle with old method : 0.004541158676147461 time for calcul the mask position with numpy : 0.005808830261230469 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006251335144042969 time for calcul the mask position with numpy : 0.005836009979248047 nb_pixel_total : 171 time to create 1 rle with old method : 0.00021338462829589844 time for calcul the mask position with numpy : 0.005538463592529297 nb_pixel_total : 76 time to create 1 rle with old method : 0.00010752677917480469 time for calcul the mask position with numpy : 0.00556182861328125 nb_pixel_total : 204 time to create 1 rle with old method : 0.00026607513427734375 time for calcul the mask position with numpy : 0.0055239200592041016 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003333091735839844 time for calcul the mask position with numpy : 0.005491733551025391 nb_pixel_total : 19 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.006036996841430664 nb_pixel_total : 163 time to create 1 rle with old method : 0.00020074844360351562 time for calcul the mask position with numpy : 0.008635282516479492 nb_pixel_total : 400 time to create 1 rle with old method : 0.00044918060302734375 time for calcul the mask position with numpy : 0.005731821060180664 nb_pixel_total : 92 time to create 1 rle with old method : 0.00015211105346679688 time for calcul the mask position with numpy : 0.005691051483154297 nb_pixel_total : 134 time to create 1 rle with old method : 0.0001590251922607422 time for calcul the mask position with numpy : 0.0059964656829833984 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003108978271484375 time for calcul the mask position with numpy : 0.006659030914306641 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002315044403076172 time for calcul the mask position with numpy : 0.008317232131958008 nb_pixel_total : 149 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.008143186569213867 nb_pixel_total : 918 time to create 1 rle with old method : 0.0009946823120117188 time for calcul the mask position with numpy : 0.009607315063476562 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002620220184326172 time for calcul the mask position with numpy : 0.007991313934326172 nb_pixel_total : 335 time to create 1 rle with old method : 0.00039958953857421875 create new chi : 0.9618785381317139 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013523101806640625 batch 1 Loaded 89 chid ids of type : 4230 Number RLEs to save : 9967 TO DO : save crop sub photo not yet done ! save time : 0.874537467956543 nb_obj : 89 nb_hashtags : 7 time to prepare the origin masks : 1.3400709629058838 time for calcul the mask position with numpy : 0.022168636322021484 nb_pixel_total : 1807955 time to create 1 rle with new method : 0.0414884090423584 time for calcul the mask position with numpy : 0.0062236785888671875 nb_pixel_total : 15029 time to create 1 rle with old method : 0.016576290130615234 time for calcul the mask position with numpy : 0.0064084529876708984 nb_pixel_total : 2431 time to create 1 rle with old method : 0.004089832305908203 time for calcul the mask position with numpy : 0.0062677860260009766 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002772808074951172 time for calcul the mask position with numpy : 0.0059244632720947266 nb_pixel_total : 39 time to create 1 rle with old method : 9.369850158691406e-05 time for calcul the mask position with numpy : 0.0060269832611083984 nb_pixel_total : 67 time to create 1 rle with old method : 0.00010323524475097656 time for calcul the mask position with numpy : 0.0058481693267822266 nb_pixel_total : 828 time to create 1 rle with old method : 0.0009660720825195312 time for calcul the mask position with numpy : 0.005831480026245117 nb_pixel_total : 18 time to create 1 rle with old method : 4.482269287109375e-05 time for calcul the mask position with numpy : 0.005707502365112305 nb_pixel_total : 894 time to create 1 rle with old method : 0.0010509490966796875 time for calcul the mask position with numpy : 0.005922555923461914 nb_pixel_total : 25 time to create 1 rle with old method : 5.6743621826171875e-05 time for calcul the mask position with numpy : 0.0057604312896728516 nb_pixel_total : 101 time to create 1 rle with old method : 0.00012683868408203125 time for calcul the mask position with numpy : 0.00583338737487793 nb_pixel_total : 69 time to create 1 rle with old method : 0.00010228157043457031 time for calcul the mask position with numpy : 0.00597381591796875 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003330707550048828 time for calcul the mask position with numpy : 0.00580596923828125 nb_pixel_total : 3520 time to create 1 rle with old method : 0.004015922546386719 time for calcul the mask position with numpy : 0.006376504898071289 nb_pixel_total : 61556 time to create 1 rle with old method : 0.06769490242004395 time for calcul the mask position with numpy : 0.0061228275299072266 nb_pixel_total : 19 time to create 1 rle with old method : 6.246566772460938e-05 time for calcul the mask position with numpy : 0.0059587955474853516 nb_pixel_total : 14 time to create 1 rle with old method : 4.124641418457031e-05 time for calcul the mask position with numpy : 0.00620579719543457 nb_pixel_total : 158 time to create 1 rle with old method : 0.00027751922607421875 time for calcul the mask position with numpy : 0.00601506233215332 nb_pixel_total : 2 time to create 1 rle with old method : 2.002716064453125e-05 time for calcul the mask position with numpy : 0.006102561950683594 nb_pixel_total : 40 time to create 1 rle with old method : 6.604194641113281e-05 time for calcul the mask position with numpy : 0.005892753601074219 nb_pixel_total : 1 time to create 1 rle with old method : 1.811981201171875e-05 time for calcul the mask position with numpy : 0.006044864654541016 nb_pixel_total : 6 time to create 1 rle with old method : 3.504753112792969e-05 time for calcul the mask position with numpy : 0.006169557571411133 nb_pixel_total : 976 time to create 1 rle with old method : 0.0011832714080810547 time for calcul the mask position with numpy : 0.0060770511627197266 nb_pixel_total : 113 time to create 1 rle with old method : 0.00015616416931152344 time for calcul the mask position with numpy : 0.006071567535400391 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002243518829345703 time for calcul the mask position with numpy : 0.006073474884033203 nb_pixel_total : 2621 time to create 1 rle with old method : 0.0030469894409179688 time for calcul the mask position with numpy : 0.006682395935058594 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006155967712402344 time for calcul the mask position with numpy : 0.006211519241333008 nb_pixel_total : 1100 time to create 1 rle with old method : 0.001401662826538086 time for calcul the mask position with numpy : 0.006342649459838867 nb_pixel_total : 1569 time to create 1 rle with old method : 0.0019347667694091797 time for calcul the mask position with numpy : 0.006058216094970703 nb_pixel_total : 10267 time to create 1 rle with old method : 0.011864900588989258 time for calcul the mask position with numpy : 0.006071329116821289 nb_pixel_total : 1149 time to create 1 rle with old method : 0.0014183521270751953 time for calcul the mask position with numpy : 0.00618743896484375 nb_pixel_total : 506 time to create 1 rle with old method : 0.0006403923034667969 time for calcul the mask position with numpy : 0.006041049957275391 nb_pixel_total : 10193 time to create 1 rle with old method : 0.011647701263427734 time for calcul the mask position with numpy : 0.006093263626098633 nb_pixel_total : 2993 time to create 1 rle with old method : 0.003626585006713867 time for calcul the mask position with numpy : 0.006058931350708008 nb_pixel_total : 4991 time to create 1 rle with old method : 0.005925416946411133 time for calcul the mask position with numpy : 0.00588679313659668 nb_pixel_total : 915 time to create 1 rle with old method : 0.0010440349578857422 time for calcul the mask position with numpy : 0.0057909488677978516 nb_pixel_total : 113 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.005773782730102539 nb_pixel_total : 499 time to create 1 rle with old method : 0.0005574226379394531 time for calcul the mask position with numpy : 0.0057163238525390625 nb_pixel_total : 719 time to create 1 rle with old method : 0.0008511543273925781 time for calcul the mask position with numpy : 0.005559206008911133 nb_pixel_total : 543 time to create 1 rle with old method : 0.0005929470062255859 time for calcul the mask position with numpy : 0.005793571472167969 nb_pixel_total : 278 time to create 1 rle with old method : 0.000392913818359375 time for calcul the mask position with numpy : 0.0055217742919921875 nb_pixel_total : 1348 time to create 1 rle with old method : 0.0014791488647460938 time for calcul the mask position with numpy : 0.0055773258209228516 nb_pixel_total : 50 time to create 1 rle with old method : 7.62939453125e-05 time for calcul the mask position with numpy : 0.005460023880004883 nb_pixel_total : 878 time to create 1 rle with old method : 0.0009627342224121094 time for calcul the mask position with numpy : 0.005483865737915039 nb_pixel_total : 573 time to create 1 rle with old method : 0.0007038116455078125 time for calcul the mask position with numpy : 0.005831480026245117 nb_pixel_total : 717 time to create 1 rle with old method : 0.0008435249328613281 time for calcul the mask position with numpy : 0.005755186080932617 nb_pixel_total : 1604 time to create 1 rle with old method : 0.0019497871398925781 time for calcul the mask position with numpy : 0.0057332515716552734 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0012099742889404297 time for calcul the mask position with numpy : 0.005797386169433594 nb_pixel_total : 822 time to create 1 rle with old method : 0.0009682178497314453 time for calcul the mask position with numpy : 0.005994081497192383 nb_pixel_total : 413 time to create 1 rle with old method : 0.0004913806915283203 time for calcul the mask position with numpy : 0.0059282779693603516 nb_pixel_total : 184 time to create 1 rle with old method : 0.00025272369384765625 time for calcul the mask position with numpy : 0.005900859832763672 nb_pixel_total : 746 time to create 1 rle with old method : 0.0008401870727539062 time for calcul the mask position with numpy : 0.005597591400146484 nb_pixel_total : 1139 time to create 1 rle with old method : 0.0014197826385498047 time for calcul the mask position with numpy : 0.005703926086425781 nb_pixel_total : 336 time to create 1 rle with old method : 0.00037288665771484375 time for calcul the mask position with numpy : 0.005715131759643555 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003287792205810547 time for calcul the mask position with numpy : 0.005688190460205078 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005333423614501953 time for calcul the mask position with numpy : 0.006017446517944336 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006093978881835938 time for calcul the mask position with numpy : 0.00611424446105957 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006167888641357422 time for calcul the mask position with numpy : 0.00602412223815918 nb_pixel_total : 312 time to create 1 rle with old method : 0.0005567073822021484 time for calcul the mask position with numpy : 0.006329774856567383 nb_pixel_total : 43 time to create 1 rle with old method : 9.560585021972656e-05 time for calcul the mask position with numpy : 0.0059735774993896484 nb_pixel_total : 2 time to create 1 rle with old method : 2.1696090698242188e-05 time for calcul the mask position with numpy : 0.005611896514892578 nb_pixel_total : 2034 time to create 1 rle with old method : 0.0022513866424560547 time for calcul the mask position with numpy : 0.0055789947509765625 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005037784576416016 time for calcul the mask position with numpy : 0.0058748722076416016 nb_pixel_total : 224 time to create 1 rle with old method : 0.00028896331787109375 time for calcul the mask position with numpy : 0.005558490753173828 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001704692840576172 time for calcul the mask position with numpy : 0.0059397220611572266 nb_pixel_total : 107495 time to create 1 rle with old method : 0.11466121673583984 time for calcul the mask position with numpy : 0.00594019889831543 nb_pixel_total : 3193 time to create 1 rle with old method : 0.003688812255859375 time for calcul the mask position with numpy : 0.005922079086303711 nb_pixel_total : 925 time to create 1 rle with old method : 0.0010349750518798828 time for calcul the mask position with numpy : 0.006073713302612305 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006396770477294922 time for calcul the mask position with numpy : 0.009566783905029297 nb_pixel_total : 325 time to create 1 rle with old method : 0.00042819976806640625 time for calcul the mask position with numpy : 0.009972810745239258 nb_pixel_total : 42 time to create 1 rle with old method : 7.104873657226562e-05 time for calcul the mask position with numpy : 0.009989261627197266 nb_pixel_total : 2134 time to create 1 rle with old method : 0.002588987350463867 time for calcul the mask position with numpy : 0.010207891464233398 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001761913299560547 time for calcul the mask position with numpy : 0.009812593460083008 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006661415100097656 time for calcul the mask position with numpy : 0.006147623062133789 nb_pixel_total : 2222 time to create 1 rle with old method : 0.0024521350860595703 time for calcul the mask position with numpy : 0.006172657012939453 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007727146148681641 time for calcul the mask position with numpy : 0.0063915252685546875 nb_pixel_total : 1760 time to create 1 rle with old method : 0.0020775794982910156 time for calcul the mask position with numpy : 0.006757497787475586 nb_pixel_total : 85 time to create 1 rle with old method : 0.00012993812561035156 time for calcul the mask position with numpy : 0.0064280033111572266 nb_pixel_total : 119 time to create 1 rle with old method : 0.00019669532775878906 time for calcul the mask position with numpy : 0.006189584732055664 nb_pixel_total : 148 time to create 1 rle with old method : 0.00017976760864257812 time for calcul the mask position with numpy : 0.005942583084106445 nb_pixel_total : 47 time to create 1 rle with old method : 8.249282836914062e-05 time for calcul the mask position with numpy : 0.006020069122314453 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005075931549072266 time for calcul the mask position with numpy : 0.00610661506652832 nb_pixel_total : 2675 time to create 1 rle with old method : 0.0031023025512695312 time for calcul the mask position with numpy : 0.006084918975830078 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004520416259765625 time for calcul the mask position with numpy : 0.0061588287353515625 nb_pixel_total : 151 time to create 1 rle with old method : 0.000186920166015625 time for calcul the mask position with numpy : 0.006128072738647461 nb_pixel_total : 165 time to create 1 rle with old method : 0.000209808349609375 time for calcul the mask position with numpy : 0.005996227264404297 nb_pixel_total : 752 time to create 1 rle with old method : 0.0008151531219482422 time for calcul the mask position with numpy : 0.006200551986694336 nb_pixel_total : 106 time to create 1 rle with old method : 0.000152587890625 time for calcul the mask position with numpy : 0.005929708480834961 nb_pixel_total : 195 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.00810384750366211 nb_pixel_total : 312 time to create 1 rle with old method : 0.00036978721618652344 create new chi : 0.920579195022583 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013089179992675781 batch 1 Loaded 90 chid ids of type : 4230 Number RLEs to save : 8707 TO DO : save crop sub photo not yet done ! save time : 0.5944092273712158 nb_obj : 86 nb_hashtags : 6 time to prepare the origin masks : 1.1913800239562988 time for calcul the mask position with numpy : 0.02356743812561035 nb_pixel_total : 1780560 time to create 1 rle with new method : 0.04187893867492676 time for calcul the mask position with numpy : 0.0058290958404541016 nb_pixel_total : 2755 time to create 1 rle with old method : 0.00286102294921875 time for calcul the mask position with numpy : 0.0054683685302734375 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002484321594238281 time for calcul the mask position with numpy : 0.0054607391357421875 nb_pixel_total : 5726 time to create 1 rle with old method : 0.006011486053466797 time for calcul the mask position with numpy : 0.005517482757568359 nb_pixel_total : 24231 time to create 1 rle with old method : 0.025805950164794922 time for calcul the mask position with numpy : 0.005894184112548828 nb_pixel_total : 25101 time to create 1 rle with old method : 0.029861927032470703 time for calcul the mask position with numpy : 0.00553131103515625 nb_pixel_total : 197 time to create 1 rle with old method : 0.00023484230041503906 time for calcul the mask position with numpy : 0.005437612533569336 nb_pixel_total : 87 time to create 1 rle with old method : 0.00011324882507324219 time for calcul the mask position with numpy : 0.005710601806640625 nb_pixel_total : 985 time to create 1 rle with old method : 0.001079559326171875 time for calcul the mask position with numpy : 0.005514383316040039 nb_pixel_total : 785 time to create 1 rle with old method : 0.0008513927459716797 time for calcul the mask position with numpy : 0.006087779998779297 nb_pixel_total : 29 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.00561070442199707 nb_pixel_total : 20 time to create 1 rle with old method : 4.315376281738281e-05 time for calcul the mask position with numpy : 0.0056803226470947266 nb_pixel_total : 44749 time to create 1 rle with old method : 0.04786396026611328 time for calcul the mask position with numpy : 0.005724430084228516 nb_pixel_total : 204 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.005695819854736328 nb_pixel_total : 7 time to create 1 rle with old method : 2.5272369384765625e-05 time for calcul the mask position with numpy : 0.005732297897338867 nb_pixel_total : 143 time to create 1 rle with old method : 0.00020623207092285156 time for calcul the mask position with numpy : 0.005563974380493164 nb_pixel_total : 1445 time to create 1 rle with old method : 0.0016741752624511719 time for calcul the mask position with numpy : 0.005682229995727539 nb_pixel_total : 1 time to create 1 rle with old method : 2.002716064453125e-05 time for calcul the mask position with numpy : 0.0056610107421875 nb_pixel_total : 2 time to create 1 rle with old method : 2.0265579223632812e-05 time for calcul the mask position with numpy : 0.0054836273193359375 nb_pixel_total : 1805 time to create 1 rle with old method : 0.0019867420196533203 time for calcul the mask position with numpy : 0.00554203987121582 nb_pixel_total : 2 time to create 1 rle with old method : 2.1457672119140625e-05 time for calcul the mask position with numpy : 0.005522251129150391 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002524852752685547 time for calcul the mask position with numpy : 0.005846738815307617 nb_pixel_total : 1410 time to create 1 rle with old method : 0.0014955997467041016 time for calcul the mask position with numpy : 0.005582571029663086 nb_pixel_total : 219 time to create 1 rle with old method : 0.00025725364685058594 time for calcul the mask position with numpy : 0.007518768310546875 nb_pixel_total : 786 time to create 1 rle with old method : 0.0008876323699951172 time for calcul the mask position with numpy : 0.008916378021240234 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005488395690917969 time for calcul the mask position with numpy : 0.009427309036254883 nb_pixel_total : 1070 time to create 1 rle with old method : 0.0013363361358642578 time for calcul the mask position with numpy : 0.00902700424194336 nb_pixel_total : 1892 time to create 1 rle with old method : 0.0020732879638671875 time for calcul the mask position with numpy : 0.009074211120605469 nb_pixel_total : 10354 time to create 1 rle with old method : 0.011230945587158203 time for calcul the mask position with numpy : 0.009097576141357422 nb_pixel_total : 32 time to create 1 rle with old method : 0.00010442733764648438 time for calcul the mask position with numpy : 0.009554862976074219 nb_pixel_total : 2111 time to create 1 rle with old method : 0.0023565292358398438 time for calcul the mask position with numpy : 0.008446455001831055 nb_pixel_total : 512 time to create 1 rle with old method : 0.0005884170532226562 time for calcul the mask position with numpy : 0.0055353641510009766 nb_pixel_total : 11255 time to create 1 rle with old method : 0.012575626373291016 time for calcul the mask position with numpy : 0.005547285079956055 nb_pixel_total : 2087 time to create 1 rle with old method : 0.0023415088653564453 time for calcul the mask position with numpy : 0.005532503128051758 nb_pixel_total : 566 time to create 1 rle with old method : 0.0006287097930908203 time for calcul the mask position with numpy : 0.005400896072387695 nb_pixel_total : 4400 time to create 1 rle with old method : 0.004597902297973633 time for calcul the mask position with numpy : 0.005448579788208008 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005276203155517578 time for calcul the mask position with numpy : 0.005437612533569336 nb_pixel_total : 726 time to create 1 rle with old method : 0.0007951259613037109 time for calcul the mask position with numpy : 0.005458831787109375 nb_pixel_total : 29 time to create 1 rle with old method : 5.1975250244140625e-05 time for calcul the mask position with numpy : 0.005441904067993164 nb_pixel_total : 89 time to create 1 rle with old method : 0.00017142295837402344 time for calcul the mask position with numpy : 0.005480766296386719 nb_pixel_total : 1336 time to create 1 rle with old method : 0.0014374256134033203 time for calcul the mask position with numpy : 0.005665779113769531 nb_pixel_total : 31 time to create 1 rle with old method : 6.198883056640625e-05 time for calcul the mask position with numpy : 0.005705833435058594 nb_pixel_total : 892 time to create 1 rle with old method : 0.001001596450805664 time for calcul the mask position with numpy : 0.005708456039428711 nb_pixel_total : 6792 time to create 1 rle with old method : 0.007830381393432617 time for calcul the mask position with numpy : 0.005639791488647461 nb_pixel_total : 624 time to create 1 rle with old method : 0.0007152557373046875 time for calcul the mask position with numpy : 0.005945920944213867 nb_pixel_total : 4232 time to create 1 rle with old method : 0.0046939849853515625 time for calcul the mask position with numpy : 0.00603938102722168 nb_pixel_total : 564 time to create 1 rle with old method : 0.0006978511810302734 time for calcul the mask position with numpy : 0.006014108657836914 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002968311309814453 time for calcul the mask position with numpy : 0.006086587905883789 nb_pixel_total : 2168 time to create 1 rle with old method : 0.0023686885833740234 time for calcul the mask position with numpy : 0.006134748458862305 nb_pixel_total : 565 time to create 1 rle with old method : 0.0006301403045654297 time for calcul the mask position with numpy : 0.00616765022277832 nb_pixel_total : 1140 time to create 1 rle with old method : 0.0013651847839355469 time for calcul the mask position with numpy : 0.006799459457397461 nb_pixel_total : 216 time to create 1 rle with old method : 0.000274658203125 time for calcul the mask position with numpy : 0.0065457820892333984 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.006484031677246094 nb_pixel_total : 1143 time to create 1 rle with old method : 0.0013611316680908203 time for calcul the mask position with numpy : 0.0064542293548583984 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005161762237548828 time for calcul the mask position with numpy : 0.0062465667724609375 nb_pixel_total : 1382 time to create 1 rle with old method : 0.001646280288696289 time for calcul the mask position with numpy : 0.006341457366943359 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0012738704681396484 time for calcul the mask position with numpy : 0.0064504146575927734 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003952980041503906 time for calcul the mask position with numpy : 0.006509065628051758 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005366802215576172 time for calcul the mask position with numpy : 0.00652003288269043 nb_pixel_total : 513 time to create 1 rle with old method : 0.0006625652313232422 time for calcul the mask position with numpy : 0.00640416145324707 nb_pixel_total : 74 time to create 1 rle with old method : 0.00012373924255371094 time for calcul the mask position with numpy : 0.00655364990234375 nb_pixel_total : 1961 time to create 1 rle with old method : 0.002355813980102539 time for calcul the mask position with numpy : 0.00646209716796875 nb_pixel_total : 54 time to create 1 rle with old method : 9.465217590332031e-05 time for calcul the mask position with numpy : 0.006462574005126953 nb_pixel_total : 473 time to create 1 rle with old method : 0.000591278076171875 time for calcul the mask position with numpy : 0.006922006607055664 nb_pixel_total : 105764 time to create 1 rle with old method : 0.11340141296386719 time for calcul the mask position with numpy : 0.006001710891723633 nb_pixel_total : 3210 time to create 1 rle with old method : 0.0035316944122314453 time for calcul the mask position with numpy : 0.005845069885253906 nb_pixel_total : 759 time to create 1 rle with old method : 0.0008075237274169922 time for calcul the mask position with numpy : 0.0059795379638671875 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005519390106201172 time for calcul the mask position with numpy : 0.005654573440551758 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003552436828613281 time for calcul the mask position with numpy : 0.005894660949707031 nb_pixel_total : 53 time to create 1 rle with old method : 7.82012939453125e-05 time for calcul the mask position with numpy : 0.0057871341705322266 nb_pixel_total : 300 time to create 1 rle with old method : 0.0003809928894042969 time for calcul the mask position with numpy : 0.0058879852294921875 nb_pixel_total : 3581 time to create 1 rle with old method : 0.003914594650268555 time for calcul the mask position with numpy : 0.005963802337646484 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005636215209960938 time for calcul the mask position with numpy : 0.0060024261474609375 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002224445343017578 time for calcul the mask position with numpy : 0.005978584289550781 nb_pixel_total : 549 time to create 1 rle with old method : 0.0006663799285888672 time for calcul the mask position with numpy : 0.00587916374206543 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004017353057861328 time for calcul the mask position with numpy : 0.005686759948730469 nb_pixel_total : 14 time to create 1 rle with old method : 3.695487976074219e-05 time for calcul the mask position with numpy : 0.0058710575103759766 nb_pixel_total : 390 time to create 1 rle with old method : 0.00048279762268066406 time for calcul the mask position with numpy : 0.005855083465576172 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012445449829101562 time for calcul the mask position with numpy : 0.006034135818481445 nb_pixel_total : 324 time to create 1 rle with old method : 0.00035953521728515625 time for calcul the mask position with numpy : 0.005698204040527344 nb_pixel_total : 120 time to create 1 rle with old method : 0.00017905235290527344 time for calcul the mask position with numpy : 0.0058062076568603516 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002281665802001953 time for calcul the mask position with numpy : 0.005950212478637695 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002181529998779297 time for calcul the mask position with numpy : 0.005914211273193359 nb_pixel_total : 1501 time to create 1 rle with old method : 0.00165557861328125 time for calcul the mask position with numpy : 0.00577092170715332 nb_pixel_total : 29 time to create 1 rle with old method : 6.198883056640625e-05 time for calcul the mask position with numpy : 0.006024599075317383 nb_pixel_total : 209 time to create 1 rle with old method : 0.00026988983154296875 time for calcul the mask position with numpy : 0.005876302719116211 nb_pixel_total : 250 time to create 1 rle with old method : 0.0002732276916503906 create new chi : 0.9200594425201416 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014925003051757812 batch 1 Loaded 87 chid ids of type : 4230 Number RLEs to save : 10199 TO DO : save crop sub photo not yet done ! save time : 0.6919782161712646 nb_obj : 88 nb_hashtags : 6 time to prepare the origin masks : 1.17478346824646 time for calcul the mask position with numpy : 0.02213001251220703 nb_pixel_total : 1784500 time to create 1 rle with new method : 0.04644489288330078 time for calcul the mask position with numpy : 0.0063762664794921875 nb_pixel_total : 18239 time to create 1 rle with old method : 0.020337820053100586 time for calcul the mask position with numpy : 0.006057024002075195 nb_pixel_total : 2609 time to create 1 rle with old method : 0.003015756607055664 time for calcul the mask position with numpy : 0.00599980354309082 nb_pixel_total : 210 time to create 1 rle with old method : 0.00035834312438964844 time for calcul the mask position with numpy : 0.00600123405456543 nb_pixel_total : 100 time to create 1 rle with old method : 0.00015473365783691406 time for calcul the mask position with numpy : 0.006237506866455078 nb_pixel_total : 782 time to create 1 rle with old method : 0.0009829998016357422 time for calcul the mask position with numpy : 0.006545305252075195 nb_pixel_total : 25 time to create 1 rle with old method : 6.532669067382812e-05 time for calcul the mask position with numpy : 0.005971431732177734 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003838539123535156 time for calcul the mask position with numpy : 0.006036996841430664 nb_pixel_total : 86 time to create 1 rle with old method : 0.000152587890625 time for calcul the mask position with numpy : 0.005887031555175781 nb_pixel_total : 36 time to create 1 rle with old method : 7.343292236328125e-05 time for calcul the mask position with numpy : 0.00586390495300293 nb_pixel_total : 1 time to create 1 rle with old method : 1.9311904907226562e-05 time for calcul the mask position with numpy : 0.005840301513671875 nb_pixel_total : 780 time to create 1 rle with old method : 0.0010309219360351562 time for calcul the mask position with numpy : 0.005839824676513672 nb_pixel_total : 3201 time to create 1 rle with old method : 0.0036346912384033203 time for calcul the mask position with numpy : 0.00583195686340332 nb_pixel_total : 16 time to create 1 rle with old method : 4.76837158203125e-05 time for calcul the mask position with numpy : 0.005759239196777344 nb_pixel_total : 41 time to create 1 rle with old method : 6.723403930664062e-05 time for calcul the mask position with numpy : 0.005861997604370117 nb_pixel_total : 12 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.005738258361816406 nb_pixel_total : 189 time to create 1 rle with old method : 0.00024271011352539062 time for calcul the mask position with numpy : 0.0055997371673583984 nb_pixel_total : 2394 time to create 1 rle with old method : 0.0027997493743896484 time for calcul the mask position with numpy : 0.00575566291809082 nb_pixel_total : 14627 time to create 1 rle with old method : 0.0163114070892334 time for calcul the mask position with numpy : 0.00557708740234375 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007436275482177734 time for calcul the mask position with numpy : 0.005706310272216797 nb_pixel_total : 465 time to create 1 rle with old method : 0.0005850791931152344 time for calcul the mask position with numpy : 0.005831241607666016 nb_pixel_total : 1076 time to create 1 rle with old method : 0.0013709068298339844 time for calcul the mask position with numpy : 0.005807161331176758 nb_pixel_total : 1792 time to create 1 rle with old method : 0.002167224884033203 time for calcul the mask position with numpy : 0.005971431732177734 nb_pixel_total : 10199 time to create 1 rle with old method : 0.011234521865844727 time for calcul the mask position with numpy : 0.00580906867980957 nb_pixel_total : 1986 time to create 1 rle with old method : 0.00244140625 time for calcul the mask position with numpy : 0.006074190139770508 nb_pixel_total : 3065 time to create 1 rle with old method : 0.0035791397094726562 time for calcul the mask position with numpy : 0.006002664566040039 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003628730773925781 time for calcul the mask position with numpy : 0.0059697628021240234 nb_pixel_total : 143 time to create 1 rle with old method : 0.00023937225341796875 time for calcul the mask position with numpy : 0.005787849426269531 nb_pixel_total : 1615 time to create 1 rle with old method : 0.001886606216430664 time for calcul the mask position with numpy : 0.0058405399322509766 nb_pixel_total : 118 time to create 1 rle with old method : 0.000202178955078125 time for calcul the mask position with numpy : 0.0058672428131103516 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006113052368164062 time for calcul the mask position with numpy : 0.005762815475463867 nb_pixel_total : 1278 time to create 1 rle with old method : 0.001443624496459961 time for calcul the mask position with numpy : 0.0058002471923828125 nb_pixel_total : 1378 time to create 1 rle with old method : 0.0016436576843261719 time for calcul the mask position with numpy : 0.006007194519042969 nb_pixel_total : 1756 time to create 1 rle with old method : 0.002172708511352539 time for calcul the mask position with numpy : 0.005875825881958008 nb_pixel_total : 4664 time to create 1 rle with old method : 0.005244731903076172 time for calcul the mask position with numpy : 0.005869388580322266 nb_pixel_total : 13509 time to create 1 rle with old method : 0.01497960090637207 time for calcul the mask position with numpy : 0.005927324295043945 nb_pixel_total : 300 time to create 1 rle with old method : 0.0003657341003417969 time for calcul the mask position with numpy : 0.005805253982543945 nb_pixel_total : 15477 time to create 1 rle with old method : 0.017244577407836914 time for calcul the mask position with numpy : 0.005791425704956055 nb_pixel_total : 932 time to create 1 rle with old method : 0.001089334487915039 time for calcul the mask position with numpy : 0.005949735641479492 nb_pixel_total : 534 time to create 1 rle with old method : 0.0006783008575439453 time for calcul the mask position with numpy : 0.0060155391693115234 nb_pixel_total : 860 time to create 1 rle with old method : 0.001123189926147461 time for calcul the mask position with numpy : 0.0060846805572509766 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007519721984863281 time for calcul the mask position with numpy : 0.005964756011962891 nb_pixel_total : 1371 time to create 1 rle with old method : 0.0016474723815917969 time for calcul the mask position with numpy : 0.0058557987213134766 nb_pixel_total : 15 time to create 1 rle with old method : 4.100799560546875e-05 time for calcul the mask position with numpy : 0.005862712860107422 nb_pixel_total : 839 time to create 1 rle with old method : 0.0010182857513427734 time for calcul the mask position with numpy : 0.00611424446105957 nb_pixel_total : 4647 time to create 1 rle with old method : 0.005356788635253906 time for calcul the mask position with numpy : 0.0056765079498291016 nb_pixel_total : 182 time to create 1 rle with old method : 0.00023484230041503906 time for calcul the mask position with numpy : 0.005742549896240234 nb_pixel_total : 1544 time to create 1 rle with old method : 0.001796722412109375 time for calcul the mask position with numpy : 0.005725860595703125 nb_pixel_total : 4559 time to create 1 rle with old method : 0.0050389766693115234 time for calcul the mask position with numpy : 0.005837440490722656 nb_pixel_total : 600 time to create 1 rle with old method : 0.0007109642028808594 time for calcul the mask position with numpy : 0.005697488784790039 nb_pixel_total : 2047 time to create 1 rle with old method : 0.002289295196533203 time for calcul the mask position with numpy : 0.005642890930175781 nb_pixel_total : 1047 time to create 1 rle with old method : 0.0011813640594482422 time for calcul the mask position with numpy : 0.005898714065551758 nb_pixel_total : 994 time to create 1 rle with old method : 0.0011277198791503906 time for calcul the mask position with numpy : 0.005745887756347656 nb_pixel_total : 656 time to create 1 rle with old method : 0.0008683204650878906 time for calcul the mask position with numpy : 0.005844593048095703 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004451274871826172 time for calcul the mask position with numpy : 0.005881547927856445 nb_pixel_total : 236 time to create 1 rle with old method : 0.00030350685119628906 time for calcul the mask position with numpy : 0.0056133270263671875 nb_pixel_total : 630 time to create 1 rle with old method : 0.0007886886596679688 time for calcul the mask position with numpy : 0.005522966384887695 nb_pixel_total : 1207 time to create 1 rle with old method : 0.0014452934265136719 time for calcul the mask position with numpy : 0.005650520324707031 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004680156707763672 time for calcul the mask position with numpy : 0.0057430267333984375 nb_pixel_total : 16 time to create 1 rle with old method : 5.0067901611328125e-05 time for calcul the mask position with numpy : 0.005822896957397461 nb_pixel_total : 636 time to create 1 rle with old method : 0.0007848739624023438 time for calcul the mask position with numpy : 0.0057828426361083984 nb_pixel_total : 1406 time to create 1 rle with old method : 0.0017230510711669922 time for calcul the mask position with numpy : 0.005718231201171875 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003478527069091797 time for calcul the mask position with numpy : 0.005661487579345703 nb_pixel_total : 76 time to create 1 rle with old method : 0.00014162063598632812 time for calcul the mask position with numpy : 0.008155107498168945 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005128383636474609 time for calcul the mask position with numpy : 0.008058786392211914 nb_pixel_total : 2017 time to create 1 rle with old method : 0.0022499561309814453 time for calcul the mask position with numpy : 0.008125066757202148 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005106925964355469 time for calcul the mask position with numpy : 0.008242607116699219 nb_pixel_total : 106475 time to create 1 rle with old method : 0.11377549171447754 time for calcul the mask position with numpy : 0.008579492568969727 nb_pixel_total : 3165 time to create 1 rle with old method : 0.003525972366333008 time for calcul the mask position with numpy : 0.008169174194335938 nb_pixel_total : 480 time to create 1 rle with old method : 0.000530242919921875 time for calcul the mask position with numpy : 0.008054256439208984 nb_pixel_total : 185 time to create 1 rle with old method : 0.00022029876708984375 time for calcul the mask position with numpy : 0.00817728042602539 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002684593200683594 time for calcul the mask position with numpy : 0.008196353912353516 nb_pixel_total : 36090 time to create 1 rle with old method : 0.03880620002746582 time for calcul the mask position with numpy : 0.008448123931884766 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.008029699325561523 nb_pixel_total : 4357 time to create 1 rle with old method : 0.004665374755859375 time for calcul the mask position with numpy : 0.007999420166015625 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005233287811279297 time for calcul the mask position with numpy : 0.008271455764770508 nb_pixel_total : 212 time to create 1 rle with old method : 0.00025272369384765625 time for calcul the mask position with numpy : 0.00830078125 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007338523864746094 time for calcul the mask position with numpy : 0.008258581161499023 nb_pixel_total : 343 time to create 1 rle with old method : 0.0003979206085205078 time for calcul the mask position with numpy : 0.00808262825012207 nb_pixel_total : 16 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.0119781494140625 nb_pixel_total : 778 time to create 1 rle with old method : 0.0009257793426513672 time for calcul the mask position with numpy : 0.008237123489379883 nb_pixel_total : 436 time to create 1 rle with old method : 0.000530242919921875 time for calcul the mask position with numpy : 0.007775783538818359 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004169940948486328 time for calcul the mask position with numpy : 0.008086681365966797 nb_pixel_total : 282 time to create 1 rle with old method : 0.00030612945556640625 time for calcul the mask position with numpy : 0.007518291473388672 nb_pixel_total : 185 time to create 1 rle with old method : 0.00019788742065429688 time for calcul the mask position with numpy : 0.0077667236328125 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003294944763183594 time for calcul the mask position with numpy : 0.007935523986816406 nb_pixel_total : 192 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.007746696472167969 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003218650817871094 time for calcul the mask position with numpy : 0.007909297943115234 nb_pixel_total : 8 time to create 1 rle with old method : 2.765655517578125e-05 create new chi : 0.9712715148925781 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0015950202941894531 batch 1 Loaded 89 chid ids of type : 4230 Number RLEs to save : 11378 TO DO : save crop sub photo not yet done ! save time : 2.313856840133667 map_output_result : {1336563185: (0.0, 'Should be the crop_list due to order', 0.0), 1336563147: (0.0, 'Should be the crop_list due to order', 0.0), 1336563145: (0.0, 'Should be the crop_list due to order', 0.0), 1336563141: (0.0, 'Should be the crop_list due to order', 0.0), 1336563138: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1336563185, 1336563147, 1336563145, 1336563141, 1336563138] Looping around the photos to save general results len do output : 5 /1336563185.Didn't retrieve data . /1336563147.Didn't retrieve data . /1336563145.Didn't retrieve data . /1336563141.Didn't retrieve data . /1336563138.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563185', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563147', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563145', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563141', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563138', None, None, None, None, None, '2574023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013211488723754883 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.462764978408813 time spend to save output : 0.01356649398803711 total time spend for step 4 : 17.47633147239685 step5:crop_condition Mon Feb 10 23:21:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 441 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 157 About to insert : list_path_to_insert length 157 new photo from crops ! About to upload 157 photos upload in portfolio : 4869462 init cache_photo without model_param we have 157 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739226087_223917 we have uploaded 157 photos in the portfolio 4869462 time of upload the photos Elapsed time : 36.77744650840759 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 4869462 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739226125_223917 we have uploaded 45 photos in the portfolio 4869462 time of upload the photos Elapsed time : 10.817380428314209 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 4869462 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739226136_223917 we have uploaded 32 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.870646953582764 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 4869462 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739226145_223917 we have uploaded 46 photos in the portfolio 4869462 time of upload the photos Elapsed time : 10.019060373306274 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1336563185, 1336563147, 1336563145, 1336563141, 1336563138] Looping around the photos to save general results len do output : 280 /1336618181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336618474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563185', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563147', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563145', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563141', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563138', None, None, None, None, None, '2574023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 845 time used for this insertion : 0.04793906211853027 save_final save missing photos in datou_result : time spend for datou_step_exec : 71.04489421844482 time spend to save output : 0.05784726142883301 total time spend for step 5 : 71.10274147987366 step6:thcl Mon Feb 10 23:22:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.016754627227783203 time to convert the images to numpy array : 0.09023594856262207 time to import caffe and check if the image exist : 0.023296356201171875 time to convert the images to numpy array : 0.08354902267456055 time to import caffe and check if the image exist : 0.0295870304107666 time to convert the images to numpy array : 0.08334803581237793 time to import caffe and check if the image exist : 0.02062249183654785 time to convert the images to numpy array : 0.09270715713500977 time to import caffe and check if the image exist : 0.02862262725830078 time to convert the images to numpy array : 0.0861353874206543 time to import caffe and check if the image exist : 0.01521611213684082 time to convert the images to numpy array : 0.10007739067077637 time to import caffe and check if the image exist : 0.021889686584472656 time to convert the images to numpy array : 0.09534740447998047 time to import caffe and check if the image exist : 0.02893996238708496 time to convert the images to numpy array : 0.09459733963012695 time to import caffe and check if the image exist : 0.025528430938720703 time to convert the images to numpy array : 0.09980463981628418 time to import caffe and check if the image exist : 0.025960445404052734 time to convert the images to numpy array : 0.0995790958404541 total time to convert the images to numpy array : 0.3236098289489746 list photo_ids error: [] list photo_ids correct : [1336618181, 1336618182, 1336618183, 1336618184, 1336618185, 1336618186, 1336618187, 1336618188, 1336618189, 1336618190, 1336618191, 1336618192, 1336618193, 1336618194, 1336618195, 1336618196, 1336618197, 1336618198, 1336618199, 1336618200, 1336618201, 1336618202, 1336618203, 1336618204, 1336618205, 1336618206, 1336618207, 1336618208, 1336618414, 1336618415, 1336618416, 1336618417, 1336618418, 1336618419, 1336618420, 1336618421, 1336618422, 1336618423, 1336618429, 1336618430, 1336618431, 1336618432, 1336618433, 1336618434, 1336618435, 1336618436, 1336618437, 1336618438, 1336618439, 1336618440, 1336618441, 1336618442, 1336618443, 1336618444, 1336618445, 1336618446, 1336618237, 1336618238, 1336618239, 1336618240, 1336618241, 1336618242, 1336618243, 1336618244, 1336618245, 1336618247, 1336618248, 1336618249, 1336618250, 1336618251, 1336618252, 1336618253, 1336618254, 1336618255, 1336618256, 1336618257, 1336618258, 1336618259, 1336618260, 1336618261, 1336618262, 1336618263, 1336618264, 1336618265, 1336618447, 1336618448, 1336618449, 1336618450, 1336618451, 1336618452, 1336618453, 1336618454, 1336618455, 1336618456, 1336618457, 1336618458, 1336618459, 1336618460, 1336618461, 1336618462, 1336618463, 1336618464, 1336618465, 1336618466, 1336618467, 1336618468, 1336618469, 1336618470, 1336618471, 1336618472, 1336618473, 1336618474, 1336618294, 1336618295, 1336618296, 1336618297, 1336618298, 1336618299, 1336618300, 1336618301, 1336618302, 1336618303, 1336618304, 1336618305, 1336618306, 1336618307, 1336618308, 1336618309, 1336618310, 1336618311, 1336618312, 1336618313, 1336618314, 1336618315, 1336618316, 1336618317, 1336618318, 1336618319, 1336618320, 1336618321, 1336618383, 1336618384, 1336618385, 1336618386, 1336618387, 1336618388, 1336618392, 1336618393, 1336618394, 1336618395, 1336618396, 1336618397, 1336618398, 1336618399, 1336618400, 1336618401, 1336618402, 1336618403, 1336618404, 1336618405, 1336618406, 1336618407, 1336618408, 1336618409, 1336618410, 1336618411, 1336618412, 1336618413, 1336618209, 1336618210, 1336618211, 1336618212, 1336618213, 1336618214, 1336618215, 1336618216, 1336618217, 1336618218, 1336618219, 1336618220, 1336618221, 1336618222, 1336618223, 1336618224, 1336618225, 1336618226, 1336618227, 1336618228, 1336618229, 1336618230, 1336618231, 1336618232, 1336618233, 1336618234, 1336618235, 1336618236, 1336618266, 1336618267, 1336618268, 1336618269, 1336618270, 1336618271, 1336618272, 1336618273, 1336618274, 1336618275, 1336618276, 1336618277, 1336618278, 1336618279, 1336618280, 1336618281, 1336618282, 1336618283, 1336618284, 1336618285, 1336618286, 1336618287, 1336618288, 1336618289, 1336618290, 1336618291, 1336618292, 1336618293, 1336618354, 1336618355, 1336618356, 1336618357, 1336618358, 1336618359, 1336618360, 1336618361, 1336618362, 1336618363, 1336618364, 1336618365, 1336618366, 1336618367, 1336618368, 1336618369, 1336618370, 1336618371, 1336618372, 1336618373, 1336618374, 1336618375, 1336618376, 1336618377, 1336618379, 1336618380, 1336618381, 1336618382, 1336618322, 1336618323, 1336618324, 1336618325, 1336618326, 1336618327, 1336618328, 1336618329, 1336618330, 1336618331, 1336618332, 1336618333, 1336618334, 1336618335, 1336618336, 1336618337, 1336618338, 1336618343, 1336618344, 1336618345, 1336618346, 1336618347, 1336618348, 1336618349, 1336618350, 1336618351, 1336618352, 1336618353] number of photos to traite : 280 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10776 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.2284111976623535 time used to do the prediction : 0.9749560356140137 save descriptor for thcl : 3237 time to traite the descriptors : 1.5542171001434326 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1336618181 To insert : 1336618182 To insert : 1336618183 To insert : 1336618184 To insert : 1336618185 To insert : 1336618186 To insert : 1336618187 To insert : 1336618188 To insert : 1336618189 To insert : 1336618190 To insert : 1336618191 To insert : 1336618192 To insert : 1336618193 To insert : 1336618194 To insert : 1336618195 To insert : 1336618196 To insert : 1336618197 To insert : 1336618198 To insert : 1336618199 To insert : 1336618200 To insert : 1336618201 To insert : 1336618202 To insert : 1336618203 To insert : 1336618204 To insert : 1336618205 To insert : 1336618206 To insert : 1336618207 To insert : 1336618208 To insert : 1336618414 To insert : 1336618415 To insert : 1336618416 To insert : 1336618417 To insert : 1336618418 To insert : 1336618419 To insert : 1336618420 To insert : 1336618421 To insert : 1336618422 To insert : 1336618423 To insert : 1336618429 To insert : 1336618430 To insert : 1336618431 To insert : 1336618432 To insert : 1336618433 To insert : 1336618434 To insert : 1336618435 To insert : 1336618436 To insert : 1336618437 To insert : 1336618438 To insert : 1336618439 To insert : 1336618440 To insert : 1336618441 To insert : 1336618442 To insert : 1336618443 To insert : 1336618444 To insert : 1336618445 To insert : 1336618446 To insert : 1336618237 To insert : 1336618238 To insert : 1336618239 To insert : 1336618240 To insert : 1336618241 To insert : 1336618242 To insert : 1336618243 To insert : 1336618244 To insert : 1336618245 To insert : 1336618247 To insert : 1336618248 To insert : 1336618249 To insert : 1336618250 To insert : 1336618251 To insert : 1336618252 To insert : 1336618253 To insert : 1336618254 To insert : 1336618255 To insert : 1336618256 To insert : 1336618257 To insert : 1336618258 To insert : 1336618259 To insert : 1336618260 To insert : 1336618261 To insert : 1336618262 To insert : 1336618263 To insert : 1336618264 To insert : 1336618265 To insert : 1336618447 To insert : 1336618448 To insert : 1336618449 To insert : 1336618450 To insert : 1336618451 To insert : 1336618452 To insert : 1336618453 To insert : 1336618454 To insert : 1336618455 To insert : 1336618456 To insert : 1336618457 To insert : 1336618458 To insert : 1336618459 To insert : 1336618460 To insert : 1336618461 To insert : 1336618462 To insert : 1336618463 To insert : 1336618464 To insert : 1336618465 To insert : 1336618466 To insert : 1336618467 To insert : 1336618468 To insert : 1336618469 To insert : 1336618470 To insert : 1336618471 To insert : 1336618472 To insert : 1336618473 To insert : 1336618474 To insert : 1336618294 To insert : 1336618295 To insert : 1336618296 To insert : 1336618297 To insert : 1336618298 To insert : 1336618299 To insert : 1336618300 To insert : 1336618301 To insert : 1336618302 To insert : 1336618303 To insert : 1336618304 To insert : 1336618305 To insert : 1336618306 To insert : 1336618307 To insert : 1336618308 To insert : 1336618309 To insert : 1336618310 To insert : 1336618311 To insert : 1336618312 To insert : 1336618313 To insert : 1336618314 To insert : 1336618315 To insert : 1336618316 To insert : 1336618317 To insert : 1336618318 To insert : 1336618319 To insert : 1336618320 To insert : 1336618321 To insert : 1336618383 To insert : 1336618384 To insert : 1336618385 To insert : 1336618386 To insert : 1336618387 To insert : 1336618388 To insert : 1336618392 To insert : 1336618393 To insert : 1336618394 To insert : 1336618395 To insert : 1336618396 To insert : 1336618397 To insert : 1336618398 To insert : 1336618399 To insert : 1336618400 To insert : 1336618401 To insert : 1336618402 To insert : 1336618403 To insert : 1336618404 To insert : 1336618405 To insert : 1336618406 To insert : 1336618407 To insert : 1336618408 To insert : 1336618409 To insert : 1336618410 To insert : 1336618411 To insert : 1336618412 To insert : 1336618413 To insert : 1336618209 To insert : 1336618210 To insert : 1336618211 To insert : 1336618212 To insert : 1336618213 To insert : 1336618214 To insert : 1336618215 To insert : 1336618216 To insert : 1336618217 To insert : 1336618218 To insert : 1336618219 To insert : 1336618220 To insert : 1336618221 To insert : 1336618222 To insert : 1336618223 To insert : 1336618224 To insert : 1336618225 To insert : 1336618226 To insert : 1336618227 To insert : 1336618228 To insert : 1336618229 To insert : 1336618230 To insert : 1336618231 To insert : 1336618232 To insert : 1336618233 To insert : 1336618234 To insert : 1336618235 To insert : 1336618236 To insert : 1336618266 To insert : 1336618267 To insert : 1336618268 To insert : 1336618269 To insert : 1336618270 To insert : 1336618271 To insert : 1336618272 To insert : 1336618273 To insert : 1336618274 To insert : 1336618275 To insert : 1336618276 To insert : 1336618277 To insert : 1336618278 To insert : 1336618279 To insert : 1336618280 To insert : 1336618281 To insert : 1336618282 To insert : 1336618283 To insert : 1336618284 To insert : 1336618285 To insert : 1336618286 To insert : 1336618287 To insert : 1336618288 To insert : 1336618289 To insert : 1336618290 To insert : 1336618291 To insert : 1336618292 To insert : 1336618293 To insert : 1336618354 To insert : 1336618355 To insert : 1336618356 To insert : 1336618357 To insert : 1336618358 To insert : 1336618359 To insert : 1336618360 To insert : 1336618361 To insert : 1336618362 To insert : 1336618363 To insert : 1336618364 To insert : 1336618365 To insert : 1336618366 To insert : 1336618367 To insert : 1336618368 To insert : 1336618369 To insert : 1336618370 To insert : 1336618371 To insert : 1336618372 To insert : 1336618373 To insert : 1336618374 To insert : 1336618375 To insert : 1336618376 To insert : 1336618377 To insert : 1336618379 To insert : 1336618380 To insert : 1336618381 To insert : 1336618382 To insert : 1336618322 To insert : 1336618323 To insert : 1336618324 To insert : 1336618325 To insert : 1336618326 To insert : 1336618327 To insert : 1336618328 To insert : 1336618329 To insert : 1336618330 To insert : 1336618331 To insert : 1336618332 To insert : 1336618333 To insert : 1336618334 To insert : 1336618335 To insert : 1336618336 To insert : 1336618337 To insert : 1336618338 To insert : 1336618343 To insert : 1336618344 To insert : 1336618345 To insert : 1336618346 To insert : 1336618347 To insert : 1336618348 To insert : 1336618349 To insert : 1336618350 To insert : 1336618351 To insert : 1336618352 To insert : 1336618353 time to insert the descriptors : 52.96737456321716 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 409 time used for this insertion : 0.02890491485595703 save missing photos in datou_result : time spend for datou_step_exec : 61.12240481376648 time spend to save output : 0.08319497108459473 total time spend for step 6 : 61.205599784851074 step7:ventilate_hashtags_in_portfolio Mon Feb 10 23:23:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20421981 get user id for portfolio 20421981 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20421981 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','PET_clair','mal_croppe','papier','Carton','PEHD','pehd','pet_clair','PET_fonce','Papier','flou','refus','metal','pet_fonce','environnement','autre','Film_plastique','Tetrapak')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20421981 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','PET_clair','mal_croppe','papier','Carton','PEHD','pehd','pet_clair','PET_fonce','Papier','flou','refus','metal','pet_fonce','environnement','autre','Film_plastique','Tetrapak')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20421981 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','PET_clair','mal_croppe','papier','Carton','PEHD','pehd','pet_clair','PET_fonce','Papier','flou','refus','metal','pet_fonce','environnement','autre','Film_plastique','Tetrapak')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20421981 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','PET_clair','mal_croppe','papier','Carton','PEHD','pehd','pet_clair','PET_fonce','Papier','flou','refus','metal','pet_fonce','environnement','autre','Film_plastique','Tetrapak')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20422923,20422926,20422921,20422928,20422925,20422932,20422929,20422930,20422931,20422933,20422934,20422935,20422936?tags=carton,pet_clair,mal_croppe,papier,pehd,pet_fonce,flou,refus,metal,environnement,autre,film_plastique,tetrapak&datou_id_consolidate=4235&port_consolidate=20421981 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1336563185, 1336563147, 1336563145, 1336563141, 1336563138] Looping around the photos to save general results len do output : 1 /20421981. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563185', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563147', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563145', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563141', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563138', None, None, None, None, None, '2574023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012497186660766602 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.57159423828125 time spend to save output : 0.01275491714477539 total time spend for step 7 : 2.5843491554260254 step8:final Mon Feb 10 23:23:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1336563185: ('0.21934976660559524',), 1336563147: ('0.21934976660559524',), 1336563145: ('0.21934976660559524',), 1336563141: ('0.21934976660559524',), 1336563138: ('0.21934976660559524',)} new output for save of step final : {1336563185: ('0.21934976660559524',), 1336563147: ('0.21934976660559524',), 1336563145: ('0.21934976660559524',), 1336563141: ('0.21934976660559524',), 1336563138: ('0.21934976660559524',)} [1336563185, 1336563147, 1336563145, 1336563141, 1336563138] Looping around the photos to save general results len do output : 5 /1336563185.Didn't retrieve data . /1336563147.Didn't retrieve data . /1336563145.Didn't retrieve data . /1336563141.Didn't retrieve data . /1336563138.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563185', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563147', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563145', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563141', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563138', None, None, None, None, None, '2574023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01616954803466797 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12969040870666504 time spend to save output : 0.016492605209350586 total time spend for step 8 : 0.14618301391601562 step9:velours_tree Mon Feb 10 23:23:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20422923,20422926,20422921,20422928,20422925,20422932,20422929,20422930,20422931,20422933,20422934,20422935,20422936 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422923 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422926 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422921 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422928 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422925 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422932 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422929 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422930 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422931 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422933 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422934 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422935 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20422936 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 280 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 5 5 2 2 2 3 3 2 2 2 1 0 0 2 0 1 1 2 2 1 0 1 1 0 1 0 5 3 2 2 2 4 2 2 2 4 4 3 3 3 3 2 2 2 2 2 1 2 1 0 0 2 2 1 1 0 1 5 2 5 2 3 2 2 2 5 2 2 2 4 3 3 3 3 5 2 2 1 2 2 0 0 2 1 2 1 1 0 1 0 2 3 2 5 2 2 2 2 2 4 3 3 3 3 2 1 2 0 2 2 2 2 1 0 2 2 2 2 1 1 0 5 2 2 3 2 2 2 1 1 2 2 2 5 4 3 3 3 2 2 2 2 0 0 2 2 0 1 2 1 1 0 5 3 2 2 2 2 3 0 1 0 0 5 5 3 2 2 0 0 1 0 2 3 2 3 0 2 0 1 1 0 4 4 2 2 1 0 1 0 0 0 4 2 2 2 0 0 0 0 3 2 2 2 2 5 1 5 1 0 2 3 0 1 1 5 2 2 2 2 0 0 1 1 2 2 1 3 0 1 2 2 1 4 5 4 0 1 1 0 5 1 4 5 5 1 4 0 2 5 0 4 2 4 5 1 2 1 5 2 5 5 0 1 5 5 4 1 0 4 2 5 5 4 1 1 5 0 4] Elapsed time: 0.0465693473815918 graph_id used : 77756 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20422923,20422926,20422921,20422928,20422925,20422932,20422929,20422930,20422931,20422933,20422934,20422935,20422936?tags=carton,pet_clair,mal_croppe,papier,pehd,pet_fonce,flou,refus,metal,environnement,autre,film_plastique,tetrapak&datou_id_consolidate=4235&port_consolidate=20421981&tree_id=77756 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1336563185, 1336563147, 1336563145, 1336563141, 1336563138] Looping around the photos to save general results len do output : 1 /20421981Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563185', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563147', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563145', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563141', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563138', None, None, None, None, None, '2574023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013648033142089844 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.249789476394653 time spend to save output : 0.013968229293823242 total time spend for step 9 : 20.263757705688477 step10:send_mail_cod Mon Feb 10 23:23:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20421981_10-02-2025_23_23_59.pdf 20422905 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204229051739226239 20422908 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204229081739226240 20422903 imagette204229031739226241 20422910 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204229101739226241 20422907 imagette204229071739226242 20422914 imagette204229141739226242 20422911 imagette204229111739226242 20422912 imagette204229121739226242 20422913 imagette204229131739226242 20422916 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204229161739226242 20422917 imagette204229171739226243 20422918 imagette204229181739226243 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20421981 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20422923,20422926,20422921,20422928,20422925,20422932,20422929,20422930,20422931,20422933,20422934,20422935,20422936?tags=carton,pet_clair,mal_croppe,papier,pehd,pet_fonce,flou,refus,metal,environnement,autre,film_plastique,tetrapak&datou_id_consolidate=4235&port_consolidate=20421981&tree_id=77756 your option no_mail is active, we will not send the real mail to your client args[1336563185] : ((1336563185, -7.269224027403639, 492609224), (1336563185, -0.48690801637561093, 501862349), '0.21934976660559524') apple ((1336563185, -7.269224027403639, 492609224), (1336563185, -0.48690801637561093, 501862349), '0.21934976660559524') We are sending mail with results at cod@fotonower.com args[1336563147] : ((1336563147, -7.298242748840134, 492609224), (1336563147, -0.4757377560564542, 496442774), '0.21934976660559524') apple ((1336563147, -7.298242748840134, 492609224), (1336563147, -0.4757377560564542, 496442774), '0.21934976660559524') We are sending mail with results at cod@fotonower.com args[1336563145] : ((1336563145, -7.284518525982637, 492609224), (1336563145, -0.47473067530449914, 496442774), '0.21934976660559524') apple ((1336563145, -7.284518525982637, 492609224), (1336563145, -0.47473067530449914, 496442774), '0.21934976660559524') We are sending mail with results at cod@fotonower.com args[1336563141] : ((1336563141, -7.217178822409085, 492609224), (1336563141, -0.4741910591583251, 496442774), '0.21934976660559524') apple ((1336563141, -7.217178822409085, 492609224), (1336563141, -0.4741910591583251, 496442774), '0.21934976660559524') We are sending mail with results at cod@fotonower.com args[1336563138] : ((1336563138, -7.160021230007483, 492609224), (1336563138, -0.47569329943670047, 496442774), '0.21934976660559524') apple ((1336563138, -7.160021230007483, 492609224), (1336563138, -0.47569329943670047, 496442774), '0.21934976660559524') We are sending mail with results at cod@fotonower.com refus_total : 0.21934976660559524 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20421981 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20421981_10-02-2025_23_23_59.pdf results_Qualipapia_P20421981_10-02-2025_23_23_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20421981_10-02-2025_23_23_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20421981','results_Qualipapia_P20421981_10-02-2025_23_23_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20421981_10-02-2025_23_23_59.pdf','pdf','','0.18','0.21934976660559524') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1336563185, 1336563147, 1336563145, 1336563141, 1336563138] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563185', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563147', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563145', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563141', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563138', None, None, None, None, None, '2574023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.014146566390991211 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.982239246368408 time spend to save output : 0.014410018920898438 total time spend for step 10 : 4.996649265289307 step11:split_time_score Mon Feb 10 23:24:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10022025 20421981 Nombre de photos uploadées : 6 / 23040 (0%) 10022025 20421981 Nombre de photos taguées (types de déchets): 6 / 6 (100%) 10022025 20421981 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.00046706199645996094 elapsed_time : insert_dashboard_record_day_entry 0.028029441833496094 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20402595 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20402596 order by id desc limit 1 Qualite : 0.22689427111802013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20402597_10-02-2025_12_47_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20402597 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20402597 AND mptpi.`type`=4230 To do Qualite : 0.18707302247293373 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20404181_10-02-2025_14_33_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20404181 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20404181 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20404182 order by id desc limit 1 Qualite : 0.24256398886930103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20404183_10-02-2025_14_17_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20404183 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20404183 AND mptpi.`type`=4230 To do Qualite : 0.24593212128082215 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20404184_10-02-2025_14_15_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20404184 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20404184 AND mptpi.`type`=4230 To do Qualite : 0.1931657574185144 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20406214_10-02-2025_15_17_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20406214 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20406214 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20407528 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20407529 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20407530 order by id desc limit 1 Qualite : 0.19076758619613052 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20407531_10-02-2025_15_48_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20407531 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20407531 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20407532 order by id desc limit 1 Qualite : 0.19477289041868498 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20408736_10-02-2025_16_17_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20408736 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20408736 AND mptpi.`type`=4230 To do Qualite : 0.19823456819653626 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20408737_10-02-2025_16_32_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20408737 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20408737 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409931 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409932 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409933 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409934 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409935 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409936 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409937 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409938 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409939 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409952 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409965 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409966 order by id desc limit 1 Qualite : 0.23387791603237645 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20409967_10-02-2025_16_47_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409967 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20409967 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20409968 order by id desc limit 1 Qualite : 0.2176467191961314 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20415723_10-02-2025_21_22_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20415723 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20415723 AND mptpi.`type`=4230 To do Qualite : 0.19383890763343226 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20415724_10-02-2025_20_48_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20415724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20415724 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20411225 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20411226 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20411227 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20411228 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20411229 order by id desc limit 1 Qualite : 0.12786421795977349 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20411230_10-02-2025_17_32_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20411230 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20411230 AND mptpi.`type`=4230 To do Qualite : 0.1820284055376528 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20411231_10-02-2025_17_17_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20411231 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20411231 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414518 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414519 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414520 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414521 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20412588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20412589 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20412590 order by id desc limit 1 Qualite : 0.17137703988881423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20412591_10-02-2025_17_48_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20412591 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20412591 AND mptpi.`type`=4230 To do Qualite : 0.24645736969852525 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20412592_10-02-2025_17_35_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20412592 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20412592 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20413215 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20413216 order by id desc limit 1 Qualite : 0.16731784552960752 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20413217_10-02-2025_18_34_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20413217 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20413217 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20413218 order by id desc limit 1 Qualite : 0.17117586894921286 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20413219_10-02-2025_18_19_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20413219 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20413219 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414522 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414523 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414524 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414525 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414526 order by id desc limit 1 Qualite : 0.17529224132018398 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20414527_10-02-2025_18_52_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20414527 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20414527 AND mptpi.`type`=4230 To do Qualite : 0.26397665981018675 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20415725_10-02-2025_19_32_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20415725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20415725 AND mptpi.`type`=4230 To do Qualite : 0.28135115983410103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20415726_10-02-2025_19_17_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20415726 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20415726 AND mptpi.`type`=4230 To do Qualite : 0.19575669186025568 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20415727_10-02-2025_20_33_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20415727 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20415727 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20421979 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20421980 order by id desc limit 1 Qualite : 0.21934976660559524 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20421981_10-02-2025_23_23_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20421981 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20421981 AND mptpi.`type`=4230 To do Qualite : 0.17243178524849828 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20416894_10-02-2025_20_22_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20416894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20416894 AND mptpi.`type`=4230 To do Qualite : 0.20290222051769696 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20416895_10-02-2025_19_57_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20416895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20416895 AND mptpi.`type`=4230 To do Qualite : 0.189507212659159 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20421982_10-02-2025_23_21_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20421982 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20421982 AND mptpi.`type`=4230 To do Qualite : 0.24658283590841007 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20421983_10-02-2025_22_44_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20421983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20421983 AND mptpi.`type`=4230 To do Qualite : 0.2237163994395726 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20421984_10-02-2025_22_34_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20421984 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20421984 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10022025': {'nb_upload': 6, 'nb_taggue_class': 6, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1336563185, 1336563147, 1336563145, 1336563141, 1336563138] Looping around the photos to save general results len do output : 1 /20421981Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563185', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563147', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563145', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563141', None, None, None, None, None, '2574023') ('4234', None, None, None, None, None, None, None, '2574023') ('4234', '20421981', '1336563138', None, None, None, None, None, '2574023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01586174964904785 save_final save missing photos in datou_result : time spend for datou_step_exec : 34.096601247787476 time spend to save output : 0.016105175018310547 total time spend for step 11 : 34.112706422805786 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 55.37user 31.33system 4:13.33elapsed 34%CPU (0avgtext+0avgdata 2509080maxresident)k 840inputs+20808outputs (1major+2444476minor)pagefaults 0swaps