python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 420747 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 8>5 please execute split_portfolio.py -i 21013624 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2633176'] with mtr_portfolio_ids : ['21013624'] and first list_photo_ids : [] new path : /proc/420747/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.831439733505249 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Mar 4 16:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-04 16:20:32.317102: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-04 16:20:32.347066: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-04 16:20:32.348851: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff9f8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-04 16:20:32.348896: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-04 16:20:32.351939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-04 16:20:32.590003: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x298e6b60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-04 16:20:32.590051: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-04 16:20:32.591501: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-04 16:20:32.595334: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-04 16:20:32.598940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-04 16:20:32.601303: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-04 16:20:32.601660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-04 16:20:32.604342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-04 16:20:32.605783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-04 16:20:32.610947: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-04 16:20:32.612376: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-04 16:20:32.612441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-04 16:20:32.613202: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-04 16:20:32.613217: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-04 16:20:32.613226: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-04 16:20:32.614596: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-04 16:20:32.875067: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-04 16:20:32.875168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-04 16:20:32.875199: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-04 16:20:32.875228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-04 16:20:32.875255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-04 16:20:32.875282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-04 16:20:32.875309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-04 16:20:32.875337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-04 16:20:32.876752: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-04 16:20:32.877809: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-04 16:20:32.877837: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-04 16:20:32.877853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-04 16:20:32.877867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-04 16:20:32.877881: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-04 16:20:32.877894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-04 16:20:32.877908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-04 16:20:32.877922: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-04 16:20:32.879231: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-04 16:20:32.879260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-04 16:20:32.879268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-04 16:20:32.879276: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-04 16:20:32.880618: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-04 16:20:40.338242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-04 16:20:40.518284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.05156 max: 149.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0008816719055175781 length of segment : 30 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002808570861816406 length of segment : 24 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 677 time to create 1 rle with old method : 0.0012917518615722656 length of segment : 60 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0010759830474853516 length of segment : 70 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.72344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003705024719238281 length of segment : 14 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004367828369140625 length of segment : 27 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -79.98125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0003237724304199219 nb_pixel_total : 6880 time to create 1 rle with old method : 0.011557579040527344 length of segment : 108 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0014700889587402344 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.00469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005762577056884766 length of segment : 24 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00027179718017578125 length of segment : 9 time for calcul the mask position with numpy : 0.00012946128845214844 nb_pixel_total : 3910 time to create 1 rle with old method : 0.005491971969604492 length of segment : 109 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 4967 time to create 1 rle with old method : 0.007452726364135742 length of segment : 121 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002682209014892578 length of segment : 18 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 115.76406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007762908935546875 length of segment : 16 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 812 time to create 1 rle with old method : 0.0011935234069824219 length of segment : 83 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 3121 time to create 1 rle with old method : 0.0048639774322509766 length of segment : 62 time for calcul the mask position with numpy : 0.0006902217864990234 nb_pixel_total : 51672 time to create 1 rle with old method : 0.07317543029785156 length of segment : 278 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 177.00000 molded_images shape: (1, 640, 640, 3) min: -91.13047 max: 55.64141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012919902801513672 nb_pixel_total : 152904 time to create 1 rle with new method : 0.0019404888153076172 length of segment : 398 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -110.63750 max: 129.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0015969276428222656 length of segment : 36 time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 25080 time to create 1 rle with old method : 0.03821849822998047 length of segment : 302 time for calcul the mask position with numpy : 0.0002551078796386719 nb_pixel_total : 5422 time to create 1 rle with old method : 0.007997751235961914 length of segment : 235 time for calcul the mask position with numpy : 0.0003540515899658203 nb_pixel_total : 21608 time to create 1 rle with old method : 0.024512767791748047 length of segment : 235 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.41094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00021004676818847656 nb_pixel_total : 3888 time to create 1 rle with old method : 0.005037784576416016 length of segment : 114 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002491474151611328 length of segment : 12 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001614093780517578 length of segment : 11 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 3718 time to create 1 rle with old method : 0.0047490596771240234 length of segment : 70 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.33672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 1495 time to create 1 rle with old method : 0.002515077590942383 length of segment : 104 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 25890 time to create 1 rle with old method : 0.029862403869628906 length of segment : 186 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003612041473388672 length of segment : 21 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0007274150848388672 length of segment : 30 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 916 time to create 1 rle with old method : 0.0012543201446533203 length of segment : 31 time for calcul the mask position with numpy : 0.0002951622009277344 nb_pixel_total : 13607 time to create 1 rle with old method : 0.016933202743530273 length of segment : 190 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0006487369537353516 length of segment : 25 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 1904 time to create 1 rle with old method : 0.0036797523498535156 length of segment : 154 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1461 time to create 1 rle with old method : 0.0018167495727539062 length of segment : 74 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 1320 time to create 1 rle with old method : 0.0018222332000732422 length of segment : 103 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 173.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 43.57500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 119.61172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 3220 time to create 1 rle with old method : 0.003946065902709961 length of segment : 49 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.00046515464782714844 length of segment : 14 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1136 time to create 1 rle with old method : 0.0015752315521240234 length of segment : 34 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 5217 time to create 1 rle with old method : 0.006482601165771484 length of segment : 79 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00037550926208496094 length of segment : 25 time for calcul the mask position with numpy : 0.00010132789611816406 nb_pixel_total : 3705 time to create 1 rle with old method : 0.004665374755859375 length of segment : 102 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 847 time to create 1 rle with old method : 0.0010890960693359375 length of segment : 43 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.53359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0006480216979980469 length of segment : 28 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002899169921875 length of segment : 18 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 603 time to create 1 rle with old method : 0.0008130073547363281 length of segment : 50 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0007297992706298828 length of segment : 32 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00015735626220703125 length of segment : 11 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006422996520996094 length of segment : 29 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 977 time to create 1 rle with old method : 0.0013175010681152344 length of segment : 49 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1058 time to create 1 rle with old method : 0.0014009475708007812 length of segment : 46 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005469322204589844 length of segment : 23 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00022077560424804688 length of segment : 14 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003998279571533203 length of segment : 18 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002524852752685547 length of segment : 17 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00045037269592285156 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.00048422813415527344 length of segment : 26 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005204677581787109 length of segment : 28 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005736351013183594 length of segment : 26 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 2043 time to create 1 rle with old method : 0.0025844573974609375 length of segment : 84 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.000926971435546875 length of segment : 29 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1408 time to create 1 rle with old method : 0.0019905567169189453 length of segment : 24 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.0002205371856689453 length of segment : 28 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1195 time to create 1 rle with old method : 0.0015363693237304688 length of segment : 57 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1030 time to create 1 rle with old method : 0.0013263225555419922 length of segment : 51 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.00016164779663085938 length of segment : 9 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00015807151794433594 length of segment : 27 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 127.63750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0014729499816894531 length of segment : 114 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.0010905265808105469 length of segment : 127 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.39922 max: 149.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0006113052368164062 length of segment : 35 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 40 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001747608184814453 length of segment : 23 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1079 time to create 1 rle with old method : 0.001573324203491211 length of segment : 64 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00016427040100097656 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.72344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 1671 time to create 1 rle with old method : 0.003197193145751953 length of segment : 33 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004112720489501953 length of segment : 27 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 1642 time to create 1 rle with old method : 0.0022017955780029297 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -95.81719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00014853477478027344 nb_pixel_total : 4027 time to create 1 rle with old method : 0.004901409149169922 length of segment : 61 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1028 time to create 1 rle with old method : 0.0014109611511230469 length of segment : 29 time for calcul the mask position with numpy : 0.00031375885009765625 nb_pixel_total : 24312 time to create 1 rle with old method : 0.030099868774414062 length of segment : 217 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.14141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002498626708984375 length of segment : 22 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005548000335693359 length of segment : 23 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 5776 time to create 1 rle with old method : 0.007474422454833984 length of segment : 115 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00019478797912597656 length of segment : 10 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 236.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 121.83437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0007419586181640625 length of segment : 18 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002574920654296875 length of segment : 27 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006883144378662109 length of segment : 83 time for calcul the mask position with numpy : 0.0007116794586181641 nb_pixel_total : 69833 time to create 1 rle with old method : 0.08127021789550781 length of segment : 294 time for calcul the mask position with numpy : 0.0007522106170654297 nb_pixel_total : 65612 time to create 1 rle with old method : 0.07340312004089355 length of segment : 280 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 171.00000 molded_images shape: (1, 640, 640, 3) min: -84.46172 max: 47.43828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.00469 max: 135.48281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 1193 time to create 1 rle with old method : 0.002431631088256836 length of segment : 37 time for calcul the mask position with numpy : 0.00028634071350097656 nb_pixel_total : 15594 time to create 1 rle with old method : 0.018645048141479492 length of segment : 287 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0008516311645507812 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -99.82109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00016689300537109375 nb_pixel_total : 6349 time to create 1 rle with old method : 0.007717609405517578 length of segment : 73 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 3835 time to create 1 rle with old method : 0.004656076431274414 length of segment : 76 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.87969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00011920928955078125 nb_pixel_total : 1688 time to create 1 rle with old method : 0.0032911300659179688 length of segment : 111 time for calcul the mask position with numpy : 0.0005781650543212891 nb_pixel_total : 26243 time to create 1 rle with old method : 0.03683829307556152 length of segment : 192 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 784 time to create 1 rle with old method : 0.0011496543884277344 length of segment : 26 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0008757114410400391 length of segment : 30 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.001184701919555664 length of segment : 30 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 2252 time to create 1 rle with old method : 0.002757549285888672 length of segment : 131 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.17656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1369 time to create 1 rle with old method : 0.0017557144165039062 length of segment : 84 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 1662 time to create 1 rle with old method : 0.002903461456298828 length of segment : 75 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 979 time to create 1 rle with old method : 0.0014154911041259766 length of segment : 91 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.0015902519226074219 length of segment : 34 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005381107330322266 length of segment : 36 Processing 1 images image shape: (280, 400, 3) min: 3.00000 max: 166.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 42.51250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008473396301269531 nb_pixel_total : 105195 time to create 1 rle with old method : 0.1372690200805664 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 118.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 3019 time to create 1 rle with old method : 0.0039000511169433594 length of segment : 48 time for calcul the mask position with numpy : 0.00013446807861328125 nb_pixel_total : 5680 time to create 1 rle with old method : 0.007044076919555664 length of segment : 89 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004601478576660156 length of segment : 15 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.0011653900146484375 length of segment : 44 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 5025 time to create 1 rle with old method : 0.009357690811157227 length of segment : 75 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 5063 time to create 1 rle with old method : 0.006150722503662109 length of segment : 79 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006401538848876953 length of segment : 25 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004725456237792969 length of segment : 41 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.00046372413635253906 length of segment : 28 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0012218952178955078 length of segment : 32 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.001087188720703125 length of segment : 63 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004818439483642578 length of segment : 21 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 17 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010387897491455078 length of segment : 42 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0009150505065917969 length of segment : 30 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00033664703369140625 length of segment : 18 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006413459777832031 length of segment : 59 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 991 time to create 1 rle with old method : 0.0013206005096435547 length of segment : 67 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005090236663818359 length of segment : 22 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 668 time to create 1 rle with old method : 0.001134634017944336 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.96719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 799 time to create 1 rle with old method : 0.0011408329010009766 length of segment : 31 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0006041526794433594 length of segment : 29 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 20 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003867149353027344 length of segment : 17 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1730 time to create 1 rle with old method : 0.0021278858184814453 length of segment : 51 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 1410 time to create 1 rle with old method : 0.0020847320556640625 length of segment : 71 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0006470680236816406 length of segment : 28 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00033926963806152344 length of segment : 23 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00017547607421875 length of segment : 20 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00042891502380371094 length of segment : 21 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.82500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00037741661071777344 length of segment : 40 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.05156 max: 149.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0007884502410888672 length of segment : 27 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002808570861816406 length of segment : 31 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0013513565063476562 length of segment : 59 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1278 time to create 1 rle with old method : 0.001964569091796875 length of segment : 69 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 720 time to create 1 rle with old method : 0.0010123252868652344 length of segment : 49 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0009617805480957031 length of segment : 60 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.30938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005254745483398438 length of segment : 31 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.00039005279541015625 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -85.10625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 3843 time to create 1 rle with old method : 0.0048062801361083984 length of segment : 63 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 4688 time to create 1 rle with old method : 0.00564122200012207 length of segment : 63 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 920 time to create 1 rle with old method : 0.0012125968933105469 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.68047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.00052642822265625 length of segment : 23 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 10295 time to create 1 rle with old method : 0.013840436935424805 length of segment : 99 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 4270 time to create 1 rle with old method : 0.005569934844970703 length of segment : 96 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 5161 time to create 1 rle with old method : 0.006322622299194336 length of segment : 106 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 233.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 113.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0010819435119628906 length of segment : 18 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 841 time to create 1 rle with old method : 0.001049041748046875 length of segment : 90 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.0007479190826416016 length of segment : 35 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 634 time to create 1 rle with old method : 0.0008196830749511719 length of segment : 76 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 179.00000 molded_images shape: (1, 640, 640, 3) min: -88.59453 max: 55.80938 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -109.94219 max: 130.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1223 time to create 1 rle with old method : 0.0015232563018798828 length of segment : 38 time for calcul the mask position with numpy : 0.00021195411682128906 nb_pixel_total : 9733 time to create 1 rle with old method : 0.011785268783569336 length of segment : 253 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 18944 time to create 1 rle with old method : 0.023507356643676758 length of segment : 227 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -97.48125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00017642974853515625 nb_pixel_total : 3845 time to create 1 rle with old method : 0.00509333610534668 length of segment : 121 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.75469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.0004470348358154297 nb_pixel_total : 26620 time to create 1 rle with old method : 0.03146481513977051 length of segment : 199 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 1328 time to create 1 rle with old method : 0.0016677379608154297 length of segment : 85 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0004248619079589844 length of segment : 24 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0010197162628173828 length of segment : 32 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 909 time to create 1 rle with old method : 0.0013349056243896484 length of segment : 36 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0007627010345458984 length of segment : 32 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0005862712860107422 length of segment : 24 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 1792 time to create 1 rle with old method : 0.0024862289428710938 length of segment : 117 time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 7577 time to create 1 rle with old method : 0.008973360061645508 length of segment : 221 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.71719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1464 time to create 1 rle with old method : 0.0018243789672851562 length of segment : 73 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 799 time to create 1 rle with old method : 0.0011076927185058594 length of segment : 85 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002589225769042969 length of segment : 22 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.001508474349975586 length of segment : 75 Processing 1 images image shape: (280, 400, 3) min: 1.00000 max: 164.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 41.69609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008704662322998047 nb_pixel_total : 104179 time to create 1 rle with old method : 0.1165916919708252 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 120.73906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 3218 time to create 1 rle with old method : 0.005643129348754883 length of segment : 51 time for calcul the mask position with numpy : 0.0001461505889892578 nb_pixel_total : 5334 time to create 1 rle with old method : 0.009215831756591797 length of segment : 86 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0016257762908935547 length of segment : 41 time for calcul the mask position with numpy : 0.00012826919555664062 nb_pixel_total : 5209 time to create 1 rle with old method : 0.00899505615234375 length of segment : 80 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003886222839355469 length of segment : 23 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00035071372985839844 length of segment : 14 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.77969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0013422966003417969 length of segment : 45 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004940032958984375 length of segment : 28 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001838207244873047 length of segment : 11 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005512237548828125 length of segment : 25 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0011780261993408203 length of segment : 31 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.00047087669372558594 length of segment : 22 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00022649765014648438 length of segment : 11 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.00043392181396484375 length of segment : 26 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004432201385498047 length of segment : 31 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.0001366138458251953 length of segment : 8 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0004894733428955078 length of segment : 17 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0007526874542236328 length of segment : 41 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.00042057037353515625 length of segment : 18 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0011069774627685547 length of segment : 28 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.00022745132446289062 length of segment : 12 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005214214324951172 length of segment : 20 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 754 time to create 1 rle with old method : 0.0010190010070800781 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.89297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0018901824951171875 length of segment : 31 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.001310586929321289 length of segment : 24 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 940 time to create 1 rle with old method : 0.001737356185913086 length of segment : 58 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.00046181678771972656 length of segment : 29 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006277561187744141 length of segment : 26 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 126.20000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0006413459777832031 nb_pixel_total : 33601 time to create 1 rle with old method : 0.05567765235900879 length of segment : 257 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1457 time to create 1 rle with old method : 0.0017852783203125 length of segment : 126 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.75078 max: 149.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005924701690673828 length of segment : 34 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 720 time to create 1 rle with old method : 0.0010099411010742188 length of segment : 57 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.000186920166015625 length of segment : 22 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.0010530948638916016 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.54375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0015764236450195312 length of segment : 30 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1492 time to create 1 rle with old method : 0.0019783973693847656 length of segment : 45 length of segment : 0 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -86.32500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 4464 time to create 1 rle with old method : 0.005631208419799805 length of segment : 69 time for calcul the mask position with numpy : 0.0002675056457519531 nb_pixel_total : 15925 time to create 1 rle with old method : 0.018634319305419922 length of segment : 209 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006554126739501953 length of segment : 28 time for calcul the mask position with numpy : 0.00028777122497558594 nb_pixel_total : 17903 time to create 1 rle with old method : 0.02124500274658203 length of segment : 213 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.95391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0009343624114990234 length of segment : 25 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0004494190216064453 length of segment : 23 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 3911 time to create 1 rle with old method : 0.0063936710357666016 length of segment : 100 time for calcul the mask position with numpy : 0.00010228157043457031 nb_pixel_total : 1060 time to create 1 rle with old method : 0.0016720294952392578 length of segment : 59 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 118.62734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 578 time to create 1 rle with old method : 0.0008001327514648438 length of segment : 20 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 968 time to create 1 rle with old method : 0.0015439987182617188 length of segment : 95 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 649 time to create 1 rle with old method : 0.0008392333984375 length of segment : 84 time for calcul the mask position with numpy : 0.0007236003875732422 nb_pixel_total : 58565 time to create 1 rle with old method : 0.07011032104492188 length of segment : 281 time for calcul the mask position with numpy : 0.0006554126739501953 nb_pixel_total : 68767 time to create 1 rle with old method : 0.07799553871154785 length of segment : 248 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 171.00000 molded_images shape: (1, 640, 640, 3) min: -89.03672 max: 45.59453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -110.63750 max: 128.13359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0015621185302734375 length of segment : 36 time for calcul the mask position with numpy : 0.0003032684326171875 nb_pixel_total : 17792 time to create 1 rle with old method : 0.021022796630859375 length of segment : 224 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009620189666748047 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -99.68828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 4209 time to create 1 rle with old method : 0.004960536956787109 length of segment : 87 time for calcul the mask position with numpy : 0.00017118453979492188 nb_pixel_total : 5570 time to create 1 rle with old method : 0.007311105728149414 length of segment : 80 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0015721321105957031 length of segment : 32 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0008997917175292969 length of segment : 32 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00035643577575683594 length of segment : 32 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0008275508880615234 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.58281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 1509 time to create 1 rle with old method : 0.0018393993377685547 length of segment : 91 time for calcul the mask position with numpy : 0.00041556358337402344 nb_pixel_total : 23477 time to create 1 rle with old method : 0.029938220977783203 length of segment : 222 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.001279592514038086 length of segment : 31 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007464885711669922 length of segment : 33 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0004496574401855469 length of segment : 18 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0012905597686767578 length of segment : 81 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 89 time to create 1 rle with old method : 0.0004057884216308594 length of segment : 13 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0004954338073730469 length of segment : 24 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1185 time to create 1 rle with old method : 0.0016033649444580078 length of segment : 33 time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 13687 time to create 1 rle with old method : 0.017049074172973633 length of segment : 142 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 1525 time to create 1 rle with old method : 0.001916646957397461 length of segment : 132 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1590 time to create 1 rle with old method : 0.0020592212677001953 length of segment : 75 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.0011470317840576172 length of segment : 34 time for calcul the mask position with numpy : 0.00012254714965820312 nb_pixel_total : 2663 time to create 1 rle with old method : 0.0034437179565429688 length of segment : 184 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002741813659667969 length of segment : 23 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 1011 time to create 1 rle with old method : 0.0015480518341064453 length of segment : 90 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 166.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 43.63359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.000995635986328125 nb_pixel_total : 105009 time to create 1 rle with old method : 0.11904716491699219 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 117.04766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0006525516510009766 length of segment : 16 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 3132 time to create 1 rle with old method : 0.0056035518646240234 length of segment : 54 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.0003216266632080078 length of segment : 14 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.000507354736328125 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.44766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005116462707519531 length of segment : 21 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 610 time to create 1 rle with old method : 0.0008456707000732422 length of segment : 29 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004744529724121094 length of segment : 28 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00014925003051757812 length of segment : 12 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00021314620971679688 length of segment : 12 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1322 time to create 1 rle with old method : 0.001707315444946289 length of segment : 45 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015044212341308594 length of segment : 8 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00022077560424804688 length of segment : 14 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004887580871582031 length of segment : 22 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00031757354736328125 length of segment : 23 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006365776062011719 length of segment : 28 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 592 time to create 1 rle with old method : 0.0008270740509033203 length of segment : 43 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.0001399517059326172 length of segment : 11 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.55703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0012416839599609375 length of segment : 37 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 32 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.00033593177795410156 length of segment : 21 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1553 time to create 1 rle with old method : 0.002135038375854492 length of segment : 87 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00018334388732910156 length of segment : 26 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005562305450439453 length of segment : 25 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0007219314575195312 length of segment : 32 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006635189056396484 length of segment : 41 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.13750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0005090236663818359 nb_pixel_total : 32805 time to create 1 rle with old method : 0.052584171295166016 length of segment : 216 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.73125 max: 148.67812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.000591278076171875 length of segment : 38 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001881122589111328 length of segment : 27 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0010068416595458984 length of segment : 56 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 850 time to create 1 rle with old method : 0.0011050701141357422 length of segment : 46 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1392 time to create 1 rle with old method : 0.0019378662109375 length of segment : 80 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0010349750518798828 length of segment : 56 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 2084 time to create 1 rle with old method : 0.0027608871459960938 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.47734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 1497 time to create 1 rle with old method : 0.0032813549041748047 length of segment : 32 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 4710 time to create 1 rle with old method : 0.008309125900268555 length of segment : 71 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -86.27813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 4958 time to create 1 rle with old method : 0.006140947341918945 length of segment : 90 time for calcul the mask position with numpy : 0.0001819133758544922 nb_pixel_total : 10593 time to create 1 rle with old method : 0.012640714645385742 length of segment : 262 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.12188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004696846008300781 length of segment : 21 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0002665519714355469 length of segment : 25 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0012688636779785156 length of segment : 50 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00018835067749023438 length of segment : 9 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 245.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 122.37344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002853870391845703 length of segment : 23 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0007417201995849609 length of segment : 16 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.000537872314453125 length of segment : 25 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 684 time to create 1 rle with old method : 0.0008647441864013672 length of segment : 74 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0003371238708496094 length of segment : 22 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.0011768341064453125 length of segment : 50 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0007109642028808594 length of segment : 17 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0004451274871826172 length of segment : 58 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 171.00000 molded_images shape: (1, 640, 640, 3) min: -85.66094 max: 44.95000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -110.80000 max: 128.13359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 1190 time to create 1 rle with old method : 0.0027313232421875 length of segment : 36 time for calcul the mask position with numpy : 0.0002570152282714844 nb_pixel_total : 9458 time to create 1 rle with old method : 0.011638402938842773 length of segment : 236 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -97.55938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 3284 time to create 1 rle with old method : 0.0045282840728759766 length of segment : 61 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.77813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.000461578369140625 nb_pixel_total : 26350 time to create 1 rle with old method : 0.03929305076599121 length of segment : 200 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 1517 time to create 1 rle with old method : 0.0018954277038574219 length of segment : 102 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 962 time to create 1 rle with old method : 0.0018069744110107422 length of segment : 31 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0010266304016113281 length of segment : 47 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.0006184577941894531 length of segment : 19 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 65 time to create 1 rle with old method : 0.00015354156494140625 length of segment : 13 time for calcul the mask position with numpy : 0.0002872943878173828 nb_pixel_total : 3286 time to create 1 rle with old method : 0.005525112152099609 length of segment : 167 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0005826950073242188 length of segment : 27 time for calcul the mask position with numpy : 0.0002281665802001953 nb_pixel_total : 3601 time to create 1 rle with old method : 0.004395246505737305 length of segment : 153 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.18203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0010991096496582031 length of segment : 74 Processing 1 images image shape: (280, 400, 3) min: 7.00000 max: 170.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 44.44609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009765625 nb_pixel_total : 104143 time to create 1 rle with old method : 0.11598539352416992 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 118.04922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005052089691162109 length of segment : 34 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.00047850608825683594 length of segment : 15 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 843 time to create 1 rle with old method : 0.0011169910430908203 length of segment : 42 time for calcul the mask position with numpy : 0.0001430511474609375 nb_pixel_total : 5295 time to create 1 rle with old method : 0.006598472595214844 length of segment : 80 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 3121 time to create 1 rle with old method : 0.004007816314697266 length of segment : 50 time for calcul the mask position with numpy : 0.00014472007751464844 nb_pixel_total : 5207 time to create 1 rle with old method : 0.006371736526489258 length of segment : 90 time for calcul the mask position with numpy : 0.00011396408081054688 nb_pixel_total : 4213 time to create 1 rle with old method : 0.005105257034301758 length of segment : 74 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.0002334117889404297 length of segment : 14 time for calcul the mask position with numpy : 0.00012803077697753906 nb_pixel_total : 5066 time to create 1 rle with old method : 0.006418943405151367 length of segment : 83 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.13906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00020241737365722656 length of segment : 11 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0007536411285400391 length of segment : 29 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.00047087669372558594 length of segment : 28 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00032711029052734375 length of segment : 16 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005462169647216797 length of segment : 22 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 929 time to create 1 rle with old method : 0.001336812973022461 length of segment : 27 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.00042128562927246094 length of segment : 15 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 21 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0002608299255371094 length of segment : 13 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1360 time to create 1 rle with old method : 0.0017807483673095703 length of segment : 46 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003829002380371094 length of segment : 23 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0006680488586425781 length of segment : 21 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0013272762298583984 length of segment : 48 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.00045752525329589844 length of segment : 23 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006816387176513672 length of segment : 29 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.00034332275390625 length of segment : 17 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0018367767333984375 length of segment : 50 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006432533264160156 length of segment : 62 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005428791046142578 length of segment : 20 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 679 time to create 1 rle with old method : 0.0009169578552246094 length of segment : 39 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.00036334991455078125 length of segment : 18 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007293224334716797 length of segment : 40 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.000728607177734375 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.72109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 833 time to create 1 rle with old method : 0.0011456012725830078 length of segment : 31 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0006861686706542969 length of segment : 27 time for calcul the mask position with numpy : 0.00012183189392089844 nb_pixel_total : 973 time to create 1 rle with old method : 0.0014340877532958984 length of segment : 74 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 2068 time to create 1 rle with old method : 0.0027387142181396484 length of segment : 49 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0015234947204589844 length of segment : 27 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005218982696533203 length of segment : 27 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0008566379547119141 length of segment : 27 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0007789134979248047 length of segment : 34 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 1577 time to create 1 rle with old method : 0.003084421157836914 length of segment : 45 time for calcul the mask position with numpy : 0.00010442733764648438 nb_pixel_total : 352 time to create 1 rle with old method : 0.0008625984191894531 length of segment : 25 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.13750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 607 time to create 1 rle with old method : 0.001188516616821289 length of segment : 89 time for calcul the mask position with numpy : 0.0005927085876464844 nb_pixel_total : 33945 time to create 1 rle with old method : 0.05761146545410156 length of segment : 244 Detection mask done ! Trying to reset tf kernel 421120 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 358 len(list_Values) 358 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 358 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 358 chid ids of type : 4228 Number RLEs to save : 22498 save missing photos in datou_result : time spend for datou_step_exec : 32.24539232254028 time spend to save output : 1.5475480556488037 total time spend for step 1 : 33.79294037818909 step2:brightness Tue Mar 4 16:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741101628_420747_1340813239_8757c740c52440389eb9bf16bd5bc6a5.jpg treat image : temp/1741101628_420747_1340813235_05d0c6773c2606f72551d0e25f36775c.jpg treat image : temp/1741101628_420747_1340813015_71ed9fca5231366f5d3e00eaa1112081.jpg treat image : temp/1741101628_420747_1340812949_a0e11414de9150c177185b0730c47d1d.jpg treat image : temp/1741101628_420747_1340812947_e46cf2c7242d790ea306a5335b0f5185.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.013733863830566406 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.011849641799926758 save missing photos in datou_result : time spend for datou_step_exec : 1.4558706283569336 time spend to save output : 0.030257225036621094 total time spend for step 2 : 1.4861278533935547 step3:blur_detection Tue Mar 4 16:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741101628_420747_1340813239_8757c740c52440389eb9bf16bd5bc6a5.jpg resize: (1080, 1920) 1340813239 -7.312883630548382 treat image : temp/1741101628_420747_1340813235_05d0c6773c2606f72551d0e25f36775c.jpg resize: (1080, 1920) 1340813235 -7.3109003095802105 treat image : temp/1741101628_420747_1340813015_71ed9fca5231366f5d3e00eaa1112081.jpg resize: (1080, 1920) 1340813015 -7.339928881017838 treat image : temp/1741101628_420747_1340812949_a0e11414de9150c177185b0730c47d1d.jpg resize: (1080, 1920) 1340812949 -7.328886511865396 treat image : temp/1741101628_420747_1340812947_e46cf2c7242d790ea306a5335b0f5185.jpg resize: (1080, 1920) 1340812947 -7.291991854439329 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.012804269790649414 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.012472391128540039 save missing photos in datou_result : time spend for datou_step_exec : 6.212693691253662 time spend to save output : 0.030942440032958984 total time spend for step 3 : 6.243636131286621 step4:rle_unique_nms_with_priority Tue Mar 4 16:21:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 358 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 70 nb_hashtags : 6 time to prepare the origin masks : 1.1975185871124268 time for calcul the mask position with numpy : 0.06367921829223633 nb_pixel_total : 1750389 time to create 1 rle with new method : 0.10783267021179199 time for calcul the mask position with numpy : 0.00887155532836914 nb_pixel_total : 6880 time to create 1 rle with old method : 0.007904052734375 time for calcul the mask position with numpy : 0.008693695068359375 nb_pixel_total : 677 time to create 1 rle with old method : 0.0007655620574951172 time for calcul the mask position with numpy : 0.009525299072265625 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005176067352294922 time for calcul the mask position with numpy : 0.008723974227905273 nb_pixel_total : 121 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.008627891540527344 nb_pixel_total : 322 time to create 1 rle with old method : 0.0003666877746582031 time for calcul the mask position with numpy : 0.008596420288085938 nb_pixel_total : 34 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.008619308471679688 nb_pixel_total : 13 time to create 1 rle with old method : 2.47955322265625e-05 time for calcul the mask position with numpy : 0.008707523345947266 nb_pixel_total : 51487 time to create 1 rle with old method : 0.05649971961975098 time for calcul the mask position with numpy : 0.008534908294677734 nb_pixel_total : 812 time to create 1 rle with old method : 0.0008776187896728516 time for calcul the mask position with numpy : 0.008416175842285156 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002276897430419922 time for calcul the mask position with numpy : 0.008292913436889648 nb_pixel_total : 161 time to create 1 rle with old method : 0.0001971721649169922 time for calcul the mask position with numpy : 0.00826883316040039 nb_pixel_total : 126 time to create 1 rle with old method : 0.00015664100646972656 time for calcul the mask position with numpy : 0.00822758674621582 nb_pixel_total : 724 time to create 1 rle with old method : 0.0008611679077148438 time for calcul the mask position with numpy : 0.007899045944213867 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004203319549560547 time for calcul the mask position with numpy : 0.008159160614013672 nb_pixel_total : 3121 time to create 1 rle with old method : 0.003412008285522461 time for calcul the mask position with numpy : 0.00809025764465332 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0016667842864990234 time for calcul the mask position with numpy : 0.008131027221679688 nb_pixel_total : 3910 time to create 1 rle with old method : 0.004442930221557617 time for calcul the mask position with numpy : 0.008148431777954102 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005550384521484375 time for calcul the mask position with numpy : 0.009334564208984375 nb_pixel_total : 152904 time to create 1 rle with new method : 0.2720801830291748 time for calcul the mask position with numpy : 0.008439064025878906 nb_pixel_total : 916 time to create 1 rle with old method : 0.0011119842529296875 time for calcul the mask position with numpy : 0.008523702621459961 nb_pixel_total : 288 time to create 1 rle with old method : 0.000415802001953125 time for calcul the mask position with numpy : 0.008554220199584961 nb_pixel_total : 23891 time to create 1 rle with old method : 0.026074647903442383 time for calcul the mask position with numpy : 0.008800506591796875 nb_pixel_total : 25890 time to create 1 rle with old method : 0.02921271324157715 time for calcul the mask position with numpy : 0.008824586868286133 nb_pixel_total : 3888 time to create 1 rle with old method : 0.00449371337890625 time for calcul the mask position with numpy : 0.008678674697875977 nb_pixel_total : 737 time to create 1 rle with old method : 0.0010280609130859375 time for calcul the mask position with numpy : 0.008640050888061523 nb_pixel_total : 5 time to create 1 rle with old method : 5.507469177246094e-05 time for calcul the mask position with numpy : 0.00901174545288086 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002110004425048828 time for calcul the mask position with numpy : 0.008861780166625977 nb_pixel_total : 5422 time to create 1 rle with old method : 0.0064013004302978516 time for calcul the mask position with numpy : 0.00890040397644043 nb_pixel_total : 3699 time to create 1 rle with old method : 0.004540205001831055 time for calcul the mask position with numpy : 0.009303092956542969 nb_pixel_total : 1904 time to create 1 rle with old method : 0.0023186206817626953 time for calcul the mask position with numpy : 0.008634567260742188 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004849433898925781 time for calcul the mask position with numpy : 0.008700370788574219 nb_pixel_total : 1495 time to create 1 rle with old method : 0.0019223690032958984 time for calcul the mask position with numpy : 0.009559869766235352 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0014100074768066406 time for calcul the mask position with numpy : 0.008735418319702148 nb_pixel_total : 97 time to create 1 rle with old method : 0.00013899803161621094 time for calcul the mask position with numpy : 0.008877277374267578 nb_pixel_total : 1461 time to create 1 rle with old method : 0.0016870498657226562 time for calcul the mask position with numpy : 0.009012699127197266 nb_pixel_total : 245 time to create 1 rle with old method : 0.0005059242248535156 time for calcul the mask position with numpy : 0.009159088134765625 nb_pixel_total : 499 time to create 1 rle with old method : 0.0007078647613525391 time for calcul the mask position with numpy : 0.00880289077758789 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0016102790832519531 time for calcul the mask position with numpy : 0.009452581405639648 nb_pixel_total : 32 time to create 1 rle with old method : 0.00016689300537109375 time for calcul the mask position with numpy : 0.008783578872680664 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002033710479736328 time for calcul the mask position with numpy : 0.00921940803527832 nb_pixel_total : 1136 time to create 1 rle with old method : 0.0014421939849853516 time for calcul the mask position with numpy : 0.008619070053100586 nb_pixel_total : 360 time to create 1 rle with old method : 0.0006313323974609375 time for calcul the mask position with numpy : 0.008632421493530273 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005519390106201172 time for calcul the mask position with numpy : 0.008579015731811523 nb_pixel_total : 3220 time to create 1 rle with old method : 0.0035774707794189453 time for calcul the mask position with numpy : 0.008526802062988281 nb_pixel_total : 529 time to create 1 rle with old method : 0.0006129741668701172 time for calcul the mask position with numpy : 0.008450984954833984 nb_pixel_total : 977 time to create 1 rle with old method : 0.0011317729949951172 time for calcul the mask position with numpy : 0.008938312530517578 nb_pixel_total : 134 time to create 1 rle with old method : 0.00022220611572265625 time for calcul the mask position with numpy : 0.008590936660766602 nb_pixel_total : 135 time to create 1 rle with old method : 0.000171661376953125 time for calcul the mask position with numpy : 0.008404254913330078 nb_pixel_total : 5217 time to create 1 rle with old method : 0.005796194076538086 time for calcul the mask position with numpy : 0.00846719741821289 nb_pixel_total : 108 time to create 1 rle with old method : 0.000148773193359375 time for calcul the mask position with numpy : 0.008678197860717773 nb_pixel_total : 3705 time to create 1 rle with old method : 0.004297018051147461 time for calcul the mask position with numpy : 0.008700132369995117 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002224445343017578 time for calcul the mask position with numpy : 0.008888483047485352 nb_pixel_total : 275 time to create 1 rle with old method : 0.00035572052001953125 time for calcul the mask position with numpy : 0.008566856384277344 nb_pixel_total : 4 time to create 1 rle with old method : 2.9325485229492188e-05 time for calcul the mask position with numpy : 0.008666038513183594 nb_pixel_total : 57 time to create 1 rle with old method : 9.179115295410156e-05 time for calcul the mask position with numpy : 0.008594274520874023 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004470348358154297 time for calcul the mask position with numpy : 0.008959054946899414 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005071163177490234 time for calcul the mask position with numpy : 0.008744955062866211 nb_pixel_total : 1408 time to create 1 rle with old method : 0.001697540283203125 time for calcul the mask position with numpy : 0.011338472366333008 nb_pixel_total : 98 time to create 1 rle with old method : 0.00019168853759765625 time for calcul the mask position with numpy : 0.009296894073486328 nb_pixel_total : 847 time to create 1 rle with old method : 0.0010764598846435547 time for calcul the mask position with numpy : 0.008733510971069336 nb_pixel_total : 79 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.008678197860717773 nb_pixel_total : 2043 time to create 1 rle with old method : 0.002300262451171875 time for calcul the mask position with numpy : 0.008676528930664062 nb_pixel_total : 254 time to create 1 rle with old method : 0.00031757354736328125 time for calcul the mask position with numpy : 0.0086212158203125 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004215240478515625 time for calcul the mask position with numpy : 0.008637189865112305 nb_pixel_total : 305 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.009208440780639648 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004794597625732422 time for calcul the mask position with numpy : 0.008968353271484375 nb_pixel_total : 1195 time to create 1 rle with old method : 0.0014154911041259766 time for calcul the mask position with numpy : 0.008668661117553711 nb_pixel_total : 42 time to create 1 rle with old method : 6.413459777832031e-05 time for calcul the mask position with numpy : 0.008870601654052734 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007712841033935547 time for calcul the mask position with numpy : 0.008740663528442383 nb_pixel_total : 603 time to create 1 rle with old method : 0.0007064342498779297 create new chi : 1.27189302444458 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.015338420867919922 batch 1 Loaded 71 chid ids of type : 4230 Number RLEs to save : 9200 TO DO : save crop sub photo not yet done ! save time : 0.5642671585083008 nb_obj : 67 nb_hashtags : 6 time to prepare the origin masks : 1.9302289485931396 time for calcul the mask position with numpy : 0.03599858283996582 nb_pixel_total : 1761627 time to create 1 rle with new method : 0.1078641414642334 time for calcul the mask position with numpy : 0.008077859878540039 nb_pixel_total : 69797 time to create 1 rle with old method : 0.09627151489257812 time for calcul the mask position with numpy : 0.008558511734008789 nb_pixel_total : 141 time to create 1 rle with old method : 0.00020551681518554688 time for calcul the mask position with numpy : 0.008172988891601562 nb_pixel_total : 86 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.00861668586730957 nb_pixel_total : 301 time to create 1 rle with old method : 0.00035953521728515625 time for calcul the mask position with numpy : 0.008398294448852539 nb_pixel_total : 1079 time to create 1 rle with old method : 0.0012798309326171875 time for calcul the mask position with numpy : 0.008081436157226562 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005271434783935547 time for calcul the mask position with numpy : 0.008039712905883789 nb_pixel_total : 31 time to create 1 rle with old method : 8.249282836914062e-05 time for calcul the mask position with numpy : 0.008008480072021484 nb_pixel_total : 4027 time to create 1 rle with old method : 0.005286216735839844 time for calcul the mask position with numpy : 0.008290529251098633 nb_pixel_total : 1642 time to create 1 rle with old method : 0.0019216537475585938 time for calcul the mask position with numpy : 0.008836984634399414 nb_pixel_total : 5121 time to create 1 rle with old method : 0.0060732364654541016 time for calcul the mask position with numpy : 0.00791621208190918 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006234645843505859 time for calcul the mask position with numpy : 0.007806539535522461 nb_pixel_total : 1671 time to create 1 rle with old method : 0.0021796226501464844 time for calcul the mask position with numpy : 0.008113861083984375 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002238750457763672 time for calcul the mask position with numpy : 0.007753133773803711 nb_pixel_total : 90 time to create 1 rle with old method : 0.00014710426330566406 time for calcul the mask position with numpy : 0.007605552673339844 nb_pixel_total : 1028 time to create 1 rle with old method : 0.0012178421020507812 time for calcul the mask position with numpy : 0.008022308349609375 nb_pixel_total : 395 time to create 1 rle with old method : 0.0004429817199707031 time for calcul the mask position with numpy : 0.0077207088470458984 nb_pixel_total : 24312 time to create 1 rle with old method : 0.026960372924804688 time for calcul the mask position with numpy : 0.007790327072143555 nb_pixel_total : 5776 time to create 1 rle with old method : 0.00644993782043457 time for calcul the mask position with numpy : 0.007706165313720703 nb_pixel_total : 165 time to create 1 rle with old method : 0.00021791458129882812 time for calcul the mask position with numpy : 0.013863086700439453 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006046295166015625 time for calcul the mask position with numpy : 0.007830142974853516 nb_pixel_total : 2252 time to create 1 rle with old method : 0.0026526451110839844 time for calcul the mask position with numpy : 0.007620096206665039 nb_pixel_total : 865 time to create 1 rle with old method : 0.0010025501251220703 time for calcul the mask position with numpy : 0.00772404670715332 nb_pixel_total : 14 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.007633686065673828 nb_pixel_total : 784 time to create 1 rle with old method : 0.0009369850158691406 time for calcul the mask position with numpy : 0.00781702995300293 nb_pixel_total : 26243 time to create 1 rle with old method : 0.030215978622436523 time for calcul the mask position with numpy : 0.007732868194580078 nb_pixel_total : 6349 time to create 1 rle with old method : 0.007189512252807617 time for calcul the mask position with numpy : 0.007962465286254883 nb_pixel_total : 14647 time to create 1 rle with old method : 0.016187667846679688 time for calcul the mask position with numpy : 0.007985830307006836 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005726814270019531 time for calcul the mask position with numpy : 0.007617473602294922 nb_pixel_total : 3835 time to create 1 rle with old method : 0.004490375518798828 time for calcul the mask position with numpy : 0.008327722549438477 nb_pixel_total : 826 time to create 1 rle with old method : 0.0009770393371582031 time for calcul the mask position with numpy : 0.007518768310546875 nb_pixel_total : 1369 time to create 1 rle with old method : 0.0015134811401367188 time for calcul the mask position with numpy : 0.007480144500732422 nb_pixel_total : 133 time to create 1 rle with old method : 0.00022292137145996094 time for calcul the mask position with numpy : 0.007489681243896484 nb_pixel_total : 1688 time to create 1 rle with old method : 0.001790761947631836 time for calcul the mask position with numpy : 0.007268667221069336 nb_pixel_total : 1193 time to create 1 rle with old method : 0.002142190933227539 time for calcul the mask position with numpy : 0.007684469223022461 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0018646717071533203 time for calcul the mask position with numpy : 0.007567167282104492 nb_pixel_total : 655 time to create 1 rle with old method : 0.0007445812225341797 time for calcul the mask position with numpy : 0.008421659469604492 nb_pixel_total : 105195 time to create 1 rle with old method : 0.11470293998718262 time for calcul the mask position with numpy : 0.007521629333496094 nb_pixel_total : 229 time to create 1 rle with old method : 0.00028896331787109375 time for calcul the mask position with numpy : 0.007295846939086914 nb_pixel_total : 260 time to create 1 rle with old method : 0.000324249267578125 time for calcul the mask position with numpy : 0.007431983947753906 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004017353057861328 time for calcul the mask position with numpy : 0.007473468780517578 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005538463592529297 time for calcul the mask position with numpy : 0.007566928863525391 nb_pixel_total : 3019 time to create 1 rle with old method : 0.0032842159271240234 time for calcul the mask position with numpy : 0.007447242736816406 nb_pixel_total : 256 time to create 1 rle with old method : 0.00032639503479003906 time for calcul the mask position with numpy : 0.007548093795776367 nb_pixel_total : 668 time to create 1 rle with old method : 0.0007812976837158203 time for calcul the mask position with numpy : 0.007590532302856445 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.007277250289916992 nb_pixel_total : 313 time to create 1 rle with old method : 0.00040411949157714844 time for calcul the mask position with numpy : 0.007265329360961914 nb_pixel_total : 5025 time to create 1 rle with old method : 0.005637168884277344 time for calcul the mask position with numpy : 0.007470846176147461 nb_pixel_total : 211 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.007325649261474609 nb_pixel_total : 221 time to create 1 rle with old method : 0.00028228759765625 time for calcul the mask position with numpy : 0.0072040557861328125 nb_pixel_total : 771 time to create 1 rle with old method : 0.0009081363677978516 time for calcul the mask position with numpy : 0.007390499114990234 nb_pixel_total : 287 time to create 1 rle with old method : 0.00037288665771484375 time for calcul the mask position with numpy : 0.00743865966796875 nb_pixel_total : 1730 time to create 1 rle with old method : 0.0019736289978027344 time for calcul the mask position with numpy : 0.007475137710571289 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004658699035644531 time for calcul the mask position with numpy : 0.007532596588134766 nb_pixel_total : 587 time to create 1 rle with old method : 0.0006914138793945312 time for calcul the mask position with numpy : 0.00780940055847168 nb_pixel_total : 413 time to create 1 rle with old method : 0.0004811286926269531 time for calcul the mask position with numpy : 0.006242513656616211 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002570152282714844 time for calcul the mask position with numpy : 0.0060460567474365234 nb_pixel_total : 915 time to create 1 rle with old method : 0.0011315345764160156 time for calcul the mask position with numpy : 0.006242275238037109 nb_pixel_total : 862 time to create 1 rle with old method : 0.0009965896606445312 time for calcul the mask position with numpy : 0.006223440170288086 nb_pixel_total : 5680 time to create 1 rle with old method : 0.0064389705657958984 time for calcul the mask position with numpy : 0.006086587905883789 nb_pixel_total : 1358 time to create 1 rle with old method : 0.0016112327575683594 time for calcul the mask position with numpy : 0.0062139034271240234 nb_pixel_total : 110 time to create 1 rle with old method : 0.00014448165893554688 time for calcul the mask position with numpy : 0.006177663803100586 nb_pixel_total : 17 time to create 1 rle with old method : 5.1021575927734375e-05 time for calcul the mask position with numpy : 0.006197214126586914 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004222393035888672 time for calcul the mask position with numpy : 0.006334781646728516 nb_pixel_total : 799 time to create 1 rle with old method : 0.0016100406646728516 time for calcul the mask position with numpy : 0.008228778839111328 nb_pixel_total : 770 time to create 1 rle with old method : 0.0009245872497558594 time for calcul the mask position with numpy : 0.006095409393310547 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003933906555175781 time for calcul the mask position with numpy : 0.00615382194519043 nb_pixel_total : 13 time to create 1 rle with old method : 3.409385681152344e-05 create new chi : 1.0270161628723145 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0015947818756103516 batch 1 Loaded 68 chid ids of type : 4230 Number RLEs to save : 8791 TO DO : save crop sub photo not yet done ! save time : 0.5290384292602539 nb_obj : 65 nb_hashtags : 6 time to prepare the origin masks : 1.4442863464355469 time for calcul the mask position with numpy : 0.09701323509216309 nb_pixel_total : 1819895 time to create 1 rle with new method : 0.0961921215057373 time for calcul the mask position with numpy : 0.006490945816040039 nb_pixel_total : 3843 time to create 1 rle with old method : 0.004401445388793945 time for calcul the mask position with numpy : 0.0060329437255859375 nb_pixel_total : 151 time to create 1 rle with old method : 0.00021576881408691406 time for calcul the mask position with numpy : 0.0062029361724853516 nb_pixel_total : 18 time to create 1 rle with old method : 6.937980651855469e-05 time for calcul the mask position with numpy : 0.006328105926513672 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0015888214111328125 time for calcul the mask position with numpy : 0.006389617919921875 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004298686981201172 time for calcul the mask position with numpy : 0.006440639495849609 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005459785461425781 time for calcul the mask position with numpy : 0.007267951965332031 nb_pixel_total : 142 time to create 1 rle with old method : 0.00018262863159179688 time for calcul the mask position with numpy : 0.008227109909057617 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009205341339111328 time for calcul the mask position with numpy : 0.008810758590698242 nb_pixel_total : 574 time to create 1 rle with old method : 0.0008289813995361328 time for calcul the mask position with numpy : 0.006392955780029297 nb_pixel_total : 841 time to create 1 rle with old method : 0.001031637191772461 time for calcul the mask position with numpy : 0.00624847412109375 nb_pixel_total : 33 time to create 1 rle with old method : 7.343292236328125e-05 time for calcul the mask position with numpy : 0.006647825241088867 nb_pixel_total : 920 time to create 1 rle with old method : 0.0010821819305419922 time for calcul the mask position with numpy : 0.0063915252685546875 nb_pixel_total : 397 time to create 1 rle with old method : 0.00046753883361816406 time for calcul the mask position with numpy : 0.006335020065307617 nb_pixel_total : 4688 time to create 1 rle with old method : 0.005326509475708008 time for calcul the mask position with numpy : 0.006444692611694336 nb_pixel_total : 10295 time to create 1 rle with old method : 0.011626005172729492 time for calcul the mask position with numpy : 0.006400108337402344 nb_pixel_total : 20 time to create 1 rle with old method : 7.128715515136719e-05 time for calcul the mask position with numpy : 0.006372928619384766 nb_pixel_total : 1 time to create 1 rle with old method : 2.5033950805664062e-05 time for calcul the mask position with numpy : 0.006337881088256836 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006239414215087891 time for calcul the mask position with numpy : 0.006360769271850586 nb_pixel_total : 41 time to create 1 rle with old method : 0.00012254714965820312 time for calcul the mask position with numpy : 0.006339550018310547 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007910728454589844 time for calcul the mask position with numpy : 0.006257057189941406 nb_pixel_total : 9733 time to create 1 rle with old method : 0.011140584945678711 time for calcul the mask position with numpy : 0.010603189468383789 nb_pixel_total : 26620 time to create 1 rle with old method : 0.029599905014038086 time for calcul the mask position with numpy : 0.010213136672973633 nb_pixel_total : 8267 time to create 1 rle with old method : 0.009236812591552734 time for calcul the mask position with numpy : 0.009955883026123047 nb_pixel_total : 3845 time to create 1 rle with old method : 0.0045032501220703125 time for calcul the mask position with numpy : 0.010215520858764648 nb_pixel_total : 909 time to create 1 rle with old method : 0.001062154769897461 time for calcul the mask position with numpy : 0.010603666305541992 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002415180206298828 time for calcul the mask position with numpy : 0.010151147842407227 nb_pixel_total : 7577 time to create 1 rle with old method : 0.008503437042236328 time for calcul the mask position with numpy : 0.01038980484008789 nb_pixel_total : 799 time to create 1 rle with old method : 0.0010378360748291016 time for calcul the mask position with numpy : 0.010204553604125977 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002281665802001953 time for calcul the mask position with numpy : 0.01009988784790039 nb_pixel_total : 1328 time to create 1 rle with old method : 0.0015292167663574219 time for calcul the mask position with numpy : 0.01031184196472168 nb_pixel_total : 1223 time to create 1 rle with old method : 0.0014452934265136719 time for calcul the mask position with numpy : 0.007251262664794922 nb_pixel_total : 1540 time to create 1 rle with old method : 0.0018014907836914062 time for calcul the mask position with numpy : 0.010234355926513672 nb_pixel_total : 1464 time to create 1 rle with old method : 0.0016684532165527344 time for calcul the mask position with numpy : 0.010386943817138672 nb_pixel_total : 311 time to create 1 rle with old method : 0.0004391670227050781 time for calcul the mask position with numpy : 0.01055765151977539 nb_pixel_total : 104179 time to create 1 rle with old method : 0.1211087703704834 time for calcul the mask position with numpy : 0.014417409896850586 nb_pixel_total : 1457 time to create 1 rle with old method : 0.0017762184143066406 time for calcul the mask position with numpy : 0.013547420501708984 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003342628479003906 time for calcul the mask position with numpy : 0.013619184494018555 nb_pixel_total : 778 time to create 1 rle with old method : 0.0009429454803466797 time for calcul the mask position with numpy : 0.01407766342163086 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004851818084716797 time for calcul the mask position with numpy : 0.01343846321105957 nb_pixel_total : 33601 time to create 1 rle with old method : 0.036077022552490234 time for calcul the mask position with numpy : 0.012860536575317383 nb_pixel_total : 133 time to create 1 rle with old method : 0.00020813941955566406 time for calcul the mask position with numpy : 0.016930818557739258 nb_pixel_total : 3218 time to create 1 rle with old method : 0.005057811737060547 time for calcul the mask position with numpy : 0.011629819869995117 nb_pixel_total : 857 time to create 1 rle with old method : 0.0009167194366455078 time for calcul the mask position with numpy : 0.011632680892944336 nb_pixel_total : 5209 time to create 1 rle with old method : 0.0054323673248291016 time for calcul the mask position with numpy : 0.011871337890625 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003707408905029297 time for calcul the mask position with numpy : 0.011573076248168945 nb_pixel_total : 285 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.007226705551147461 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005507469177246094 time for calcul the mask position with numpy : 0.012204408645629883 nb_pixel_total : 302 time to create 1 rle with old method : 0.000370025634765625 time for calcul the mask position with numpy : 0.012367725372314453 nb_pixel_total : 272 time to create 1 rle with old method : 0.00036454200744628906 time for calcul the mask position with numpy : 0.012393712997436523 nb_pixel_total : 711 time to create 1 rle with old method : 0.0008339881896972656 time for calcul the mask position with numpy : 0.012153387069702148 nb_pixel_total : 26 time to create 1 rle with old method : 7.677078247070312e-05 time for calcul the mask position with numpy : 0.012017965316772461 nb_pixel_total : 887 time to create 1 rle with old method : 0.0010411739349365234 time for calcul the mask position with numpy : 0.012104034423828125 nb_pixel_total : 80 time to create 1 rle with old method : 0.00012230873107910156 time for calcul the mask position with numpy : 0.01366281509399414 nb_pixel_total : 5334 time to create 1 rle with old method : 0.006168842315673828 time for calcul the mask position with numpy : 0.012283802032470703 nb_pixel_total : 940 time to create 1 rle with old method : 0.0011518001556396484 time for calcul the mask position with numpy : 0.01232600212097168 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003361701965332031 time for calcul the mask position with numpy : 0.012545108795166016 nb_pixel_total : 127 time to create 1 rle with old method : 0.00022530555725097656 time for calcul the mask position with numpy : 0.011919736862182617 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004169940948486328 time for calcul the mask position with numpy : 0.011479377746582031 nb_pixel_total : 413 time to create 1 rle with old method : 0.00047898292541503906 time for calcul the mask position with numpy : 0.01678323745727539 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005564689636230469 time for calcul the mask position with numpy : 0.011848688125610352 nb_pixel_total : 545 time to create 1 rle with old method : 0.0006628036499023438 time for calcul the mask position with numpy : 0.011662006378173828 nb_pixel_total : 887 time to create 1 rle with old method : 0.0009660720825195312 time for calcul the mask position with numpy : 0.011540412902832031 nb_pixel_total : 1053 time to create 1 rle with old method : 0.001116037368774414 time for calcul the mask position with numpy : 0.011988639831542969 nb_pixel_total : 132 time to create 1 rle with old method : 0.00017642974853515625 time for calcul the mask position with numpy : 0.011776447296142578 nb_pixel_total : 73 time to create 1 rle with old method : 0.000110626220703125 create new chi : 1.1464498043060303 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0024411678314208984 batch 1 Loaded 66 chid ids of type : 4230 Number RLEs to save : 8402 TO DO : save crop sub photo not yet done ! save time : 0.5012216567993164 nb_obj : 71 nb_hashtags : 6 time to prepare the origin masks : 1.5638644695281982 time for calcul the mask position with numpy : 0.07136845588684082 nb_pixel_total : 1739155 time to create 1 rle with new method : 0.1053323745727539 time for calcul the mask position with numpy : 0.006745338439941406 nb_pixel_total : 4464 time to create 1 rle with old method : 0.005011081695556641 time for calcul the mask position with numpy : 0.0063953399658203125 nb_pixel_total : 14373 time to create 1 rle with old method : 0.016311168670654297 time for calcul the mask position with numpy : 0.0075969696044921875 nb_pixel_total : 106 time to create 1 rle with old method : 0.00015425682067871094 time for calcul the mask position with numpy : 0.010317802429199219 nb_pixel_total : 720 time to create 1 rle with old method : 0.0008540153503417969 time for calcul the mask position with numpy : 0.01187443733215332 nb_pixel_total : 124 time to create 1 rle with old method : 0.0001983642578125 time for calcul the mask position with numpy : 0.010449647903442383 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0013883113861083984 time for calcul the mask position with numpy : 0.010370016098022461 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005602836608886719 time for calcul the mask position with numpy : 0.010306119918823242 nb_pixel_total : 1492 time to create 1 rle with old method : 0.00170135498046875 time for calcul the mask position with numpy : 0.01048898696899414 nb_pixel_total : 58381 time to create 1 rle with old method : 0.06608366966247559 time for calcul the mask position with numpy : 0.010438203811645508 nb_pixel_total : 22 time to create 1 rle with old method : 6.628036499023438e-05 time for calcul the mask position with numpy : 0.006479024887084961 nb_pixel_total : 968 time to create 1 rle with old method : 0.0011353492736816406 time for calcul the mask position with numpy : 0.006404399871826172 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002608299255371094 time for calcul the mask position with numpy : 0.0064470767974853516 nb_pixel_total : 456 time to create 1 rle with old method : 0.0005693435668945312 time for calcul the mask position with numpy : 0.006637096405029297 nb_pixel_total : 395 time to create 1 rle with old method : 0.0004673004150390625 time for calcul the mask position with numpy : 0.006802558898925781 nb_pixel_total : 2288 time to create 1 rle with old method : 0.0029985904693603516 time for calcul the mask position with numpy : 0.0068666934967041016 nb_pixel_total : 15925 time to create 1 rle with old method : 0.018514633178710938 time for calcul the mask position with numpy : 0.006864786148071289 nb_pixel_total : 3911 time to create 1 rle with old method : 0.006390571594238281 time for calcul the mask position with numpy : 0.006720781326293945 nb_pixel_total : 47 time to create 1 rle with old method : 0.000110626220703125 time for calcul the mask position with numpy : 0.006734371185302734 nb_pixel_total : 578 time to create 1 rle with old method : 0.0009799003601074219 time for calcul the mask position with numpy : 0.0068585872650146484 nb_pixel_total : 13273 time to create 1 rle with old method : 0.021390438079833984 time for calcul the mask position with numpy : 0.006867408752441406 nb_pixel_total : 644 time to create 1 rle with old method : 0.0010540485382080078 time for calcul the mask position with numpy : 0.0066792964935302734 nb_pixel_total : 231 time to create 1 rle with old method : 0.0004899501800537109 time for calcul the mask position with numpy : 0.006952762603759766 nb_pixel_total : 954 time to create 1 rle with old method : 0.001580953598022461 time for calcul the mask position with numpy : 0.006618976593017578 nb_pixel_total : 205 time to create 1 rle with old method : 0.00028133392333984375 time for calcul the mask position with numpy : 0.010167121887207031 nb_pixel_total : 5570 time to create 1 rle with old method : 0.006311893463134766 time for calcul the mask position with numpy : 0.010591506958007812 nb_pixel_total : 23477 time to create 1 rle with old method : 0.026401996612548828 time for calcul the mask position with numpy : 0.011391162872314453 nb_pixel_total : 89 time to create 1 rle with old method : 0.00023365020751953125 time for calcul the mask position with numpy : 0.012074708938598633 nb_pixel_total : 16631 time to create 1 rle with old method : 0.0187685489654541 time for calcul the mask position with numpy : 0.010743141174316406 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002524852752685547 time for calcul the mask position with numpy : 0.010493755340576172 nb_pixel_total : 1165 time to create 1 rle with old method : 0.0013821125030517578 time for calcul the mask position with numpy : 0.010559320449829102 nb_pixel_total : 4209 time to create 1 rle with old method : 0.004823207855224609 time for calcul the mask position with numpy : 0.010463476181030273 nb_pixel_total : 361 time to create 1 rle with old method : 0.000476837158203125 time for calcul the mask position with numpy : 0.010847091674804688 nb_pixel_total : 1525 time to create 1 rle with old method : 0.0018377304077148438 time for calcul the mask position with numpy : 0.010800361633300781 nb_pixel_total : 1434 time to create 1 rle with old method : 0.0017592906951904297 time for calcul the mask position with numpy : 0.010576725006103516 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001609325408935547 time for calcul the mask position with numpy : 0.0064775943756103516 nb_pixel_total : 582 time to create 1 rle with old method : 0.000667572021484375 time for calcul the mask position with numpy : 0.006449699401855469 nb_pixel_total : 1509 time to create 1 rle with old method : 0.0017914772033691406 time for calcul the mask position with numpy : 0.0063915252685546875 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0013797283172607422 time for calcul the mask position with numpy : 0.006453037261962891 nb_pixel_total : 242 time to create 1 rle with old method : 0.00029349327087402344 time for calcul the mask position with numpy : 0.007529020309448242 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006895065307617188 time for calcul the mask position with numpy : 0.006375789642333984 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009324550628662109 time for calcul the mask position with numpy : 0.006330728530883789 nb_pixel_total : 1590 time to create 1 rle with old method : 0.0017948150634765625 time for calcul the mask position with numpy : 0.006402254104614258 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003020763397216797 time for calcul the mask position with numpy : 0.006178140640258789 nb_pixel_total : 1009 time to create 1 rle with old method : 0.001302957534790039 time for calcul the mask position with numpy : 0.007071256637573242 nb_pixel_total : 105009 time to create 1 rle with old method : 0.15230965614318848 time for calcul the mask position with numpy : 0.00696110725402832 nb_pixel_total : 32805 time to create 1 rle with old method : 0.04052424430847168 time for calcul the mask position with numpy : 0.006956338882446289 nb_pixel_total : 332 time to create 1 rle with old method : 0.00040793418884277344 time for calcul the mask position with numpy : 0.007055521011352539 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005333423614501953 time for calcul the mask position with numpy : 0.006719827651977539 nb_pixel_total : 133 time to create 1 rle with old method : 0.00021529197692871094 time for calcul the mask position with numpy : 0.007126331329345703 nb_pixel_total : 3132 time to create 1 rle with old method : 0.0035457611083984375 time for calcul the mask position with numpy : 0.006514549255371094 nb_pixel_total : 208 time to create 1 rle with old method : 0.00031828880310058594 time for calcul the mask position with numpy : 0.006922006607055664 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004904270172119141 time for calcul the mask position with numpy : 0.0069637298583984375 nb_pixel_total : 86 time to create 1 rle with old method : 0.00014090538024902344 time for calcul the mask position with numpy : 0.006817340850830078 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006906986236572266 time for calcul the mask position with numpy : 0.006797313690185547 nb_pixel_total : 133 time to create 1 rle with old method : 0.00017762184143066406 time for calcul the mask position with numpy : 0.006571292877197266 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003521442413330078 time for calcul the mask position with numpy : 0.006883144378662109 nb_pixel_total : 337 time to create 1 rle with old method : 0.00041747093200683594 time for calcul the mask position with numpy : 0.0070035457611083984 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002856254577636719 time for calcul the mask position with numpy : 0.0069539546966552734 nb_pixel_total : 610 time to create 1 rle with old method : 0.0007767677307128906 time for calcul the mask position with numpy : 0.0069582462310791016 nb_pixel_total : 75 time to create 1 rle with old method : 0.00012350082397460938 time for calcul the mask position with numpy : 0.006898403167724609 nb_pixel_total : 1553 time to create 1 rle with old method : 0.0018832683563232422 time for calcul the mask position with numpy : 0.006741046905517578 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003325939178466797 time for calcul the mask position with numpy : 0.006745815277099609 nb_pixel_total : 318 time to create 1 rle with old method : 0.00040912628173828125 time for calcul the mask position with numpy : 0.0068933963775634766 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004239082336425781 time for calcul the mask position with numpy : 0.008527278900146484 nb_pixel_total : 592 time to create 1 rle with old method : 0.0007214546203613281 time for calcul the mask position with numpy : 0.00876307487487793 nb_pixel_total : 902 time to create 1 rle with old method : 0.001561880111694336 time for calcul the mask position with numpy : 0.00970315933227539 nb_pixel_total : 249 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.008347272872924805 nb_pixel_total : 1322 time to create 1 rle with old method : 0.0017397403717041016 time for calcul the mask position with numpy : 0.008512258529663086 nb_pixel_total : 85 time to create 1 rle with old method : 0.00012874603271484375 time for calcul the mask position with numpy : 0.008364677429199219 nb_pixel_total : 132 time to create 1 rle with old method : 0.00014972686767578125 time for calcul the mask position with numpy : 0.008351325988769531 nb_pixel_total : 82 time to create 1 rle with old method : 9.846687316894531e-05 create new chi : 1.1822373867034912 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016002655029296875 batch 1 Loaded 72 chid ids of type : 4230 Number RLEs to save : 9490 TO DO : save crop sub photo not yet done ! save time : 0.5442695617675781 nb_obj : 81 nb_hashtags : 6 time to prepare the origin masks : 1.5649940967559814 time for calcul the mask position with numpy : 0.2648804187774658 nb_pixel_total : 1820347 time to create 1 rle with new method : 0.28177762031555176 time for calcul the mask position with numpy : 0.008266687393188477 nb_pixel_total : 4958 time to create 1 rle with old method : 0.00695490837097168 time for calcul the mask position with numpy : 0.008260488510131836 nb_pixel_total : 171 time to create 1 rle with old method : 0.0003705024719238281 time for calcul the mask position with numpy : 0.008481025695800781 nb_pixel_total : 1392 time to create 1 rle with old method : 0.002303600311279297 time for calcul the mask position with numpy : 0.0088043212890625 nb_pixel_total : 726 time to create 1 rle with old method : 0.0012400150299072266 time for calcul the mask position with numpy : 0.008630037307739258 nb_pixel_total : 440 time to create 1 rle with old method : 0.0007050037384033203 time for calcul the mask position with numpy : 0.008659601211547852 nb_pixel_total : 775 time to create 1 rle with old method : 0.0013418197631835938 time for calcul the mask position with numpy : 0.007920026779174805 nb_pixel_total : 111 time to create 1 rle with old method : 0.00020813941955566406 time for calcul the mask position with numpy : 0.008054971694946289 nb_pixel_total : 60 time to create 1 rle with old method : 0.0001552104949951172 time for calcul the mask position with numpy : 0.013823747634887695 nb_pixel_total : 4710 time to create 1 rle with old method : 0.0072705745697021484 time for calcul the mask position with numpy : 0.014252662658691406 nb_pixel_total : 380 time to create 1 rle with old method : 0.0006108283996582031 time for calcul the mask position with numpy : 0.014669179916381836 nb_pixel_total : 684 time to create 1 rle with old method : 0.001094818115234375 time for calcul the mask position with numpy : 0.014512777328491211 nb_pixel_total : 1497 time to create 1 rle with old method : 0.0029306411743164062 time for calcul the mask position with numpy : 0.014382600784301758 nb_pixel_total : 184 time to create 1 rle with old method : 0.0003261566162109375 time for calcul the mask position with numpy : 0.014648914337158203 nb_pixel_total : 176 time to create 1 rle with old method : 0.00033211708068847656 time for calcul the mask position with numpy : 0.008023500442504883 nb_pixel_total : 99 time to create 1 rle with old method : 0.00022149085998535156 time for calcul the mask position with numpy : 0.008437633514404297 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005555152893066406 time for calcul the mask position with numpy : 0.008174419403076172 nb_pixel_total : 10593 time to create 1 rle with old method : 0.017752885818481445 time for calcul the mask position with numpy : 0.008692741394042969 nb_pixel_total : 692 time to create 1 rle with old method : 0.0009286403656005859 time for calcul the mask position with numpy : 0.007698774337768555 nb_pixel_total : 757 time to create 1 rle with old method : 0.0009229183197021484 time for calcul the mask position with numpy : 0.007395029067993164 nb_pixel_total : 164 time to create 1 rle with old method : 0.00024628639221191406 time for calcul the mask position with numpy : 0.0077972412109375 nb_pixel_total : 162 time to create 1 rle with old method : 0.00022983551025390625 time for calcul the mask position with numpy : 0.014111995697021484 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006916522979736328 time for calcul the mask position with numpy : 0.013232946395874023 nb_pixel_total : 31 time to create 1 rle with old method : 0.00010037422180175781 time for calcul the mask position with numpy : 0.008407354354858398 nb_pixel_total : 962 time to create 1 rle with old method : 0.0011937618255615234 time for calcul the mask position with numpy : 0.008322000503540039 nb_pixel_total : 128 time to create 1 rle with old method : 0.00029277801513671875 time for calcul the mask position with numpy : 0.00785684585571289 nb_pixel_total : 148 time to create 1 rle with old method : 0.00036406517028808594 time for calcul the mask position with numpy : 0.008484363555908203 nb_pixel_total : 26350 time to create 1 rle with old method : 0.04329347610473633 time for calcul the mask position with numpy : 0.014329671859741211 nb_pixel_total : 9458 time to create 1 rle with old method : 0.016727924346923828 time for calcul the mask position with numpy : 0.01416325569152832 nb_pixel_total : 65 time to create 1 rle with old method : 0.0001456737518310547 time for calcul the mask position with numpy : 0.007915496826171875 nb_pixel_total : 3284 time to create 1 rle with old method : 0.0054094791412353516 time for calcul the mask position with numpy : 0.008247613906860352 nb_pixel_total : 1169 time to create 1 rle with old method : 0.002075672149658203 time for calcul the mask position with numpy : 0.008273601531982422 nb_pixel_total : 3286 time to create 1 rle with old method : 0.0057370662689208984 time for calcul the mask position with numpy : 0.007237911224365234 nb_pixel_total : 571 time to create 1 rle with old method : 0.0007238388061523438 time for calcul the mask position with numpy : 0.007159709930419922 nb_pixel_total : 1517 time to create 1 rle with old method : 0.0017654895782470703 time for calcul the mask position with numpy : 0.006918430328369141 nb_pixel_total : 1190 time to create 1 rle with old method : 0.001432180404663086 time for calcul the mask position with numpy : 0.008474588394165039 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006206035614013672 time for calcul the mask position with numpy : 0.0078122615814208984 nb_pixel_total : 104143 time to create 1 rle with old method : 0.1441192626953125 time for calcul the mask position with numpy : 0.010785579681396484 nb_pixel_total : 607 time to create 1 rle with old method : 0.001127004623413086 time for calcul the mask position with numpy : 0.008098602294921875 nb_pixel_total : 211 time to create 1 rle with old method : 0.00045013427734375 time for calcul the mask position with numpy : 0.007503986358642578 nb_pixel_total : 390 time to create 1 rle with old method : 0.00046706199645996094 time for calcul the mask position with numpy : 0.0065915584564208984 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004215240478515625 time for calcul the mask position with numpy : 0.010775566101074219 nb_pixel_total : 235 time to create 1 rle with old method : 0.0002918243408203125 time for calcul the mask position with numpy : 0.010942459106445312 nb_pixel_total : 33945 time to create 1 rle with old method : 0.037132978439331055 time for calcul the mask position with numpy : 0.012730121612548828 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005702972412109375 time for calcul the mask position with numpy : 0.013060331344604492 nb_pixel_total : 486 time to create 1 rle with old method : 0.0008208751678466797 time for calcul the mask position with numpy : 0.013176679611206055 nb_pixel_total : 929 time to create 1 rle with old method : 0.0015270709991455078 time for calcul the mask position with numpy : 0.012652397155761719 nb_pixel_total : 140 time to create 1 rle with old method : 0.0002567768096923828 time for calcul the mask position with numpy : 0.012986898422241211 nb_pixel_total : 3121 time to create 1 rle with old method : 0.005482196807861328 time for calcul the mask position with numpy : 0.009918212890625 nb_pixel_total : 25 time to create 1 rle with old method : 0.00012683868408203125 time for calcul the mask position with numpy : 0.007445573806762695 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0016720294952392578 time for calcul the mask position with numpy : 0.007403373718261719 nb_pixel_total : 447 time to create 1 rle with old method : 0.0007524490356445312 time for calcul the mask position with numpy : 0.007537364959716797 nb_pixel_total : 5295 time to create 1 rle with old method : 0.008453845977783203 time for calcul the mask position with numpy : 0.007117271423339844 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0013196468353271484 time for calcul the mask position with numpy : 0.006617307662963867 nb_pixel_total : 244 time to create 1 rle with old method : 0.0002961158752441406 time for calcul the mask position with numpy : 0.010425090789794922 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005593299865722656 time for calcul the mask position with numpy : 0.010487794876098633 nb_pixel_total : 4213 time to create 1 rle with old method : 0.00468754768371582 time for calcul the mask position with numpy : 0.01062631607055664 nb_pixel_total : 2068 time to create 1 rle with old method : 0.0024340152740478516 time for calcul the mask position with numpy : 0.010789871215820312 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003285408020019531 time for calcul the mask position with numpy : 0.0105133056640625 nb_pixel_total : 12 time to create 1 rle with old method : 4.267692565917969e-05 time for calcul the mask position with numpy : 0.010267972946166992 nb_pixel_total : 367 time to create 1 rle with old method : 0.0004200935363769531 time for calcul the mask position with numpy : 0.010564804077148438 nb_pixel_total : 497 time to create 1 rle with old method : 0.0005824565887451172 time for calcul the mask position with numpy : 0.010521173477172852 nb_pixel_total : 1577 time to create 1 rle with old method : 0.0017828941345214844 time for calcul the mask position with numpy : 0.010777473449707031 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005812644958496094 time for calcul the mask position with numpy : 0.010361433029174805 nb_pixel_total : 843 time to create 1 rle with old method : 0.0009655952453613281 time for calcul the mask position with numpy : 0.010787248611450195 nb_pixel_total : 5164 time to create 1 rle with old method : 0.006081342697143555 time for calcul the mask position with numpy : 0.01127171516418457 nb_pixel_total : 106 time to create 1 rle with old method : 0.00023436546325683594 time for calcul the mask position with numpy : 0.010990381240844727 nb_pixel_total : 965 time to create 1 rle with old method : 0.0011374950408935547 time for calcul the mask position with numpy : 0.011484146118164062 nb_pixel_total : 322 time to create 1 rle with old method : 0.0005567073822021484 time for calcul the mask position with numpy : 0.01206064224243164 nb_pixel_total : 235 time to create 1 rle with old method : 0.0004687309265136719 time for calcul the mask position with numpy : 0.011907339096069336 nb_pixel_total : 328 time to create 1 rle with old method : 0.0005643367767333984 time for calcul the mask position with numpy : 0.012045860290527344 nb_pixel_total : 393 time to create 1 rle with old method : 0.0006608963012695312 time for calcul the mask position with numpy : 0.009785175323486328 nb_pixel_total : 34 time to create 1 rle with old method : 0.00010180473327636719 time for calcul the mask position with numpy : 0.009754180908203125 nb_pixel_total : 547 time to create 1 rle with old method : 0.0008995532989501953 time for calcul the mask position with numpy : 0.009680032730102539 nb_pixel_total : 833 time to create 1 rle with old method : 0.0013628005981445312 time for calcul the mask position with numpy : 0.009531021118164062 nb_pixel_total : 60 time to create 1 rle with old method : 9.226799011230469e-05 time for calcul the mask position with numpy : 0.008420944213867188 nb_pixel_total : 1360 time to create 1 rle with old method : 0.001550912857055664 time for calcul the mask position with numpy : 0.00847482681274414 nb_pixel_total : 83 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.008450746536254883 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002315044403076172 time for calcul the mask position with numpy : 0.008480310440063477 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004565715789794922 time for calcul the mask position with numpy : 0.008474588394165039 nb_pixel_total : 108 time to create 1 rle with old method : 0.0001442432403564453 time for calcul the mask position with numpy : 0.008506536483764648 nb_pixel_total : 144 time to create 1 rle with old method : 0.00017642974853515625 create new chi : 1.7259283065795898 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.002015829086303711 batch 1 Loaded 82 chid ids of type : 4230 Number RLEs to save : 9219 TO DO : save crop sub photo not yet done ! save time : 0.6613030433654785 map_output_result : {1340813239: (0.0, 'Should be the crop_list due to order', 0.0), 1340813235: (0.0, 'Should be the crop_list due to order', 0.0), 1340813015: (0.0, 'Should be the crop_list due to order', 0.0), 1340812949: (0.0, 'Should be the crop_list due to order', 0.0), 1340812947: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340813239, 1340813235, 1340813015, 1340812949, 1340812947] Looping around the photos to save general results len do output : 5 /1340813239.Didn't retrieve data . /1340813235.Didn't retrieve data . /1340813015.Didn't retrieve data . /1340812949.Didn't retrieve data . /1340812947.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813239', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813235', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813015', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812949', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812947', None, None, None, None, None, '2633176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014654874801635742 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.37504267692566 time spend to save output : 0.018347978591918945 total time spend for step 4 : 17.393390655517578 step5:crop_condition Tue Mar 4 16:21:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 359 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 142 About to insert : list_path_to_insert length 142 new photo from crops ! About to upload 142 photos upload in portfolio : 4869462 init cache_photo without model_param we have 142 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741101692_420747 we have uploaded 142 photos in the portfolio 4869462 time of upload the photos Elapsed time : 40.95265245437622 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4869462 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741101733_420747 we have uploaded 26 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.665848255157471 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741101741_420747 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6087625026702881 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 4869462 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741101742_420747 we have uploaded 17 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.525071620941162 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 4869462 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741101747_420747 we have uploaded 42 photos in the portfolio 4869462 time of upload the photos Elapsed time : 9.16265058517456 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340813239, 1340813235, 1340813015, 1340812949, 1340812947] Looping around the photos to save general results len do output : 228 /1340825361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340825644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813239', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813235', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813015', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812949', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812947', None, None, None, None, None, '2633176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 689 time used for this insertion : 0.04356241226196289 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.39941787719727 time spend to save output : 0.049637556076049805 total time spend for step 5 : 68.44905543327332 step6:thcl Tue Mar 4 16:22:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01997232437133789 time to convert the images to numpy array : 0.06964707374572754 time to import caffe and check if the image exist : 0.024364709854125977 time to convert the images to numpy array : 0.0729062557220459 time to import caffe and check if the image exist : 0.02477884292602539 time to convert the images to numpy array : 0.07806110382080078 time to import caffe and check if the image exist : 0.020975589752197266 time to convert the images to numpy array : 0.08889412879943848 time to import caffe and check if the image exist : 0.01890707015991211 time to convert the images to numpy array : 0.09612631797790527 time to import caffe and check if the image exist : 0.027415037155151367 time to convert the images to numpy array : 0.08820486068725586 time to import caffe and check if the image exist : 0.02702617645263672 time to convert the images to numpy array : 0.0887918472290039 time to import caffe and check if the image exist : 0.02334308624267578 time to convert the images to numpy array : 0.09282994270324707 time to import caffe and check if the image exist : 0.018680810928344727 time to convert the images to numpy array : 0.09767961502075195 time to import caffe and check if the image exist : 0.02860426902770996 time to convert the images to numpy array : 0.09148502349853516 total time to convert the images to numpy array : 0.4996161460876465 list photo_ids error: [] list photo_ids correct : [1340825623, 1340825625, 1340825626, 1340825627, 1340825628, 1340825629, 1340825630, 1340825631, 1340825632, 1340825633, 1340825634, 1340825635, 1340825636, 1340825637, 1340825638, 1340825639, 1340825640, 1340825641, 1340825642, 1340825643, 1340825644, 1340825506, 1340825507, 1340825508, 1340825509, 1340825515, 1340825516, 1340825517, 1340825518, 1340825519, 1340825520, 1340825521, 1340825522, 1340825523, 1340825525, 1340825526, 1340825527, 1340825528, 1340825529, 1340825530, 1340825531, 1340825532, 1340825533, 1340825534, 1340825585, 1340825587, 1340825602, 1340825603, 1340825604, 1340825605, 1340825606, 1340825607, 1340825608, 1340825609, 1340825610, 1340825611, 1340825612, 1340825613, 1340825614, 1340825615, 1340825616, 1340825617, 1340825618, 1340825619, 1340825620, 1340825621, 1340825622, 1340825361, 1340825362, 1340825363, 1340825364, 1340825365, 1340825366, 1340825367, 1340825368, 1340825369, 1340825370, 1340825371, 1340825372, 1340825373, 1340825374, 1340825375, 1340825376, 1340825377, 1340825378, 1340825379, 1340825380, 1340825381, 1340825382, 1340825384, 1340825385, 1340825386, 1340825387, 1340825388, 1340825389, 1340825390, 1340825391, 1340825392, 1340825393, 1340825394, 1340825395, 1340825396, 1340825397, 1340825399, 1340825400, 1340825401, 1340825402, 1340825403, 1340825404, 1340825405, 1340825406, 1340825407, 1340825408, 1340825458, 1340825459, 1340825460, 1340825461, 1340825462, 1340825463, 1340825464, 1340825465, 1340825466, 1340825467, 1340825468, 1340825469, 1340825470, 1340825471, 1340825472, 1340825473, 1340825474, 1340825475, 1340825476, 1340825477, 1340825478, 1340825479, 1340825480, 1340825409, 1340825410, 1340825411, 1340825412, 1340825413, 1340825414, 1340825415, 1340825416, 1340825417, 1340825418, 1340825419, 1340825420, 1340825421, 1340825422, 1340825423, 1340825424, 1340825425, 1340825426, 1340825427, 1340825428, 1340825429, 1340825430, 1340825431, 1340825481, 1340825482, 1340825483, 1340825484, 1340825486, 1340825487, 1340825488, 1340825489, 1340825490, 1340825491, 1340825492, 1340825493, 1340825494, 1340825495, 1340825496, 1340825497, 1340825498, 1340825499, 1340825500, 1340825501, 1340825502, 1340825503, 1340825505, 1340825535, 1340825536, 1340825537, 1340825538, 1340825539, 1340825540, 1340825541, 1340825542, 1340825554, 1340825557, 1340825560, 1340825562, 1340825564, 1340825566, 1340825568, 1340825570, 1340825572, 1340825574, 1340825576, 1340825578, 1340825580, 1340825581, 1340825583, 1340825432, 1340825433, 1340825434, 1340825435, 1340825436, 1340825437, 1340825438, 1340825439, 1340825440, 1340825441, 1340825442, 1340825445, 1340825446, 1340825447, 1340825448, 1340825449, 1340825450, 1340825451, 1340825452, 1340825453, 1340825454, 1340825456, 1340825457] number of photos to traite : 228 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10595 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.086967945098877 time used to do the prediction : 1.152392864227295 save descriptor for thcl : 3237 time to traite the descriptors : 1.3186051845550537 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340825623 To insert : 1340825625 To insert : 1340825626 To insert : 1340825627 To insert : 1340825628 To insert : 1340825629 To insert : 1340825630 To insert : 1340825631 To insert : 1340825632 To insert : 1340825633 To insert : 1340825634 To insert : 1340825635 To insert : 1340825636 To insert : 1340825637 To insert : 1340825638 To insert : 1340825639 To insert : 1340825640 To insert : 1340825641 To insert : 1340825642 To insert : 1340825643 To insert : 1340825644 To insert : 1340825506 To insert : 1340825507 To insert : 1340825508 To insert : 1340825509 To insert : 1340825515 To insert : 1340825516 To insert : 1340825517 To insert : 1340825518 To insert : 1340825519 To insert : 1340825520 To insert : 1340825521 To insert : 1340825522 To insert : 1340825523 To insert : 1340825525 To insert : 1340825526 To insert : 1340825527 To insert : 1340825528 To insert : 1340825529 To insert : 1340825530 To insert : 1340825531 To insert : 1340825532 To insert : 1340825533 To insert : 1340825534 To insert : 1340825585 To insert : 1340825587 To insert : 1340825602 To insert : 1340825603 To insert : 1340825604 To insert : 1340825605 To insert : 1340825606 To insert : 1340825607 To insert : 1340825608 To insert : 1340825609 To insert : 1340825610 To insert : 1340825611 To insert : 1340825612 To insert : 1340825613 To insert : 1340825614 To insert : 1340825615 To insert : 1340825616 To insert : 1340825617 To insert : 1340825618 To insert : 1340825619 To insert : 1340825620 To insert : 1340825621 To insert : 1340825622 To insert : 1340825361 To insert : 1340825362 To insert : 1340825363 To insert : 1340825364 To insert : 1340825365 To insert : 1340825366 To insert : 1340825367 To insert : 1340825368 To insert : 1340825369 To insert : 1340825370 To insert : 1340825371 To insert : 1340825372 To insert : 1340825373 To insert : 1340825374 To insert : 1340825375 To insert : 1340825376 To insert : 1340825377 To insert : 1340825378 To insert : 1340825379 To insert : 1340825380 To insert : 1340825381 To insert : 1340825382 To insert : 1340825384 To insert : 1340825385 To insert : 1340825386 To insert : 1340825387 To insert : 1340825388 To insert : 1340825389 To insert : 1340825390 To insert : 1340825391 To insert : 1340825392 To insert : 1340825393 To insert : 1340825394 To insert : 1340825395 To insert : 1340825396 To insert : 1340825397 To insert : 1340825399 To insert : 1340825400 To insert : 1340825401 To insert : 1340825402 To insert : 1340825403 To insert : 1340825404 To insert : 1340825405 To insert : 1340825406 To insert : 1340825407 To insert : 1340825408 To insert : 1340825458 To insert : 1340825459 To insert : 1340825460 To insert : 1340825461 To insert : 1340825462 To insert : 1340825463 To insert : 1340825464 To insert : 1340825465 To insert : 1340825466 To insert : 1340825467 To insert : 1340825468 To insert : 1340825469 To insert : 1340825470 To insert : 1340825471 To insert : 1340825472 To insert : 1340825473 To insert : 1340825474 To insert : 1340825475 To insert : 1340825476 To insert : 1340825477 To insert : 1340825478 To insert : 1340825479 To insert : 1340825480 To insert : 1340825409 To insert : 1340825410 To insert : 1340825411 To insert : 1340825412 To insert : 1340825413 To insert : 1340825414 To insert : 1340825415 To insert : 1340825416 To insert : 1340825417 To insert : 1340825418 To insert : 1340825419 To insert : 1340825420 To insert : 1340825421 To insert : 1340825422 To insert : 1340825423 To insert : 1340825424 To insert : 1340825425 To insert : 1340825426 To insert : 1340825427 To insert : 1340825428 To insert : 1340825429 To insert : 1340825430 To insert : 1340825431 To insert : 1340825481 To insert : 1340825482 To insert : 1340825483 To insert : 1340825484 To insert : 1340825486 To insert : 1340825487 To insert : 1340825488 To insert : 1340825489 To insert : 1340825490 To insert : 1340825491 To insert : 1340825492 To insert : 1340825493 To insert : 1340825494 To insert : 1340825495 To insert : 1340825496 To insert : 1340825497 To insert : 1340825498 To insert : 1340825499 To insert : 1340825500 To insert : 1340825501 To insert : 1340825502 To insert : 1340825503 To insert : 1340825505 To insert : 1340825535 To insert : 1340825536 To insert : 1340825537 To insert : 1340825538 To insert : 1340825539 To insert : 1340825540 To insert : 1340825541 To insert : 1340825542 To insert : 1340825554 To insert : 1340825557 To insert : 1340825560 To insert : 1340825562 To insert : 1340825564 To insert : 1340825566 To insert : 1340825568 To insert : 1340825570 To insert : 1340825572 To insert : 1340825574 To insert : 1340825576 To insert : 1340825578 To insert : 1340825580 To insert : 1340825581 To insert : 1340825583 To insert : 1340825432 To insert : 1340825433 To insert : 1340825434 To insert : 1340825435 To insert : 1340825436 To insert : 1340825437 To insert : 1340825438 To insert : 1340825439 To insert : 1340825440 To insert : 1340825441 To insert : 1340825442 To insert : 1340825445 To insert : 1340825446 To insert : 1340825447 To insert : 1340825448 To insert : 1340825449 To insert : 1340825450 To insert : 1340825451 To insert : 1340825452 To insert : 1340825453 To insert : 1340825454 To insert : 1340825456 To insert : 1340825457 time to insert the descriptors : 46.30535912513733 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 359 time used for this insertion : 0.028876781463623047 save missing photos in datou_result : time spend for datou_step_exec : 54.44264888763428 time spend to save output : 0.08421683311462402 total time spend for step 6 : 54.5268657207489 step7:ventilate_hashtags_in_portfolio Tue Mar 4 16:23:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21013624 get user id for portfolio 21013624 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21013624 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_fonce','Tetrapak','Film_plastique','papier','autre','refus','environnement','pehd','flou','PET_clair','PET_fonce','PEHD','Papier','Carton','carton','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21013624 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_fonce','Tetrapak','Film_plastique','papier','autre','refus','environnement','pehd','flou','PET_clair','PET_fonce','PEHD','Papier','Carton','carton','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.6 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21013624 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_fonce','Tetrapak','Film_plastique','papier','autre','refus','environnement','pehd','flou','PET_clair','PET_fonce','PEHD','Papier','Carton','carton','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21013624 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_fonce','Tetrapak','Film_plastique','papier','autre','refus','environnement','pehd','flou','PET_clair','PET_fonce','PEHD','Papier','Carton','carton','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21015978,21015989,21015980,21015981,21015991,21015983,21015984,21015985,21015990,21015987,21015995,21015993,21015994?tags=metal,pet_fonce,tetrapak,film_plastique,papier,autre,refus,environnement,pehd,flou,pet_clair,carton,mal_croppe&datou_id_consolidate=4235&port_consolidate=21013624 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340813239, 1340813235, 1340813015, 1340812949, 1340812947] Looping around the photos to save general results len do output : 1 /21013624. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813239', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813235', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813015', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812949', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812947', None, None, None, None, None, '2633176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013622760772705078 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1973233222961426 time spend to save output : 0.01392674446105957 total time spend for step 7 : 1.2112500667572021 step8:final Tue Mar 4 16:23:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340813239: ('0.22501722733439763',), 1340813235: ('0.22501722733439763',), 1340813015: ('0.22501722733439763',), 1340812949: ('0.22501722733439763',), 1340812947: ('0.22501722733439763',)} new output for save of step final : {1340813239: ('0.22501722733439763',), 1340813235: ('0.22501722733439763',), 1340813015: ('0.22501722733439763',), 1340812949: ('0.22501722733439763',), 1340812947: ('0.22501722733439763',)} [1340813239, 1340813235, 1340813015, 1340812949, 1340812947] Looping around the photos to save general results len do output : 5 /1340813239.Didn't retrieve data . /1340813235.Didn't retrieve data . /1340813015.Didn't retrieve data . /1340812949.Didn't retrieve data . /1340812947.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813239', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813235', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813015', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812949', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812947', None, None, None, None, None, '2633176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012650251388549805 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13308119773864746 time spend to save output : 0.012978315353393555 total time spend for step 8 : 0.14605951309204102 step9:velours_tree Tue Mar 4 16:23:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21015978,21015989,21015980,21015981,21015991,21015983,21015984,21015985,21015990,21015987,21015995,21015993,21015994 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015978 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015989 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015980 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015981 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015991 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015983 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015984 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015985 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015990 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015987 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015995 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015993 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21015994 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 228 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 5 5 0 5 0 5 0 0 2 2 0 3 5 0 0 0 2 2 1 5 5 0 1 5 5 3 5 2 2 0 5 0 3 2 2 0 0 2 0 2 1 2 5 0 0 3 0 1 0 0 5 5 3 5 2 0 0 2 5 0 3 0 1 0 0 0 0 0 2 2 2 1 5 0 5 2 0 1 5 5 4 0 5 0 0 3 2 0 0 5 0 3 5 0 0 0 2 0 2 2 1 5 5 0 0 0 0 0 1 0 1 1 3 5 0 3 0 5 2 2 0 3 0 0 2 2 0 2 2 2 1 5 5 0 0 1 0 0 2 0 1 0 0 4 1 4 4 4 1 0 0 0 4 1 0 0 3 1 1 0 0 0 2 2 4 1 1 0 3 1 0 0 5 1 3 3 3 1 0 5 0 3 2 2 1 4 1 3 2 0 0 1 1 4 1 0 4 1 3 3 1 1 1 1 1 4 4 1 4 1 1 1 4 4 1 1 1 4 1 1 4 4 1 3 1 1 1] Elapsed time: 0.04611635208129883 graph_id used : 81416 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21015978,21015989,21015980,21015981,21015991,21015983,21015984,21015985,21015990,21015987,21015995,21015993,21015994?tags=metal,pet_fonce,tetrapak,film_plastique,papier,autre,refus,environnement,pehd,flou,pet_clair,carton,mal_croppe&datou_id_consolidate=4235&port_consolidate=21013624&tree_id=81416 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340813239, 1340813235, 1340813015, 1340812949, 1340812947] Looping around the photos to save general results len do output : 1 /21013624Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813239', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813235', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813015', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812949', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812947', None, None, None, None, None, '2633176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01196742057800293 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.390045881271362 time spend to save output : 0.01235055923461914 total time spend for step 9 : 14.402396440505981 step10:send_mail_cod Tue Mar 4 16:23:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21013624_04-03-2025_16_23_47.pdf 21015960 change filename to text .imagette210159601741101827 21015971 imagette210159711741101827 21015962 imagette210159621741101827 21015963 imagette210159631741101827 21015973 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210159731741101827 21015965 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210159651741101828 21015966 imagette210159661741101829 21015972 imagette210159721741101829 21015969 imagette210159691741101829 21015977 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210159771741101829 21015975 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210159751741101829 21015976 imagette210159761741101831 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21013624 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21015978,21015989,21015980,21015981,21015991,21015983,21015984,21015985,21015990,21015987,21015995,21015993,21015994?tags=metal,pet_fonce,tetrapak,film_plastique,papier,autre,refus,environnement,pehd,flou,pet_clair,carton,mal_croppe&datou_id_consolidate=4235&port_consolidate=21013624&tree_id=81416 your option no_mail is active, we will not send the real mail to your client args[1340813239] : ((1340813239, -7.312883630548382, 492609224), (1340813239, -0.5021748983892819, 501862349), '0.22501722733439763') We are sending mail with results at cod@fotonower.com args[1340813235] : ((1340813235, -7.3109003095802105, 492609224), (1340813235, -0.507234283467703, 501862349), '0.22501722733439763') We are sending mail with results at cod@fotonower.com args[1340813015] : ((1340813015, -7.339928881017838, 492609224), (1340813015, -0.5096873527794551, 501862349), '0.22501722733439763') We are sending mail with results at cod@fotonower.com args[1340812949] : ((1340812949, -7.328886511865396, 492609224), (1340812949, -0.5034693461939237, 501862349), '0.22501722733439763') We are sending mail with results at cod@fotonower.com args[1340812947] : ((1340812947, -7.291991854439329, 492609224), (1340812947, -0.5024735036139606, 501862349), '0.22501722733439763') We are sending mail with results at cod@fotonower.com refus_total : 0.22501722733439763 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21013624 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21013624_04-03-2025_16_23_47.pdf results_Qualipapia_P21013624_04-03-2025_16_23_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21013624_04-03-2025_16_23_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21013624','results_Qualipapia_P21013624_04-03-2025_16_23_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21013624_04-03-2025_16_23_47.pdf','pdf','','0.17','0.22501722733439763') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340813239, 1340813235, 1340813015, 1340812949, 1340812947] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813239', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813235', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813015', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812949', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812947', None, None, None, None, None, '2633176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012669563293457031 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.917179107666016 time spend to save output : 0.012819528579711914 total time spend for step 10 : 4.9299986362457275 step11:split_time_score Tue Mar 4 16:23:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 04032025 21013624 Nombre de photos uploadées : 8 / 23040 (0%) 04032025 21013624 Nombre de photos taguées (types de déchets): 8 / 8 (100%) 04032025 21013624 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004208087921142578 elapsed_time : insert_dashboard_record_day_entry 0.024133920669555664 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007616 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007617 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007619 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007621 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007623 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007625 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007627 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007630 order by id desc limit 1 Qualite : 0.24892527834258063 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21007632_04-03-2025_12_47_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21007632 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21007632 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008149 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008150 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008151 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008152 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008154 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008156 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008159 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008161 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008163 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008165 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008167 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008169 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008171 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008174 order by id desc limit 1 Qualite : 0.2545628832014054 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21008176_04-03-2025_13_32_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008176 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21008176 AND mptpi.`type`=4230 To do Qualite : 0.2882699738249937 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21008178_04-03-2025_13_22_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008178 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21008178 AND mptpi.`type`=4230 To do Qualite : 0.2752652575950524 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21008180_04-03-2025_13_12_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21008180 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008682 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008684 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008686 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008688 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008690 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21008692 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21009813 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21009814 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21009816 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21009818 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21009820 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21012337 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21012338 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21012339 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21012340 order by id desc limit 1 Qualite : 0.2786803501749375 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21012341_04-03-2025_15_33_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21012341 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21012341 AND mptpi.`type`=4230 To do Qualite : 0.25563508816480707 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21012342_04-03-2025_15_17_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21012342 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21012342 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21012344 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013583 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013584 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013596 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013603 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013621 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013622 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013623 order by id desc limit 1 Qualite : 0.22501722733439763 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21013624_04-03-2025_16_23_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013624 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21013624 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013625 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013627 order by id desc limit 1 Qualite : 0.13308647995228717 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21013631_04-03-2025_16_02_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013631 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21013631 AND mptpi.`type`=4230 To do Qualite : 0.2233305576348793 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21013634_04-03-2025_15_47_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21013634 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21013634 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'04032025': {'nb_upload': 8, 'nb_taggue_class': 8, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340813239, 1340813235, 1340813015, 1340812949, 1340812947] Looping around the photos to save general results len do output : 1 /21013624Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813239', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813235', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340813015', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812949', None, None, None, None, None, '2633176') ('4234', None, None, None, None, None, None, None, '2633176') ('4234', '21013624', '1340812947', None, None, None, None, None, '2633176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01574254035949707 save_final save missing photos in datou_result : time spend for datou_step_exec : 36.48633527755737 time spend to save output : 0.01609659194946289 total time spend for step 11 : 36.502431869506836 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 57.23user 35.68system 4:02.31elapsed 38%CPU (0avgtext+0avgdata 2516208maxresident)k 878680inputs+19424outputs (1773major+3127941minor)pagefaults 0swaps