python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2618498 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2604476'] with mtr_portfolio_ids : ['20724470'] and first list_photo_ids : [] new path : /proc/2618498/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.3617696762084961 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Feb 21 12:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4617 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-21 12:20:32.473375: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-21 12:20:32.499153: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-21 12:20:32.501413: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc644000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-21 12:20:32.501475: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-21 12:20:32.505812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-21 12:20:32.667494: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x70553f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-21 12:20:32.667553: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-21 12:20:32.668520: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-21 12:20:32.668982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-21 12:20:32.672177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-21 12:20:32.675314: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-21 12:20:32.675852: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-21 12:20:32.678577: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-21 12:20:32.679884: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-21 12:20:32.685089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-21 12:20:32.686477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-21 12:20:32.686563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-21 12:20:32.687332: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-21 12:20:32.687354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-21 12:20:32.687365: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-21 12:20:32.688542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3936 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-21 12:20:32.952764: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-21 12:20:32.952887: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-21 12:20:32.952909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-21 12:20:32.952928: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-21 12:20:32.952947: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-21 12:20:32.952965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-21 12:20:32.952983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-21 12:20:32.953001: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-21 12:20:32.954311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-21 12:20:32.955475: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-21 12:20:32.955514: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-21 12:20:32.955533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-21 12:20:32.955550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-21 12:20:32.955571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-21 12:20:32.955589: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-21 12:20:32.955606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-21 12:20:32.955623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-21 12:20:32.956692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-21 12:20:32.956729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-21 12:20:32.956739: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-21 12:20:32.956749: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-21 12:20:32.957877: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3936 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-21 12:20:42.291644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-21 12:20:42.490552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-21 12:20:44.063417: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.064367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.01G (3233061120 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.065392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.71G (2909754880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.066162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.44G (2618779392 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.066721: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.19G (2356901376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.066756: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.067347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.067366: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.085448: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.085512: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.086416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.086435: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.096883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.096920: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.097825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.097845: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.153346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.153444: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.154031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.154049: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.159959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.160009: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.160921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.160941: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 12:20:44.191224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.192181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.194259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.195190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.232767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.233425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.235493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.236076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.262621: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.263400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.265015: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.265604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.271157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.271742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.273443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.274025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.279731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.280315: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.281864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.282467: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.311419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.312187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.312822: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.313399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.317259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.317865: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.334095: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.334694: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.335289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.335866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.348463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.349044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.349616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.350186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.354585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.355187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.359972: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.360588: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.372967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.373566: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.378759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.379865: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.380902: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.381915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.383599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.384359: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.395231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.395987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.396714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.397287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.397946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.398543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.399167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.399787: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.409269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.409841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.417049: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.418237: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.473450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.474083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.482278: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.482911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.502674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.503327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.503929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.504536: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.508676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.509254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.509819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.510382: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.511544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.511564: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-21 12:20:44.521731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.522310: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.531366: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.531980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.532580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.533174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.533764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 12:20:44.534339: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.34G (3592290304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.23516 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 934 time to create 1 rle with old method : 0.0019221305847167969 length of segment : 35 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 733 time to create 1 rle with old method : 0.0014836788177490234 length of segment : 32 length of segment : 0 time for calcul the mask position with numpy : 0.00012874603271484375 nb_pixel_total : 982 time to create 1 rle with old method : 0.002155303955078125 length of segment : 60 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.002831697463989258 length of segment : 69 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0006561279296875 length of segment : 45 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0003142356872558594 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.00469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 38 time to create 1 rle with old method : 8.678436279296875e-05 length of segment : 6 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 849 time to create 1 rle with old method : 0.0010309219360351562 length of segment : 52 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 3009 time to create 1 rle with old method : 0.003760099411010742 length of segment : 56 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 2719 time to create 1 rle with old method : 0.003389596939086914 length of segment : 55 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 2700 time to create 1 rle with old method : 0.0033898353576660156 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.12578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00011348724365234375 nb_pixel_total : 6316 time to create 1 rle with old method : 0.007800579071044922 length of segment : 119 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006659030914306641 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.40313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005381107330322266 length of segment : 42 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0006396770477294922 length of segment : 22 time for calcul the mask position with numpy : 0.0001938343048095703 nb_pixel_total : 7694 time to create 1 rle with old method : 0.009910106658935547 length of segment : 132 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0015478134155273438 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 111.44766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006656646728515625 length of segment : 21 time for calcul the mask position with numpy : 0.0006437301635742188 nb_pixel_total : 58542 time to create 1 rle with old method : 0.08094120025634766 length of segment : 259 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 1600 time to create 1 rle with old method : 0.0020148754119873047 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -92.55156 max: 61.15078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.40313 max: 150.90469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006840229034423828 length of segment : 19 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00033855438232421875 length of segment : 18 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 2237 time to create 1 rle with old method : 0.0028803348541259766 length of segment : 52 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002307891845703125 length of segment : 11 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00029730796813964844 length of segment : 11 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003440380096435547 length of segment : 18 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004951953887939453 length of segment : 26 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006566047668457031 length of segment : 22 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.000331878662109375 length of segment : 13 time for calcul the mask position with numpy : 0.0001678466796875 nb_pixel_total : 5878 time to create 1 rle with old method : 0.01088571548461914 length of segment : 110 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0009593963623046875 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.07109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0007543563842773438 length of segment : 18 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.000415802001953125 length of segment : 19 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001647472381591797 length of segment : 11 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0009214878082275391 length of segment : 34 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005192756652832031 length of segment : 12 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0008094310760498047 length of segment : 21 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00017142295837402344 length of segment : 15 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0006172657012939453 length of segment : 16 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.0001418590545654297 length of segment : 8 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.00040984153747558594 length of segment : 17 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 16 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0004937648773193359 length of segment : 40 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.00020599365234375 length of segment : 9 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00020575523376464844 length of segment : 16 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001895427703857422 length of segment : 14 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0008294582366943359 length of segment : 14 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0006418228149414062 length of segment : 31 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0007364749908447266 length of segment : 22 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1097 time to create 1 rle with old method : 0.0015642642974853516 length of segment : 30 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 668 time to create 1 rle with old method : 0.0009894371032714844 length of segment : 30 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002689361572265625 length of segment : 16 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.00030875205993652344 length of segment : 17 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007555484771728516 length of segment : 49 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004436969757080078 length of segment : 25 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0008533000946044922 length of segment : 26 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.0004329681396484375 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.85234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0004284381866455078 length of segment : 17 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0015325546264648438 length of segment : 41 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1040 time to create 1 rle with old method : 0.0014040470123291016 length of segment : 28 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007774829864501953 length of segment : 13 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1243 time to create 1 rle with old method : 0.0015611648559570312 length of segment : 39 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 1495 time to create 1 rle with old method : 0.0018718242645263672 length of segment : 103 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.00048279762268066406 length of segment : 16 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0010297298431396484 length of segment : 37 time for calcul the mask position with numpy : 0.0005445480346679688 nb_pixel_total : 7457 time to create 1 rle with old method : 0.008911848068237305 length of segment : 177 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.0003142356872558594 length of segment : 8 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0006830692291259766 length of segment : 16 time for calcul the mask position with numpy : 0.00031185150146484375 nb_pixel_total : 7310 time to create 1 rle with old method : 0.012296915054321289 length of segment : 201 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006227493286132812 length of segment : 43 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 1884 time to create 1 rle with old method : 0.0024216175079345703 length of segment : 157 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1641 time to create 1 rle with old method : 0.0022144317626953125 length of segment : 39 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 2194 time to create 1 rle with old method : 0.0029218196868896484 length of segment : 172 time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 4915 time to create 1 rle with old method : 0.005830049514770508 length of segment : 204 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 1591 time to create 1 rle with old method : 0.0020971298217773438 length of segment : 74 Processing 1 images image shape: (280, 400, 3) min: 3.00000 max: 196.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 81.92422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009922981262207031 nb_pixel_total : 105541 time to create 1 rle with old method : 0.14964675903320312 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.94766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 2762 time to create 1 rle with old method : 0.003461122512817383 length of segment : 55 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00040340423583984375 length of segment : 19 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.00021886825561523438 length of segment : 12 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0009427070617675781 length of segment : 32 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006463527679443359 length of segment : 62 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 43 time to create 1 rle with old method : 0.00013208389282226562 length of segment : 6 time for calcul the mask position with numpy : 0.00014066696166992188 nb_pixel_total : 2128 time to create 1 rle with old method : 0.003153085708618164 length of segment : 109 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.00012993812561035156 length of segment : 14 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005714893341064453 length of segment : 25 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0003058910369873047 length of segment : 12 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0007042884826660156 length of segment : 23 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 1390 time to create 1 rle with old method : 0.0017294883728027344 length of segment : 56 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.00044727325439453125 length of segment : 27 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001766681671142578 length of segment : 12 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.74453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 44 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0006763935089111328 length of segment : 20 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0008554458618164062 length of segment : 17 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 936 time to create 1 rle with old method : 0.0013484954833984375 length of segment : 39 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0005507469177246094 length of segment : 22 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003581047058105469 length of segment : 17 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 877 time to create 1 rle with old method : 0.0011322498321533203 length of segment : 35 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0006511211395263672 length of segment : 14 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00029277801513671875 length of segment : 19 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0007069110870361328 length of segment : 26 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00027942657470703125 length of segment : 19 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0005457401275634766 length of segment : 15 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0004794597625732422 length of segment : 22 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 687 time to create 1 rle with old method : 0.001102447509765625 length of segment : 30 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005645751953125 length of segment : 32 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002002716064453125 length of segment : 15 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 821 time to create 1 rle with old method : 0.0011343955993652344 length of segment : 39 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 12 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1242 time to create 1 rle with old method : 0.0015714168548583984 length of segment : 43 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0004665851593017578 length of segment : 20 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0006313323974609375 length of segment : 18 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001773834228515625 length of segment : 13 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.0002493858337402344 length of segment : 13 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007672309875488281 length of segment : 19 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0005810260772705078 length of segment : 19 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0005533695220947266 length of segment : 21 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00029468536376953125 length of segment : 16 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.00102996826171875 length of segment : 18 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0006098747253417969 length of segment : 19 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.000156402587890625 length of segment : 10 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1032 time to create 1 rle with old method : 0.0018973350524902344 length of segment : 31 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 707 time to create 1 rle with old method : 0.0013391971588134766 length of segment : 30 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00023293495178222656 length of segment : 9 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0006241798400878906 length of segment : 17 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00025177001953125 length of segment : 10 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00017786026000976562 length of segment : 6 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002999305725097656 length of segment : 12 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.0006239414215087891 length of segment : 21 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0005133152008056641 length of segment : 18 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0008268356323242188 length of segment : 19 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0012428760528564453 length of segment : 17 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0012156963348388672 length of segment : 31 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.0002841949462890625 length of segment : 12 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0013034343719482422 length of segment : 53 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.000545501708984375 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.28359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00026607513427734375 length of segment : 22 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 797 time to create 1 rle with old method : 0.0011169910430908203 length of segment : 24 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005426406860351562 length of segment : 24 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 4629 time to create 1 rle with old method : 0.005741119384765625 length of segment : 82 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007236003875732422 length of segment : 34 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.00019431114196777344 length of segment : 35 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006384849548339844 length of segment : 28 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 27 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006606578826904297 length of segment : 62 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005741119384765625 length of segment : 29 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00029850006103515625 length of segment : 20 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.000732421875 length of segment : 116 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 5597 time to create 1 rle with old method : 0.00716710090637207 length of segment : 106 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.23516 max: 145.32656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0012121200561523438 length of segment : 41 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.0011713504791259766 length of segment : 36 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0002524852752685547 length of segment : 27 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.00061798095703125 length of segment : 53 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.00012183189392089844 length of segment : 32 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 49 time to create 1 rle with old method : 0.00013375282287597656 length of segment : 26 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002551078796386719 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.61406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 38 time to create 1 rle with old method : 9.083747863769531e-05 length of segment : 7 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005800724029541016 length of segment : 34 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 2541 time to create 1 rle with old method : 0.003086566925048828 length of segment : 52 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.0009949207305908203 length of segment : 46 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0009326934814453125 length of segment : 35 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 2793 time to create 1 rle with old method : 0.003438711166381836 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.43828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 6382 time to create 1 rle with old method : 0.007531166076660156 length of segment : 128 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006794929504394531 length of segment : 22 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2877 time to create 1 rle with old method : 0.0038101673126220703 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.76641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.000308990478515625 length of segment : 27 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1060 time to create 1 rle with old method : 0.0013415813446044922 length of segment : 42 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 8411 time to create 1 rle with old method : 0.01033473014831543 length of segment : 122 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0014469623565673828 length of segment : 43 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.00029730796813964844 length of segment : 23 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006487369537353516 length of segment : 24 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 426 time to create 1 rle with old method : 0.0006957054138183594 length of segment : 25 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 254.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 126.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0008087158203125 length of segment : 24 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005309581756591797 length of segment : 39 time for calcul the mask position with numpy : 0.0005269050598144531 nb_pixel_total : 42119 time to create 1 rle with old method : 0.052076101303100586 length of segment : 260 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0009889602661132812 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -92.55156 max: 63.33828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.13359 max: 150.24453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.00034236907958984375 length of segment : 14 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003509521484375 length of segment : 18 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 5403 time to create 1 rle with old method : 0.006436824798583984 length of segment : 99 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0006108283996582031 length of segment : 16 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 2313 time to create 1 rle with old method : 0.0030579566955566406 length of segment : 46 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 16 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005388259887695312 length of segment : 25 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0007245540618896484 length of segment : 23 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006439685821533203 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.06328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 25 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0007007122039794922 length of segment : 18 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003478527069091797 length of segment : 18 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001556873321533203 length of segment : 10 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.000823974609375 length of segment : 24 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004591941833496094 length of segment : 17 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0004475116729736328 length of segment : 17 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0005013942718505859 length of segment : 11 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009882450103759766 length of segment : 39 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1268 time to create 1 rle with old method : 0.0015864372253417969 length of segment : 50 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00041604042053222656 length of segment : 17 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 743 time to create 1 rle with old method : 0.0009410381317138672 length of segment : 74 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005147457122802734 length of segment : 43 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00014925003051757812 length of segment : 12 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0008559226989746094 length of segment : 21 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00037670135498046875 length of segment : 21 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0009307861328125 length of segment : 45 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00035834312438964844 length of segment : 15 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.000118255615234375 length of segment : 7 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006859302520751953 length of segment : 14 time for calcul the mask position with numpy : 0.0003349781036376953 nb_pixel_total : 17181 time to create 1 rle with old method : 0.019717931747436523 length of segment : 139 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 15 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 650 time to create 1 rle with old method : 0.0008382797241210938 length of segment : 33 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.00029349327087402344 length of segment : 17 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0006780624389648438 length of segment : 15 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0008366107940673828 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.44219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.000576019287109375 length of segment : 15 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1033 time to create 1 rle with old method : 0.0019068717956542969 length of segment : 26 time for calcul the mask position with numpy : 0.00013208389282226562 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0020046234130859375 length of segment : 105 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0020589828491210938 length of segment : 40 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0013244152069091797 length of segment : 37 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0007119178771972656 length of segment : 28 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 1057 time to create 1 rle with old method : 0.002124786376953125 length of segment : 43 time for calcul the mask position with numpy : 0.00033402442932128906 nb_pixel_total : 8746 time to create 1 rle with old method : 0.014727592468261719 length of segment : 208 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004246234893798828 length of segment : 15 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 16 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007359981536865234 length of segment : 16 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0006792545318603516 length of segment : 15 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0016410350799560547 length of segment : 45 time for calcul the mask position with numpy : 0.00019860267639160156 nb_pixel_total : 6811 time to create 1 rle with old method : 0.007980108261108398 length of segment : 175 time for calcul the mask position with numpy : 0.00023126602172851562 nb_pixel_total : 7968 time to create 1 rle with old method : 0.009288311004638672 length of segment : 195 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 116.41641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.00037980079650878906 length of segment : 30 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 634 time to create 1 rle with old method : 0.0008645057678222656 length of segment : 43 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00023865699768066406 length of segment : 30 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001556873321533203 length of segment : 26 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 2067 time to create 1 rle with old method : 0.003206491470336914 length of segment : 47 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1774 time to create 1 rle with old method : 0.0021266937255859375 length of segment : 86 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0016443729400634766 length of segment : 58 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1686 time to create 1 rle with old method : 0.0020995140075683594 length of segment : 40 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0015821456909179688 length of segment : 67 time for calcul the mask position with numpy : 0.00019502639770507812 nb_pixel_total : 4664 time to create 1 rle with old method : 0.005478620529174805 length of segment : 187 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1733 time to create 1 rle with old method : 0.002122163772583008 length of segment : 89 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 193.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 80.63906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.98672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1805 time to create 1 rle with old method : 0.002407073974609375 length of segment : 53 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 17 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00046324729919433594 length of segment : 50 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 46 time to create 1 rle with old method : 0.00010991096496582031 length of segment : 14 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00022554397583007812 length of segment : 11 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.0011410713195800781 length of segment : 28 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1263 time to create 1 rle with old method : 0.0017342567443847656 length of segment : 40 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.000518798828125 length of segment : 26 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009875297546386719 length of segment : 37 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0007739067077636719 length of segment : 33 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00036787986755371094 length of segment : 22 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0009715557098388672 length of segment : 34 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 43 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0004265308380126953 length of segment : 19 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0012531280517578125 length of segment : 40 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0011146068572998047 length of segment : 35 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005080699920654297 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003135204315185547 length of segment : 15 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0005481243133544922 length of segment : 23 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002231597900390625 length of segment : 19 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003559589385986328 length of segment : 20 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0007562637329101562 length of segment : 16 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0003426074981689453 length of segment : 18 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 679 time to create 1 rle with old method : 0.0009372234344482422 length of segment : 30 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004894733428955078 length of segment : 20 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.000217437744140625 length of segment : 14 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 782 time to create 1 rle with old method : 0.0010781288146972656 length of segment : 53 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00038743019104003906 length of segment : 16 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00023746490478515625 length of segment : 13 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0007865428924560547 length of segment : 16 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0003211498260498047 length of segment : 16 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1093 time to create 1 rle with old method : 0.001523733139038086 length of segment : 32 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.0009393692016601562 length of segment : 43 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00018525123596191406 length of segment : 9 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00013303756713867188 length of segment : 12 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005180835723876953 length of segment : 29 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00022172927856445312 length of segment : 20 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004513263702392578 length of segment : 24 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00014138221740722656 length of segment : 7 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0006494522094726562 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00017786026000976562 length of segment : 12 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1723 time to create 1 rle with old method : 0.0019636154174804688 length of segment : 76 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0007078647613525391 length of segment : 19 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00037288665771484375 length of segment : 20 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003199577331542969 length of segment : 19 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001614093780517578 length of segment : 16 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.00020051002502441406 length of segment : 11 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005648136138916016 length of segment : 17 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.00031304359436035156 length of segment : 18 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006923675537109375 length of segment : 15 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 639 time to create 1 rle with old method : 0.00080108642578125 length of segment : 37 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006492137908935547 length of segment : 19 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 580 time to create 1 rle with old method : 0.0007462501525878906 length of segment : 25 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.00048089027404785156 length of segment : 18 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.0007536411285400391 length of segment : 18 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.0001838207244873047 length of segment : 12 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.26797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002543926239013672 length of segment : 22 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005893707275390625 length of segment : 31 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005545616149902344 length of segment : 32 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003314018249511719 length of segment : 37 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.00037598609924316406 length of segment : 28 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0010657310485839844 length of segment : 24 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003604888916015625 length of segment : 18 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1745 time to create 1 rle with old method : 0.0021805763244628906 length of segment : 148 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1263 time to create 1 rle with old method : 0.0015833377838134766 length of segment : 77 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.87188 max: 144.99062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 980 time to create 1 rle with old method : 0.0016057491302490234 length of segment : 43 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00015616416931152344 length of segment : 27 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00029587745666503906 length of segment : 28 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1630 time to create 1 rle with old method : 0.002131938934326172 length of segment : 50 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00017905235290527344 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.05156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 39 time to create 1 rle with old method : 8.368492126464844e-05 length of segment : 6 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 2643 time to create 1 rle with old method : 0.003345012664794922 length of segment : 53 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2949 time to create 1 rle with old method : 0.003575563430786133 length of segment : 54 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2586 time to create 1 rle with old method : 0.0030946731567382812 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.00859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 5933 time to create 1 rle with old method : 0.0068972110748291016 length of segment : 101 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 5402 time to create 1 rle with old method : 0.006455421447753906 length of segment : 119 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.16094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00015497207641601562 nb_pixel_total : 9870 time to create 1 rle with old method : 0.011680126190185547 length of segment : 116 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0006618499755859375 length of segment : 70 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00043320655822753906 length of segment : 19 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1131 time to create 1 rle with old method : 0.0013818740844726562 length of segment : 43 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006020069122314453 length of segment : 23 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1096 time to create 1 rle with old method : 0.0013916492462158203 length of segment : 43 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0013434886932373047 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 240.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 125.40859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 534 time to create 1 rle with old method : 0.0007483959197998047 length of segment : 23 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0007450580596923828 length of segment : 23 time for calcul the mask position with numpy : 0.0005369186401367188 nb_pixel_total : 50041 time to create 1 rle with old method : 0.056177377700805664 length of segment : 329 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 946 time to create 1 rle with old method : 0.0012044906616210938 length of segment : 63 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -92.57109 max: 69.43203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.61406 max: 148.58828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00036525726318359375 length of segment : 19 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004391670227050781 length of segment : 24 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 2169 time to create 1 rle with old method : 0.0026912689208984375 length of segment : 47 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019979476928710938 length of segment : 11 time for calcul the mask position with numpy : 0.00011157989501953125 nb_pixel_total : 6522 time to create 1 rle with old method : 0.007729291915893555 length of segment : 108 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00025010108947753906 length of segment : 11 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002987384796142578 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.07109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 29 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007615089416503906 length of segment : 20 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00037360191345214844 length of segment : 16 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0005691051483154297 length of segment : 15 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 774 time to create 1 rle with old method : 0.001031637191772461 length of segment : 40 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002655982971191406 length of segment : 15 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.0001392364501953125 length of segment : 10 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002620220184326172 length of segment : 18 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010750293731689453 length of segment : 74 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 774 time to create 1 rle with old method : 0.0009756088256835938 length of segment : 40 time for calcul the mask position with numpy : 0.00038743019104003906 nb_pixel_total : 14904 time to create 1 rle with old method : 0.017381906509399414 length of segment : 122 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.0005011558532714844 length of segment : 16 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.0011131763458251953 length of segment : 34 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0007531642913818359 length of segment : 23 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00015020370483398438 length of segment : 14 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.00043487548828125 length of segment : 17 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.000492095947265625 length of segment : 25 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0007252693176269531 length of segment : 35 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00019049644470214844 length of segment : 14 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007421970367431641 length of segment : 28 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.00052642822265625 length of segment : 13 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 47 time to create 1 rle with old method : 9.34600830078125e-05 length of segment : 7 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.000377655029296875 length of segment : 20 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0007345676422119141 length of segment : 22 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006754398345947266 length of segment : 15 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00038361549377441406 length of segment : 16 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004582405090332031 length of segment : 18 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0007162094116210938 length of segment : 14 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.00032830238342285156 length of segment : 16 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0008437633514404297 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.02031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00041794776916503906 length of segment : 16 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0009584426879882812 length of segment : 14 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1123 time to create 1 rle with old method : 0.0013811588287353516 length of segment : 39 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.0013821125030517578 length of segment : 38 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0017309188842773438 length of segment : 118 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.00046944618225097656 length of segment : 16 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0010356903076171875 length of segment : 37 time for calcul the mask position with numpy : 0.0002522468566894531 nb_pixel_total : 7632 time to create 1 rle with old method : 0.009021282196044922 length of segment : 197 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 977 time to create 1 rle with old method : 0.0013248920440673828 length of segment : 28 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0004432201385498047 length of segment : 16 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 248.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.29531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1298 time to create 1 rle with old method : 0.0016548633575439453 length of segment : 33 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1062 time to create 1 rle with old method : 0.0014643669128417969 length of segment : 48 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1857 time to create 1 rle with old method : 0.0024442672729492188 length of segment : 140 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 2322 time to create 1 rle with old method : 0.0029630661010742188 length of segment : 153 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 3504 time to create 1 rle with old method : 0.004380464553833008 length of segment : 182 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.000705718994140625 length of segment : 26 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 909 time to create 1 rle with old method : 0.0010962486267089844 length of segment : 71 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006432533264160156 length of segment : 27 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1645 time to create 1 rle with old method : 0.002063274383544922 length of segment : 77 Processing 1 images image shape: (280, 400, 3) min: 11.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 84.70547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012476444244384766 nb_pixel_total : 105621 time to create 1 rle with old method : 0.13956475257873535 length of segment : 285 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1741 time to create 1 rle with old method : 0.0027713775634765625 length of segment : 41 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.00035858154296875 length of segment : 17 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.0002295970916748047 length of segment : 12 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 3246 time to create 1 rle with old method : 0.003943204879760742 length of segment : 131 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00014495849609375 length of segment : 15 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0010037422180175781 length of segment : 28 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 671 time to create 1 rle with old method : 0.0008599758148193359 length of segment : 32 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007376670837402344 length of segment : 68 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004050731658935547 length of segment : 24 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006337165832519531 length of segment : 25 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004899501800537109 length of segment : 36 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0008835792541503906 length of segment : 33 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00041556358337402344 length of segment : 26 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 37 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.0011684894561767578 length of segment : 37 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.00044608116149902344 length of segment : 20 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 22 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 897 time to create 1 rle with old method : 0.0012509822845458984 length of segment : 36 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006570816040039062 length of segment : 17 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006754398345947266 length of segment : 14 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.00021028518676757812 length of segment : 18 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00033545494079589844 length of segment : 16 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003972053527832031 length of segment : 23 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002658367156982422 length of segment : 17 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003688335418701172 length of segment : 13 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002651214599609375 length of segment : 14 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0001914501190185547 length of segment : 14 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 652 time to create 1 rle with old method : 0.0008332729339599609 length of segment : 29 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0007293224334716797 length of segment : 19 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00040793418884277344 length of segment : 18 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0009129047393798828 length of segment : 43 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006177425384521484 length of segment : 24 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 719 time to create 1 rle with old method : 0.0009100437164306641 length of segment : 54 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006349086761474609 length of segment : 16 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006163120269775391 length of segment : 30 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0008227825164794922 length of segment : 27 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00014257431030273438 length of segment : 7 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00017404556274414062 length of segment : 12 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00022554397583007812 length of segment : 11 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005881786346435547 length of segment : 26 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00033545494079589844 length of segment : 21 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005393028259277344 length of segment : 18 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1276 time to create 1 rle with old method : 0.0016541481018066406 length of segment : 41 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00013637542724609375 length of segment : 9 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002396106719970703 length of segment : 21 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 649 time to create 1 rle with old method : 0.0009064674377441406 length of segment : 21 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003299713134765625 length of segment : 19 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.00032782554626464844 length of segment : 23 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 860 time to create 1 rle with old method : 0.0012693405151367188 length of segment : 29 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.00033855438232421875 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015163421630859375 length of segment : 8 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.39297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002396106719970703 length of segment : 21 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002930164337158203 length of segment : 16 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006420612335205078 length of segment : 33 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0005474090576171875 length of segment : 70 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003955364227294922 length of segment : 34 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00017571449279785156 length of segment : 24 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0011286735534667969 length of segment : 25 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005919933319091797 length of segment : 27 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005795955657958984 length of segment : 35 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 15 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1163 time to create 1 rle with old method : 0.0014426708221435547 length of segment : 54 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005156993865966797 length of segment : 22 time for calcul the mask position with numpy : 0.00011515617370605469 nb_pixel_total : 4779 time to create 1 rle with old method : 0.00570368766784668 length of segment : 83 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005824565887451172 length of segment : 69 time for calcul the mask position with numpy : 0.0005240440368652344 nb_pixel_total : 46390 time to create 1 rle with old method : 0.052828073501586914 length of segment : 266 Detection mask done ! Trying to reset tf kernel 2619195 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 183 tf kernel not reseted sub process len(results) : 442 len(list_Values) 442 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 442 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1376 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 442 chid ids of type : 4228 Number RLEs to save : 17436 save missing photos in datou_result : time spend for datou_step_exec : 27.919050216674805 time spend to save output : 1.2506396770477295 total time spend for step 1 : 29.169689893722534 step2:brightness Fri Feb 21 12:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740136829_2618498_1338802818_9e086c86e5c7fd2ef8aaf0ee49c35273.jpg treat image : temp/1740136829_2618498_1338802817_34b25d238f8e7e8d5ce91af8262a37e2.jpg treat image : temp/1740136829_2618498_1338802800_6d30fa9c58d704718326b65a7b61dea6.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.013019800186157227 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.020781517028808594 save missing photos in datou_result : time spend for datou_step_exec : 0.7701339721679688 time spend to save output : 0.03826427459716797 total time spend for step 2 : 0.8083982467651367 step3:blur_detection Fri Feb 21 12:20:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740136829_2618498_1338802818_9e086c86e5c7fd2ef8aaf0ee49c35273.jpg resize: (1080, 1920) 1338802818 -7.6365901971829615 treat image : temp/1740136829_2618498_1338802817_34b25d238f8e7e8d5ce91af8262a37e2.jpg resize: (1080, 1920) 1338802817 -7.639903479289979 treat image : temp/1740136829_2618498_1338802800_6d30fa9c58d704718326b65a7b61dea6.jpg resize: (1080, 1920) 1338802800 -7.6385903746191675 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.01283407211303711 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.010826587677001953 save missing photos in datou_result : time spend for datou_step_exec : 2.581951856613159 time spend to save output : 0.028357982635498047 total time spend for step 3 : 2.6103098392486572 step4:rle_unique_nms_with_priority Fri Feb 21 12:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 442 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 147 nb_hashtags : 7 time to prepare the origin masks : 1.1876206398010254 time for calcul the mask position with numpy : 0.026067495346069336 nb_pixel_total : 1800268 time to create 1 rle with new method : 0.46368837356567383 time for calcul the mask position with numpy : 0.008558273315429688 nb_pixel_total : 934 time to create 1 rle with old method : 0.0011210441589355469 time for calcul the mask position with numpy : 0.010120868682861328 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001304149627685547 time for calcul the mask position with numpy : 0.00851583480834961 nb_pixel_total : 257 time to create 1 rle with old method : 0.00032711029052734375 time for calcul the mask position with numpy : 0.008443593978881836 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0016129016876220703 time for calcul the mask position with numpy : 0.010928869247436523 nb_pixel_total : 38 time to create 1 rle with old method : 8.535385131835938e-05 time for calcul the mask position with numpy : 0.008820533752441406 nb_pixel_total : 3 time to create 1 rle with old method : 6.079673767089844e-05 time for calcul the mask position with numpy : 0.008440971374511719 nb_pixel_total : 3009 time to create 1 rle with old method : 0.0033729076385498047 time for calcul the mask position with numpy : 0.00837564468383789 nb_pixel_total : 10 time to create 1 rle with old method : 6.437301635742188e-05 time for calcul the mask position with numpy : 0.008728742599487305 nb_pixel_total : 58542 time to create 1 rle with old method : 0.06495547294616699 time for calcul the mask position with numpy : 0.008481502532958984 nb_pixel_total : 5 time to create 1 rle with old method : 2.2649765014648438e-05 time for calcul the mask position with numpy : 0.008388757705688477 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004076957702636719 time for calcul the mask position with numpy : 0.008356332778930664 nb_pixel_total : 982 time to create 1 rle with old method : 0.0011692047119140625 time for calcul the mask position with numpy : 0.008357048034667969 nb_pixel_total : 849 time to create 1 rle with old method : 0.000965118408203125 time for calcul the mask position with numpy : 0.008378267288208008 nb_pixel_total : 492 time to create 1 rle with old method : 0.0005660057067871094 time for calcul the mask position with numpy : 0.008370637893676758 nb_pixel_total : 6316 time to create 1 rle with old method : 0.00710296630859375 time for calcul the mask position with numpy : 0.008427143096923828 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005197525024414062 time for calcul the mask position with numpy : 0.008675098419189453 nb_pixel_total : 7694 time to create 1 rle with old method : 0.01037740707397461 time for calcul the mask position with numpy : 0.008694171905517578 nb_pixel_total : 1600 time to create 1 rle with old method : 0.0018627643585205078 time for calcul the mask position with numpy : 0.008570194244384766 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0013720989227294922 time for calcul the mask position with numpy : 0.008430719375610352 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005452632904052734 time for calcul the mask position with numpy : 0.008360624313354492 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005707740783691406 time for calcul the mask position with numpy : 0.008364200592041016 nb_pixel_total : 65 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.00842428207397461 nb_pixel_total : 213 time to create 1 rle with old method : 0.000377655029296875 time for calcul the mask position with numpy : 0.010463953018188477 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005228519439697266 time for calcul the mask position with numpy : 0.010455846786499023 nb_pixel_total : 668 time to create 1 rle with old method : 0.001020193099975586 time for calcul the mask position with numpy : 0.008675098419189453 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003886222839355469 time for calcul the mask position with numpy : 0.009111404418945312 nb_pixel_total : 13 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.008471250534057617 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003027915954589844 time for calcul the mask position with numpy : 0.008480548858642578 nb_pixel_total : 95 time to create 1 rle with old method : 0.000133514404296875 time for calcul the mask position with numpy : 0.008452653884887695 nb_pixel_total : 817 time to create 1 rle with old method : 0.0009124279022216797 time for calcul the mask position with numpy : 0.008411407470703125 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006251335144042969 time for calcul the mask position with numpy : 0.008405447006225586 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.008376121520996094 nb_pixel_total : 1243 time to create 1 rle with old method : 0.0013988018035888672 time for calcul the mask position with numpy : 0.008365869522094727 nb_pixel_total : 1641 time to create 1 rle with old method : 0.0018613338470458984 time for calcul the mask position with numpy : 0.008469581604003906 nb_pixel_total : 5878 time to create 1 rle with old method : 0.006595611572265625 time for calcul the mask position with numpy : 0.008430242538452148 nb_pixel_total : 507 time to create 1 rle with old method : 0.0005826950073242188 time for calcul the mask position with numpy : 0.008311986923217773 nb_pixel_total : 1884 time to create 1 rle with old method : 0.0021767616271972656 time for calcul the mask position with numpy : 0.008038043975830078 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006501674652099609 time for calcul the mask position with numpy : 0.008240699768066406 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005307197570800781 time for calcul the mask position with numpy : 0.00830388069152832 nb_pixel_total : 4915 time to create 1 rle with old method : 0.005589485168457031 time for calcul the mask position with numpy : 0.008508682250976562 nb_pixel_total : 1634 time to create 1 rle with old method : 0.001963376998901367 time for calcul the mask position with numpy : 0.00882577896118164 nb_pixel_total : 337 time to create 1 rle with old method : 0.0005524158477783203 time for calcul the mask position with numpy : 0.008571147918701172 nb_pixel_total : 100 time to create 1 rle with old method : 0.00015115737915039062 time for calcul the mask position with numpy : 0.010039567947387695 nb_pixel_total : 1495 time to create 1 rle with old method : 0.002585172653198242 time for calcul the mask position with numpy : 0.008959293365478516 nb_pixel_total : 6985 time to create 1 rle with old method : 0.008231878280639648 time for calcul the mask position with numpy : 0.008374214172363281 nb_pixel_total : 579 time to create 1 rle with old method : 0.0006830692291259766 time for calcul the mask position with numpy : 0.008299112319946289 nb_pixel_total : 2237 time to create 1 rle with old method : 0.0026476383209228516 time for calcul the mask position with numpy : 0.008150100708007812 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001380443572998047 time for calcul the mask position with numpy : 0.00824427604675293 nb_pixel_total : 865 time to create 1 rle with old method : 0.0010864734649658203 time for calcul the mask position with numpy : 0.008972406387329102 nb_pixel_total : 1097 time to create 1 rle with old method : 0.0013554096221923828 time for calcul the mask position with numpy : 0.008417606353759766 nb_pixel_total : 93 time to create 1 rle with old method : 0.00011205673217773438 time for calcul the mask position with numpy : 0.008607625961303711 nb_pixel_total : 136 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.008381366729736328 nb_pixel_total : 1583 time to create 1 rle with old method : 0.0017728805541992188 time for calcul the mask position with numpy : 0.008376598358154297 nb_pixel_total : 22 time to create 1 rle with old method : 4.2438507080078125e-05 time for calcul the mask position with numpy : 0.008389472961425781 nb_pixel_total : 183 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.008410930633544922 nb_pixel_total : 126 time to create 1 rle with old method : 0.0001533031463623047 time for calcul the mask position with numpy : 0.008390665054321289 nb_pixel_total : 444 time to create 1 rle with old method : 0.00051116943359375 time for calcul the mask position with numpy : 0.00837254524230957 nb_pixel_total : 369 time to create 1 rle with old method : 0.0004475116729736328 time for calcul the mask position with numpy : 0.008414745330810547 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003731250762939453 time for calcul the mask position with numpy : 0.00857090950012207 nb_pixel_total : 643 time to create 1 rle with old method : 0.0008203983306884766 time for calcul the mask position with numpy : 0.008798837661743164 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001838207244873047 time for calcul the mask position with numpy : 0.008599281311035156 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005831718444824219 time for calcul the mask position with numpy : 0.008680343627929688 nb_pixel_total : 34 time to create 1 rle with old method : 8.082389831542969e-05 time for calcul the mask position with numpy : 0.008406877517700195 nb_pixel_total : 462 time to create 1 rle with old method : 0.000537872314453125 time for calcul the mask position with numpy : 0.008381843566894531 nb_pixel_total : 156 time to create 1 rle with old method : 0.0001919269561767578 time for calcul the mask position with numpy : 0.008352518081665039 nb_pixel_total : 201 time to create 1 rle with old method : 0.00023603439331054688 time for calcul the mask position with numpy : 0.008363962173461914 nb_pixel_total : 1040 time to create 1 rle with old method : 0.0012919902801513672 time for calcul the mask position with numpy : 0.00840139389038086 nb_pixel_total : 226 time to create 1 rle with old method : 0.00028014183044433594 time for calcul the mask position with numpy : 0.008235454559326172 nb_pixel_total : 516 time to create 1 rle with old method : 0.0005929470062255859 time for calcul the mask position with numpy : 0.008393049240112305 nb_pixel_total : 16 time to create 1 rle with old method : 4.982948303222656e-05 time for calcul the mask position with numpy : 0.00868844985961914 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001277923583984375 time for calcul the mask position with numpy : 0.008342742919921875 nb_pixel_total : 264 time to create 1 rle with old method : 0.00031447410583496094 time for calcul the mask position with numpy : 0.00849008560180664 nb_pixel_total : 34 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.008392333984375 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004432201385498047 time for calcul the mask position with numpy : 0.00839090347290039 nb_pixel_total : 316 time to create 1 rle with old method : 0.00037789344787597656 time for calcul the mask position with numpy : 0.00888824462890625 nb_pixel_total : 105541 time to create 1 rle with old method : 0.11848282814025879 time for calcul the mask position with numpy : 0.008469581604003906 nb_pixel_total : 54 time to create 1 rle with old method : 7.82012939453125e-05 time for calcul the mask position with numpy : 0.008487701416015625 nb_pixel_total : 127 time to create 1 rle with old method : 0.00015783309936523438 time for calcul the mask position with numpy : 0.008405685424804688 nb_pixel_total : 111 time to create 1 rle with old method : 0.00020384788513183594 time for calcul the mask position with numpy : 0.008316516876220703 nb_pixel_total : 687 time to create 1 rle with old method : 0.0008172988891601562 time for calcul the mask position with numpy : 0.008384227752685547 nb_pixel_total : 5597 time to create 1 rle with old method : 0.0062694549560546875 time for calcul the mask position with numpy : 0.008452177047729492 nb_pixel_total : 417 time to create 1 rle with old method : 0.0004858970642089844 time for calcul the mask position with numpy : 0.008331298828125 nb_pixel_total : 452 time to create 1 rle with old method : 0.0006132125854492188 time for calcul the mask position with numpy : 0.008358478546142578 nb_pixel_total : 64 time to create 1 rle with old method : 8.296966552734375e-05 time for calcul the mask position with numpy : 0.008394956588745117 nb_pixel_total : 291 time to create 1 rle with old method : 0.00032901763916015625 time for calcul the mask position with numpy : 0.008354663848876953 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002384185791015625 time for calcul the mask position with numpy : 0.008373737335205078 nb_pixel_total : 112 time to create 1 rle with old method : 0.00013446807861328125 time for calcul the mask position with numpy : 0.008347749710083008 nb_pixel_total : 254 time to create 1 rle with old method : 0.00029468536376953125 time for calcul the mask position with numpy : 0.008365392684936523 nb_pixel_total : 333 time to create 1 rle with old method : 0.0003905296325683594 time for calcul the mask position with numpy : 0.008333683013916016 nb_pixel_total : 261 time to create 1 rle with old method : 0.0002918243408203125 time for calcul the mask position with numpy : 0.009102821350097656 nb_pixel_total : 106 time to create 1 rle with old method : 0.00013637542724609375 time for calcul the mask position with numpy : 0.008321762084960938 nb_pixel_total : 43 time to create 1 rle with old method : 5.841255187988281e-05 time for calcul the mask position with numpy : 0.00879812240600586 nb_pixel_total : 1242 time to create 1 rle with old method : 0.0013911724090576172 time for calcul the mask position with numpy : 0.008351325988769531 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003342628479003906 time for calcul the mask position with numpy : 0.008431434631347656 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005147457122802734 time for calcul the mask position with numpy : 0.008203744888305664 nb_pixel_total : 132 time to create 1 rle with old method : 0.00018215179443359375 time for calcul the mask position with numpy : 0.00835418701171875 nb_pixel_total : 1 time to create 1 rle with old method : 5.412101745605469e-05 time for calcul the mask position with numpy : 0.009373903274536133 nb_pixel_total : 237 time to create 1 rle with old method : 0.0002853870391845703 time for calcul the mask position with numpy : 0.00839996337890625 nb_pixel_total : 19 time to create 1 rle with old method : 5.221366882324219e-05 time for calcul the mask position with numpy : 0.008435964584350586 nb_pixel_total : 707 time to create 1 rle with old method : 0.0008141994476318359 time for calcul the mask position with numpy : 0.008695125579833984 nb_pixel_total : 739 time to create 1 rle with old method : 0.0008797645568847656 time for calcul the mask position with numpy : 0.009681463241577148 nb_pixel_total : 105 time to create 1 rle with old method : 0.00013494491577148438 time for calcul the mask position with numpy : 0.008446216583251953 nb_pixel_total : 724 time to create 1 rle with old method : 0.0008566379547119141 time for calcul the mask position with numpy : 0.008948802947998047 nb_pixel_total : 418 time to create 1 rle with old method : 0.0007758140563964844 time for calcul the mask position with numpy : 0.008551359176635742 nb_pixel_total : 2762 time to create 1 rle with old method : 0.0031201839447021484 time for calcul the mask position with numpy : 0.008484601974487305 nb_pixel_total : 462 time to create 1 rle with old method : 0.00077056884765625 time for calcul the mask position with numpy : 0.009343624114990234 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006234645843505859 time for calcul the mask position with numpy : 0.008460044860839844 nb_pixel_total : 1388 time to create 1 rle with old method : 0.0020432472229003906 time for calcul the mask position with numpy : 0.008781909942626953 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003788471221923828 time for calcul the mask position with numpy : 0.008323907852172852 nb_pixel_total : 4629 time to create 1 rle with old method : 0.005163908004760742 time for calcul the mask position with numpy : 0.008409261703491211 nb_pixel_total : 157 time to create 1 rle with old method : 0.00018215179443359375 time for calcul the mask position with numpy : 0.008499860763549805 nb_pixel_total : 338 time to create 1 rle with old method : 0.00040435791015625 time for calcul the mask position with numpy : 0.009341716766357422 nb_pixel_total : 154 time to create 1 rle with old method : 0.00019311904907226562 time for calcul the mask position with numpy : 0.008389711380004883 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001289844512939453 time for calcul the mask position with numpy : 0.008368968963623047 nb_pixel_total : 821 time to create 1 rle with old method : 0.0009357929229736328 time for calcul the mask position with numpy : 0.008371353149414062 nb_pixel_total : 617 time to create 1 rle with old method : 0.0007581710815429688 time for calcul the mask position with numpy : 0.008329629898071289 nb_pixel_total : 2128 time to create 1 rle with old method : 0.002673625946044922 time for calcul the mask position with numpy : 0.009002447128295898 nb_pixel_total : 152 time to create 1 rle with old method : 0.0002772808074951172 time for calcul the mask position with numpy : 0.008502006530761719 nb_pixel_total : 1032 time to create 1 rle with old method : 0.0011832714080810547 time for calcul the mask position with numpy : 0.00842428207397461 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005190372467041016 time for calcul the mask position with numpy : 0.00937509536743164 nb_pixel_total : 16 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.008121967315673828 nb_pixel_total : 251 time to create 1 rle with old method : 0.0002722740173339844 time for calcul the mask position with numpy : 0.008162736892700195 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003554821014404297 time for calcul the mask position with numpy : 0.008502960205078125 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005030632019042969 time for calcul the mask position with numpy : 0.009524106979370117 nb_pixel_total : 213 time to create 1 rle with old method : 0.00025963783264160156 time for calcul the mask position with numpy : 0.008390426635742188 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004470348358154297 time for calcul the mask position with numpy : 0.008384943008422852 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001735687255859375 time for calcul the mask position with numpy : 0.010419607162475586 nb_pixel_total : 467 time to create 1 rle with old method : 0.0008189678192138672 time for calcul the mask position with numpy : 0.0088348388671875 nb_pixel_total : 312 time to create 1 rle with old method : 0.0003876686096191406 time for calcul the mask position with numpy : 0.008371591567993164 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002033710479736328 time for calcul the mask position with numpy : 0.008410215377807617 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001347064971923828 time for calcul the mask position with numpy : 0.008340597152709961 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005686283111572266 time for calcul the mask position with numpy : 0.008308172225952148 nb_pixel_total : 58 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.008435249328613281 nb_pixel_total : 797 time to create 1 rle with old method : 0.0010099411010742188 time for calcul the mask position with numpy : 0.008708953857421875 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.008621692657470703 nb_pixel_total : 327 time to create 1 rle with old method : 0.0003943443298339844 time for calcul the mask position with numpy : 0.008263349533081055 nb_pixel_total : 936 time to create 1 rle with old method : 0.0010914802551269531 time for calcul the mask position with numpy : 0.008360624313354492 nb_pixel_total : 877 time to create 1 rle with old method : 0.0011515617370605469 time for calcul the mask position with numpy : 0.008387327194213867 nb_pixel_total : 19 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.008351564407348633 nb_pixel_total : 509 time to create 1 rle with old method : 0.00057220458984375 time for calcul the mask position with numpy : 0.008359670639038086 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006074905395507812 time for calcul the mask position with numpy : 0.008372783660888672 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005145072937011719 time for calcul the mask position with numpy : 0.00836634635925293 nb_pixel_total : 73 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.008828163146972656 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002834796905517578 time for calcul the mask position with numpy : 0.008375167846679688 nb_pixel_total : 16 time to create 1 rle with old method : 3.4809112548828125e-05 time for calcul the mask position with numpy : 0.008408546447753906 nb_pixel_total : 130 time to create 1 rle with old method : 0.00016045570373535156 time for calcul the mask position with numpy : 0.008392572402954102 nb_pixel_total : 35 time to create 1 rle with old method : 4.744529724121094e-05 create new chi : 2.07846736907959 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.008609771728515625 batch 1 Loaded 148 chid ids of type : 4230 Number RLEs to save : 11466 TO DO : save crop sub photo not yet done ! save time : 0.8555295467376709 nb_obj : 151 nb_hashtags : 7 time to prepare the origin masks : 2.474461317062378 time for calcul the mask position with numpy : 0.03358960151672363 nb_pixel_total : 1913512 time to create 1 rle with new method : 0.08993911743164062 time for calcul the mask position with numpy : 0.010001182556152344 nb_pixel_total : 70 time to create 1 rle with old method : 0.00011610984802246094 time for calcul the mask position with numpy : 0.005770206451416016 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005037784576416016 time for calcul the mask position with numpy : 0.005923271179199219 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001456737518310547 time for calcul the mask position with numpy : 0.005990028381347656 nb_pixel_total : 896 time to create 1 rle with old method : 0.0010519027709960938 time for calcul the mask position with numpy : 0.00603032112121582 nb_pixel_total : 49 time to create 1 rle with old method : 9.679794311523438e-05 time for calcul the mask position with numpy : 0.005848884582519531 nb_pixel_total : 164 time to create 1 rle with old method : 0.00020933151245117188 time for calcul the mask position with numpy : 0.005915641784667969 nb_pixel_total : 30 time to create 1 rle with old method : 9.703636169433594e-05 time for calcul the mask position with numpy : 0.006205320358276367 nb_pixel_total : 38 time to create 1 rle with old method : 6.008148193359375e-05 time for calcul the mask position with numpy : 0.005963802337646484 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003764629364013672 time for calcul the mask position with numpy : 0.005920886993408203 nb_pixel_total : 2541 time to create 1 rle with old method : 0.0028710365295410156 time for calcul the mask position with numpy : 0.0060884952545166016 nb_pixel_total : 42119 time to create 1 rle with old method : 0.045961618423461914 time for calcul the mask position with numpy : 0.00639653205871582 nb_pixel_total : 446 time to create 1 rle with old method : 0.0005369186401367188 time for calcul the mask position with numpy : 0.00587010383605957 nb_pixel_total : 201 time to create 1 rle with old method : 0.00024199485778808594 time for calcul the mask position with numpy : 0.005942821502685547 nb_pixel_total : 804 time to create 1 rle with old method : 0.000919342041015625 time for calcul the mask position with numpy : 0.00584864616394043 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002617835998535156 time for calcul the mask position with numpy : 0.0061724185943603516 nb_pixel_total : 730 time to create 1 rle with old method : 0.0007877349853515625 time for calcul the mask position with numpy : 0.005923032760620117 nb_pixel_total : 507 time to create 1 rle with old method : 0.0005900859832763672 time for calcul the mask position with numpy : 0.00601649284362793 nb_pixel_total : 426 time to create 1 rle with old method : 0.0005025863647460938 time for calcul the mask position with numpy : 0.0059375762939453125 nb_pixel_total : 2877 time to create 1 rle with old method : 0.0032606124877929688 time for calcul the mask position with numpy : 0.005883216857910156 nb_pixel_total : 6382 time to create 1 rle with old method : 0.007126331329345703 time for calcul the mask position with numpy : 0.006684303283691406 nb_pixel_total : 382 time to create 1 rle with old method : 0.00045561790466308594 time for calcul the mask position with numpy : 0.005850791931152344 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005195140838623047 time for calcul the mask position with numpy : 0.00586700439453125 nb_pixel_total : 8411 time to create 1 rle with old method : 0.009562492370605469 time for calcul the mask position with numpy : 0.006748676300048828 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001621246337890625 time for calcul the mask position with numpy : 0.005866050720214844 nb_pixel_total : 1060 time to create 1 rle with old method : 0.0012400150299072266 time for calcul the mask position with numpy : 0.006032466888427734 nb_pixel_total : 573 time to create 1 rle with old method : 0.0006680488586425781 time for calcul the mask position with numpy : 0.005845069885253906 nb_pixel_total : 11 time to create 1 rle with old method : 4.410743713378906e-05 time for calcul the mask position with numpy : 0.006132364273071289 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005519390106201172 time for calcul the mask position with numpy : 0.005894899368286133 nb_pixel_total : 54 time to create 1 rle with old method : 8.249282836914062e-05 time for calcul the mask position with numpy : 0.0062754154205322266 nb_pixel_total : 23 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.006041526794433594 nb_pixel_total : 392 time to create 1 rle with old method : 0.0004429817199707031 time for calcul the mask position with numpy : 0.0076618194580078125 nb_pixel_total : 661 time to create 1 rle with old method : 0.0007765293121337891 time for calcul the mask position with numpy : 0.00976872444152832 nb_pixel_total : 650 time to create 1 rle with old method : 0.0007421970367431641 time for calcul the mask position with numpy : 0.009943246841430664 nb_pixel_total : 38 time to create 1 rle with old method : 8.082389831542969e-05 time for calcul the mask position with numpy : 0.009664535522460938 nb_pixel_total : 280 time to create 1 rle with old method : 0.00032639503479003906 time for calcul the mask position with numpy : 0.00985264778137207 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002722740173339844 time for calcul the mask position with numpy : 0.010048627853393555 nb_pixel_total : 800 time to create 1 rle with old method : 0.0008955001831054688 time for calcul the mask position with numpy : 0.01133584976196289 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005667209625244141 time for calcul the mask position with numpy : 0.010166168212890625 nb_pixel_total : 222 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.010248661041259766 nb_pixel_total : 626 time to create 1 rle with old method : 0.000728607177734375 time for calcul the mask position with numpy : 0.01030731201171875 nb_pixel_total : 7 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.010287284851074219 nb_pixel_total : 16627 time to create 1 rle with old method : 0.01838207244873047 time for calcul the mask position with numpy : 0.010298967361450195 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0012829303741455078 time for calcul the mask position with numpy : 0.010096549987792969 nb_pixel_total : 363 time to create 1 rle with old method : 0.00045561790466308594 time for calcul the mask position with numpy : 0.01011204719543457 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004582405090332031 time for calcul the mask position with numpy : 0.011465311050415039 nb_pixel_total : 1686 time to create 1 rle with old method : 0.0018253326416015625 time for calcul the mask position with numpy : 0.010136127471923828 nb_pixel_total : 147 time to create 1 rle with old method : 0.0001881122589111328 time for calcul the mask position with numpy : 0.010287046432495117 nb_pixel_total : 5403 time to create 1 rle with old method : 0.00597691535949707 time for calcul the mask position with numpy : 0.011023759841918945 nb_pixel_total : 80 time to create 1 rle with old method : 0.00011229515075683594 time for calcul the mask position with numpy : 0.010915994644165039 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005495548248291016 time for calcul the mask position with numpy : 0.009772062301635742 nb_pixel_total : 7 time to create 1 rle with old method : 2.8371810913085938e-05 time for calcul the mask position with numpy : 0.010371685028076172 nb_pixel_total : 2067 time to create 1 rle with old method : 0.0024957656860351562 time for calcul the mask position with numpy : 0.010369539260864258 nb_pixel_total : 119 time to create 1 rle with old method : 0.00020384788513183594 time for calcul the mask position with numpy : 0.010864973068237305 nb_pixel_total : 8241 time to create 1 rle with old method : 0.009253740310668945 time for calcul the mask position with numpy : 0.010354280471801758 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0014827251434326172 time for calcul the mask position with numpy : 0.010930538177490234 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0012993812561035156 time for calcul the mask position with numpy : 0.011894702911376953 nb_pixel_total : 4664 time to create 1 rle with old method : 0.0065233707427978516 time for calcul the mask position with numpy : 0.011964559555053711 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002529621124267578 time for calcul the mask position with numpy : 0.0112457275390625 nb_pixel_total : 347 time to create 1 rle with old method : 0.00045752525329589844 time for calcul the mask position with numpy : 0.011165142059326172 nb_pixel_total : 743 time to create 1 rle with old method : 0.0008747577667236328 time for calcul the mask position with numpy : 0.011289358139038086 nb_pixel_total : 80 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.011188030242919922 nb_pixel_total : 2313 time to create 1 rle with old method : 0.0026731491088867188 time for calcul the mask position with numpy : 0.011145830154418945 nb_pixel_total : 124 time to create 1 rle with old method : 0.00021886825561523438 time for calcul the mask position with numpy : 0.0113525390625 nb_pixel_total : 1057 time to create 1 rle with old method : 0.001321554183959961 time for calcul the mask position with numpy : 0.007207155227661133 nb_pixel_total : 86 time to create 1 rle with old method : 0.00012040138244628906 time for calcul the mask position with numpy : 0.006459712982177734 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009200572967529297 time for calcul the mask position with numpy : 0.006721019744873047 nb_pixel_total : 49 time to create 1 rle with old method : 9.608268737792969e-05 time for calcul the mask position with numpy : 0.00656437873840332 nb_pixel_total : 1774 time to create 1 rle with old method : 0.0019812583923339844 time for calcul the mask position with numpy : 0.006433725357055664 nb_pixel_total : 195 time to create 1 rle with old method : 0.00025582313537597656 time for calcul the mask position with numpy : 0.006506919860839844 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003933906555175781 time for calcul the mask position with numpy : 0.006535530090332031 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005936622619628906 time for calcul the mask position with numpy : 0.006510496139526367 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003046989440917969 time for calcul the mask position with numpy : 0.006685972213745117 nb_pixel_total : 1268 time to create 1 rle with old method : 0.001497030258178711 time for calcul the mask position with numpy : 0.006554603576660156 nb_pixel_total : 244 time to create 1 rle with old method : 0.00029468536376953125 time for calcul the mask position with numpy : 0.0065724849700927734 nb_pixel_total : 634 time to create 1 rle with old method : 0.0007424354553222656 time for calcul the mask position with numpy : 0.006344318389892578 nb_pixel_total : 471 time to create 1 rle with old method : 0.000598907470703125 time for calcul the mask position with numpy : 0.006341218948364258 nb_pixel_total : 281 time to create 1 rle with old method : 0.00032973289489746094 time for calcul the mask position with numpy : 0.006499528884887695 nb_pixel_total : 214 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.0065155029296875 nb_pixel_total : 1033 time to create 1 rle with old method : 0.0012433528900146484 time for calcul the mask position with numpy : 0.007029056549072266 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002999305725097656 time for calcul the mask position with numpy : 0.006999969482421875 nb_pixel_total : 558 time to create 1 rle with old method : 0.0006778240203857422 time for calcul the mask position with numpy : 0.006347179412841797 nb_pixel_total : 8 time to create 1 rle with old method : 4.363059997558594e-05 time for calcul the mask position with numpy : 0.006291389465332031 nb_pixel_total : 86 time to create 1 rle with old method : 0.00011897087097167969 time for calcul the mask position with numpy : 0.006439924240112305 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003533363342285156 time for calcul the mask position with numpy : 0.006452083587646484 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003819465637207031 time for calcul the mask position with numpy : 0.006995677947998047 nb_pixel_total : 256 time to create 1 rle with old method : 0.00033736228942871094 time for calcul the mask position with numpy : 0.006592988967895508 nb_pixel_total : 10 time to create 1 rle with old method : 3.552436828613281e-05 time for calcul the mask position with numpy : 0.007149219512939453 nb_pixel_total : 46 time to create 1 rle with old method : 8.296966552734375e-05 time for calcul the mask position with numpy : 0.00647735595703125 nb_pixel_total : 135 time to create 1 rle with old method : 0.00017881393432617188 time for calcul the mask position with numpy : 0.00649714469909668 nb_pixel_total : 679 time to create 1 rle with old method : 0.0007886886596679688 time for calcul the mask position with numpy : 0.006899356842041016 nb_pixel_total : 1745 time to create 1 rle with old method : 0.0021359920501708984 time for calcul the mask position with numpy : 0.0071985721588134766 nb_pixel_total : 78 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.0066263675689697266 nb_pixel_total : 1263 time to create 1 rle with old method : 0.002162933349609375 time for calcul the mask position with numpy : 0.00649714469909668 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004031658172607422 time for calcul the mask position with numpy : 0.006683349609375 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002715587615966797 time for calcul the mask position with numpy : 0.006682157516479492 nb_pixel_total : 109 time to create 1 rle with old method : 0.00014495849609375 time for calcul the mask position with numpy : 0.0072154998779296875 nb_pixel_total : 98 time to create 1 rle with old method : 0.00014328956604003906 time for calcul the mask position with numpy : 0.006876945495605469 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003046989440917969 time for calcul the mask position with numpy : 0.006752490997314453 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003180503845214844 time for calcul the mask position with numpy : 0.006956338882446289 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003139972686767578 time for calcul the mask position with numpy : 0.006565570831298828 nb_pixel_total : 751 time to create 1 rle with old method : 0.0008437633514404297 time for calcul the mask position with numpy : 0.006785869598388672 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003452301025390625 time for calcul the mask position with numpy : 0.006743431091308594 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011754035949707031 time for calcul the mask position with numpy : 0.00645756721496582 nb_pixel_total : 14 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.0065860748291015625 nb_pixel_total : 386 time to create 1 rle with old method : 0.00045418739318847656 time for calcul the mask position with numpy : 0.006528615951538086 nb_pixel_total : 138 time to create 1 rle with old method : 0.0001728534698486328 time for calcul the mask position with numpy : 0.011312723159790039 nb_pixel_total : 247 time to create 1 rle with old method : 0.00032401084899902344 time for calcul the mask position with numpy : 0.006806612014770508 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009984970092773438 time for calcul the mask position with numpy : 0.006584882736206055 nb_pixel_total : 4 time to create 1 rle with old method : 8.058547973632812e-05 time for calcul the mask position with numpy : 0.006342172622680664 nb_pixel_total : 37 time to create 1 rle with old method : 7.414817810058594e-05 time for calcul the mask position with numpy : 0.0063860416412353516 nb_pixel_total : 782 time to create 1 rle with old method : 0.0009036064147949219 time for calcul the mask position with numpy : 0.006609439849853516 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005333423614501953 time for calcul the mask position with numpy : 0.00652313232421875 nb_pixel_total : 1805 time to create 1 rle with old method : 0.002126932144165039 time for calcul the mask position with numpy : 0.006340980529785156 nb_pixel_total : 13 time to create 1 rle with old method : 4.0531158447265625e-05 time for calcul the mask position with numpy : 0.006571769714355469 nb_pixel_total : 449 time to create 1 rle with old method : 0.0005116462707519531 time for calcul the mask position with numpy : 0.006448268890380859 nb_pixel_total : 312 time to create 1 rle with old method : 0.00038433074951171875 time for calcul the mask position with numpy : 0.0063669681549072266 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002052783966064453 time for calcul the mask position with numpy : 0.006497621536254883 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004394054412841797 time for calcul the mask position with numpy : 0.006463050842285156 nb_pixel_total : 766 time to create 1 rle with old method : 0.0009248256683349609 time for calcul the mask position with numpy : 0.0064737796783447266 nb_pixel_total : 90 time to create 1 rle with old method : 0.00013399124145507812 time for calcul the mask position with numpy : 0.006334066390991211 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002727508544921875 time for calcul the mask position with numpy : 0.006322145462036133 nb_pixel_total : 144 time to create 1 rle with old method : 0.00019979476928710938 time for calcul the mask position with numpy : 0.0063877105712890625 nb_pixel_total : 526 time to create 1 rle with old method : 0.0006291866302490234 time for calcul the mask position with numpy : 0.0062716007232666016 nb_pixel_total : 580 time to create 1 rle with old method : 0.0007188320159912109 time for calcul the mask position with numpy : 0.0063152313232421875 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002269744873046875 time for calcul the mask position with numpy : 0.007000923156738281 nb_pixel_total : 1263 time to create 1 rle with old method : 0.0014841556549072266 time for calcul the mask position with numpy : 0.006414890289306641 nb_pixel_total : 1093 time to create 1 rle with old method : 0.0012590885162353516 time for calcul the mask position with numpy : 0.006906270980834961 nb_pixel_total : 499 time to create 1 rle with old method : 0.0008106231689453125 time for calcul the mask position with numpy : 0.0063326358795166016 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003712177276611328 time for calcul the mask position with numpy : 0.006273031234741211 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0014057159423828125 time for calcul the mask position with numpy : 0.0064961910247802734 nb_pixel_total : 425 time to create 1 rle with old method : 0.0006058216094970703 time for calcul the mask position with numpy : 0.006520748138427734 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005633831024169922 time for calcul the mask position with numpy : 0.006437540054321289 nb_pixel_total : 145 time to create 1 rle with old method : 0.00020384788513183594 time for calcul the mask position with numpy : 0.006888151168823242 nb_pixel_total : 280 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.006503105163574219 nb_pixel_total : 174 time to create 1 rle with old method : 0.00022077560424804688 time for calcul the mask position with numpy : 0.006426095962524414 nb_pixel_total : 389 time to create 1 rle with old method : 0.00045752525329589844 time for calcul the mask position with numpy : 0.006244659423828125 nb_pixel_total : 760 time to create 1 rle with old method : 0.0008943080902099609 time for calcul the mask position with numpy : 0.006160736083984375 nb_pixel_total : 183 time to create 1 rle with old method : 0.00023317337036132812 time for calcul the mask position with numpy : 0.006478786468505859 nb_pixel_total : 935 time to create 1 rle with old method : 0.0010862350463867188 time for calcul the mask position with numpy : 0.00638890266418457 nb_pixel_total : 915 time to create 1 rle with old method : 0.0010383129119873047 time for calcul the mask position with numpy : 0.00677180290222168 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005035400390625 time for calcul the mask position with numpy : 0.0070378780364990234 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003383159637451172 time for calcul the mask position with numpy : 0.006444454193115234 nb_pixel_total : 41 time to create 1 rle with old method : 6.937980651855469e-05 time for calcul the mask position with numpy : 0.006445407867431641 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006031990051269531 time for calcul the mask position with numpy : 0.0063245296478271484 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005543231964111328 time for calcul the mask position with numpy : 0.006158351898193359 nb_pixel_total : 200 time to create 1 rle with old method : 0.00023221969604492188 time for calcul the mask position with numpy : 0.0060918331146240234 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002512931823730469 time for calcul the mask position with numpy : 0.008295297622680664 nb_pixel_total : 61 time to create 1 rle with old method : 0.00010442733764648438 time for calcul the mask position with numpy : 0.008729219436645508 nb_pixel_total : 127 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.008728265762329102 nb_pixel_total : 17 time to create 1 rle with old method : 6.318092346191406e-05 time for calcul the mask position with numpy : 0.008374214172363281 nb_pixel_total : 1 time to create 1 rle with old method : 1.33514404296875e-05 create new chi : 1.4429328441619873 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0017175674438476562 batch 1 Loaded 152 chid ids of type : 4230 Number RLEs to save : 11039 TO DO : save crop sub photo not yet done ! save time : 1.0164761543273926 nb_obj : 143 nb_hashtags : 7 time to prepare the origin masks : 1.608393669128418 time for calcul the mask position with numpy : 0.01812005043029785 nb_pixel_total : 1755316 time to create 1 rle with new method : 0.034157752990722656 time for calcul the mask position with numpy : 0.00609135627746582 nb_pixel_total : 23 time to create 1 rle with old method : 4.887580871582031e-05 time for calcul the mask position with numpy : 0.006127834320068359 nb_pixel_total : 107 time to create 1 rle with old method : 0.00013327598571777344 time for calcul the mask position with numpy : 0.006049633026123047 nb_pixel_total : 980 time to create 1 rle with old method : 0.0011172294616699219 time for calcul the mask position with numpy : 0.006444454193115234 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002129077911376953 time for calcul the mask position with numpy : 0.00649261474609375 nb_pixel_total : 1630 time to create 1 rle with old method : 0.0019063949584960938 time for calcul the mask position with numpy : 0.00682377815246582 nb_pixel_total : 50041 time to create 1 rle with old method : 0.06034207344055176 time for calcul the mask position with numpy : 0.006287336349487305 nb_pixel_total : 39 time to create 1 rle with old method : 6.413459777832031e-05 time for calcul the mask position with numpy : 0.006545305252075195 nb_pixel_total : 306 time to create 1 rle with old method : 0.0004749298095703125 time for calcul the mask position with numpy : 0.010673284530639648 nb_pixel_total : 2643 time to create 1 rle with old method : 0.0029175281524658203 time for calcul the mask position with numpy : 0.0061872005462646484 nb_pixel_total : 6 time to create 1 rle with old method : 6.699562072753906e-05 time for calcul the mask position with numpy : 0.006268501281738281 nb_pixel_total : 516 time to create 1 rle with old method : 0.0010104179382324219 time for calcul the mask position with numpy : 0.006101131439208984 nb_pixel_total : 166 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.006079435348510742 nb_pixel_total : 946 time to create 1 rle with old method : 0.0011649131774902344 time for calcul the mask position with numpy : 0.006142139434814453 nb_pixel_total : 151 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.007057666778564453 nb_pixel_total : 5933 time to create 1 rle with old method : 0.007188081741333008 time for calcul the mask position with numpy : 0.006061077117919922 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004870891571044922 time for calcul the mask position with numpy : 0.005978107452392578 nb_pixel_total : 9870 time to create 1 rle with old method : 0.010994195938110352 time for calcul the mask position with numpy : 0.006246805191040039 nb_pixel_total : 1131 time to create 1 rle with old method : 0.001331329345703125 time for calcul the mask position with numpy : 0.006003379821777344 nb_pixel_total : 3 time to create 1 rle with old method : 4.2438507080078125e-05 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 21 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.005923271179199219 nb_pixel_total : 534 time to create 1 rle with old method : 0.0006432533264160156 time for calcul the mask position with numpy : 0.006010532379150391 nb_pixel_total : 22 time to create 1 rle with old method : 6.723403930664062e-05 time for calcul the mask position with numpy : 0.0060193538665771484 nb_pixel_total : 435 time to create 1 rle with old method : 0.0005290508270263672 time for calcul the mask position with numpy : 0.0060045719146728516 nb_pixel_total : 39 time to create 1 rle with old method : 7.62939453125e-05 time for calcul the mask position with numpy : 0.0058977603912353516 nb_pixel_total : 497 time to create 1 rle with old method : 0.0005948543548583984 time for calcul the mask position with numpy : 0.0060176849365234375 nb_pixel_total : 366 time to create 1 rle with old method : 0.0003917217254638672 time for calcul the mask position with numpy : 0.005942821502685547 nb_pixel_total : 702 time to create 1 rle with old method : 0.0007579326629638672 time for calcul the mask position with numpy : 0.005785226821899414 nb_pixel_total : 318 time to create 1 rle with old method : 0.0003662109375 time for calcul the mask position with numpy : 0.005996227264404297 nb_pixel_total : 6 time to create 1 rle with old method : 2.8133392333984375e-05 time for calcul the mask position with numpy : 0.005993366241455078 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003001689910888672 time for calcul the mask position with numpy : 0.006122589111328125 nb_pixel_total : 840 time to create 1 rle with old method : 0.0009255409240722656 time for calcul the mask position with numpy : 0.006286144256591797 nb_pixel_total : 520 time to create 1 rle with old method : 0.0006353855133056641 time for calcul the mask position with numpy : 0.006139278411865234 nb_pixel_total : 1062 time to create 1 rle with old method : 0.0012500286102294922 time for calcul the mask position with numpy : 0.005825996398925781 nb_pixel_total : 155 time to create 1 rle with old method : 0.000217437744140625 time for calcul the mask position with numpy : 0.006066083908081055 nb_pixel_total : 337 time to create 1 rle with old method : 0.0003788471221923828 time for calcul the mask position with numpy : 0.006078243255615234 nb_pixel_total : 2824 time to create 1 rle with old method : 0.0032927989959716797 time for calcul the mask position with numpy : 0.006510734558105469 nb_pixel_total : 814 time to create 1 rle with old method : 0.0009350776672363281 time for calcul the mask position with numpy : 0.006215333938598633 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006558895111083984 time for calcul the mask position with numpy : 0.006101369857788086 nb_pixel_total : 75 time to create 1 rle with old method : 0.00022149085998535156 time for calcul the mask position with numpy : 0.006159305572509766 nb_pixel_total : 1123 time to create 1 rle with old method : 0.001252889633178711 time for calcul the mask position with numpy : 0.0061588287353515625 nb_pixel_total : 1298 time to create 1 rle with old method : 0.0014123916625976562 time for calcul the mask position with numpy : 0.00611424446105957 nb_pixel_total : 14904 time to create 1 rle with old method : 0.016379117965698242 time for calcul the mask position with numpy : 0.0060961246490478516 nb_pixel_total : 6522 time to create 1 rle with old method : 0.007225751876831055 time for calcul the mask position with numpy : 0.006090402603149414 nb_pixel_total : 533 time to create 1 rle with old method : 0.0006222724914550781 time for calcul the mask position with numpy : 0.005916118621826172 nb_pixel_total : 527 time to create 1 rle with old method : 0.0005924701690673828 time for calcul the mask position with numpy : 0.00621795654296875 nb_pixel_total : 569 time to create 1 rle with old method : 0.0008332729339599609 time for calcul the mask position with numpy : 0.006165742874145508 nb_pixel_total : 1857 time to create 1 rle with old method : 0.0021283626556396484 time for calcul the mask position with numpy : 0.005946636199951172 nb_pixel_total : 12 time to create 1 rle with old method : 2.9802322387695312e-05 time for calcul the mask position with numpy : 0.006161689758300781 nb_pixel_total : 7632 time to create 1 rle with old method : 0.00897526741027832 time for calcul the mask position with numpy : 0.006010770797729492 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010406970977783203 time for calcul the mask position with numpy : 0.006093025207519531 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0014634132385253906 time for calcul the mask position with numpy : 0.00642848014831543 nb_pixel_total : 565 time to create 1 rle with old method : 0.0006701946258544922 time for calcul the mask position with numpy : 0.006411314010620117 nb_pixel_total : 2169 time to create 1 rle with old method : 0.002661466598510742 time for calcul the mask position with numpy : 0.006129026412963867 nb_pixel_total : 136 time to create 1 rle with old method : 0.00016689300537109375 time for calcul the mask position with numpy : 0.005862236022949219 nb_pixel_total : 954 time to create 1 rle with old method : 0.0011386871337890625 time for calcul the mask position with numpy : 0.005879640579223633 nb_pixel_total : 81 time to create 1 rle with old method : 9.989738464355469e-05 time for calcul the mask position with numpy : 0.006140470504760742 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001621246337890625 time for calcul the mask position with numpy : 0.005883216857910156 nb_pixel_total : 47 time to create 1 rle with old method : 6.747245788574219e-05 time for calcul the mask position with numpy : 0.006295680999755859 nb_pixel_total : 774 time to create 1 rle with old method : 0.0015156269073486328 time for calcul the mask position with numpy : 0.0064890384674072266 nb_pixel_total : 167 time to create 1 rle with old method : 0.00021123886108398438 time for calcul the mask position with numpy : 0.0060498714447021484 nb_pixel_total : 1645 time to create 1 rle with old method : 0.0019652843475341797 time for calcul the mask position with numpy : 0.005811214447021484 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001552104949951172 time for calcul the mask position with numpy : 0.006022214889526367 nb_pixel_total : 33 time to create 1 rle with old method : 5.936622619628906e-05 time for calcul the mask position with numpy : 0.005833864212036133 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003707408905029297 time for calcul the mask position with numpy : 0.005905628204345703 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003018379211425781 time for calcul the mask position with numpy : 0.005881071090698242 nb_pixel_total : 774 time to create 1 rle with old method : 0.0009090900421142578 time for calcul the mask position with numpy : 0.006006717681884766 nb_pixel_total : 263 time to create 1 rle with old method : 0.00029921531677246094 time for calcul the mask position with numpy : 0.006099700927734375 nb_pixel_total : 164 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.0060389041900634766 nb_pixel_total : 195 time to create 1 rle with old method : 0.00023889541625976562 time for calcul the mask position with numpy : 0.0059549808502197266 nb_pixel_total : 967 time to create 1 rle with old method : 0.0011229515075683594 time for calcul the mask position with numpy : 0.005995035171508789 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003037452697753906 time for calcul the mask position with numpy : 0.006045341491699219 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006623268127441406 time for calcul the mask position with numpy : 0.006110668182373047 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001277923583984375 time for calcul the mask position with numpy : 0.006144523620605469 nb_pixel_total : 20 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.006175518035888672 nb_pixel_total : 246 time to create 1 rle with old method : 0.0002989768981933594 time for calcul the mask position with numpy : 0.0060617923736572266 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004229545593261719 time for calcul the mask position with numpy : 0.0061168670654296875 nb_pixel_total : 330 time to create 1 rle with old method : 0.0003998279571533203 time for calcul the mask position with numpy : 0.006090641021728516 nb_pixel_total : 71 time to create 1 rle with old method : 0.00010275840759277344 time for calcul the mask position with numpy : 0.006572723388671875 nb_pixel_total : 105621 time to create 1 rle with old method : 0.11602234840393066 time for calcul the mask position with numpy : 0.006642341613769531 nb_pixel_total : 131 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.005915403366088867 nb_pixel_total : 652 time to create 1 rle with old method : 0.00070953369140625 time for calcul the mask position with numpy : 0.00592041015625 nb_pixel_total : 74 time to create 1 rle with old method : 0.00010180473327636719 time for calcul the mask position with numpy : 0.00593876838684082 nb_pixel_total : 346 time to create 1 rle with old method : 0.00042724609375 time for calcul the mask position with numpy : 0.006073474884033203 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003371238708496094 time for calcul the mask position with numpy : 0.0060901641845703125 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005042552947998047 time for calcul the mask position with numpy : 0.00613713264465332 nb_pixel_total : 233 time to create 1 rle with old method : 0.00028395652770996094 time for calcul the mask position with numpy : 0.005988121032714844 nb_pixel_total : 14 time to create 1 rle with old method : 4.839897155761719e-05 time for calcul the mask position with numpy : 0.005997419357299805 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003497600555419922 time for calcul the mask position with numpy : 0.006209850311279297 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.006006717681884766 nb_pixel_total : 1276 time to create 1 rle with old method : 0.0014827251434326172 time for calcul the mask position with numpy : 0.005968332290649414 nb_pixel_total : 724 time to create 1 rle with old method : 0.0008034706115722656 time for calcul the mask position with numpy : 0.006085634231567383 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003314018249511719 time for calcul the mask position with numpy : 0.0069386959075927734 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003135204315185547 time for calcul the mask position with numpy : 0.0075531005859375 nb_pixel_total : 46390 time to create 1 rle with old method : 0.06175661087036133 time for calcul the mask position with numpy : 0.007291555404663086 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003039836883544922 time for calcul the mask position with numpy : 0.0070343017578125 nb_pixel_total : 218 time to create 1 rle with old method : 0.00025200843811035156 time for calcul the mask position with numpy : 0.007174015045166016 nb_pixel_total : 49 time to create 1 rle with old method : 8.797645568847656e-05 time for calcul the mask position with numpy : 0.007315874099731445 nb_pixel_total : 671 time to create 1 rle with old method : 0.0009388923645019531 time for calcul the mask position with numpy : 0.009567737579345703 nb_pixel_total : 719 time to create 1 rle with old method : 0.0010950565338134766 time for calcul the mask position with numpy : 0.015300512313842773 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005393028259277344 time for calcul the mask position with numpy : 0.011863231658935547 nb_pixel_total : 1741 time to create 1 rle with old method : 0.0021986961364746094 time for calcul the mask position with numpy : 0.012310266494750977 nb_pixel_total : 477 time to create 1 rle with old method : 0.0007038116455078125 time for calcul the mask position with numpy : 0.012605667114257812 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006575584411621094 time for calcul the mask position with numpy : 0.01347041130065918 nb_pixel_total : 1163 time to create 1 rle with old method : 0.0016491413116455078 time for calcul the mask position with numpy : 0.01273965835571289 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007908344268798828 time for calcul the mask position with numpy : 0.013262748718261719 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005948543548583984 time for calcul the mask position with numpy : 0.013370275497436523 nb_pixel_total : 4779 time to create 1 rle with old method : 0.005954742431640625 time for calcul the mask position with numpy : 0.01254725456237793 nb_pixel_total : 167 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.010351419448852539 nb_pixel_total : 343 time to create 1 rle with old method : 0.0003762245178222656 time for calcul the mask position with numpy : 0.01174306869506836 nb_pixel_total : 79 time to create 1 rle with old method : 0.00012612342834472656 time for calcul the mask position with numpy : 0.014320850372314453 nb_pixel_total : 701 time to create 1 rle with old method : 0.0010645389556884766 time for calcul the mask position with numpy : 0.014812707901000977 nb_pixel_total : 135 time to create 1 rle with old method : 0.00026345252990722656 time for calcul the mask position with numpy : 0.014417648315429688 nb_pixel_total : 102 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.013859272003173828 nb_pixel_total : 375 time to create 1 rle with old method : 0.0005285739898681641 time for calcul the mask position with numpy : 0.012110233306884766 nb_pixel_total : 607 time to create 1 rle with old method : 0.0011811256408691406 time for calcul the mask position with numpy : 0.0076863765716552734 nb_pixel_total : 3246 time to create 1 rle with old method : 0.006670951843261719 time for calcul the mask position with numpy : 0.008982419967651367 nb_pixel_total : 165 time to create 1 rle with old method : 0.000522613525390625 time for calcul the mask position with numpy : 0.009133100509643555 nb_pixel_total : 440 time to create 1 rle with old method : 0.0010266304016113281 time for calcul the mask position with numpy : 0.009203672409057617 nb_pixel_total : 296 time to create 1 rle with old method : 0.0006952285766601562 time for calcul the mask position with numpy : 0.008462190628051758 nb_pixel_total : 247 time to create 1 rle with old method : 0.0004069805145263672 time for calcul the mask position with numpy : 0.008363485336303711 nb_pixel_total : 382 time to create 1 rle with old method : 0.0006296634674072266 time for calcul the mask position with numpy : 0.014219999313354492 nb_pixel_total : 458 time to create 1 rle with old method : 0.0007312297821044922 time for calcul the mask position with numpy : 0.0142364501953125 nb_pixel_total : 140 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.014490365982055664 nb_pixel_total : 409 time to create 1 rle with old method : 0.0006220340728759766 time for calcul the mask position with numpy : 0.01467442512512207 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004813671112060547 time for calcul the mask position with numpy : 0.01457834243774414 nb_pixel_total : 220 time to create 1 rle with old method : 0.00041413307189941406 time for calcul the mask position with numpy : 0.014409780502319336 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005750656127929688 time for calcul the mask position with numpy : 0.014910459518432617 nb_pixel_total : 161 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.01792287826538086 nb_pixel_total : 323 time to create 1 rle with old method : 0.0012199878692626953 time for calcul the mask position with numpy : 0.016083478927612305 nb_pixel_total : 806 time to create 1 rle with old method : 0.0013890266418457031 time for calcul the mask position with numpy : 0.015587568283081055 nb_pixel_total : 174 time to create 1 rle with old method : 0.00033164024353027344 time for calcul the mask position with numpy : 0.01015782356262207 nb_pixel_total : 897 time to create 1 rle with old method : 0.0018951892852783203 time for calcul the mask position with numpy : 0.01077413558959961 nb_pixel_total : 867 time to create 1 rle with old method : 0.0018391609191894531 time for calcul the mask position with numpy : 0.01005411148071289 nb_pixel_total : 500 time to create 1 rle with old method : 0.0008804798126220703 time for calcul the mask position with numpy : 0.010889530181884766 nb_pixel_total : 195 time to create 1 rle with old method : 0.0004887580871582031 time for calcul the mask position with numpy : 0.010274171829223633 nb_pixel_total : 136 time to create 1 rle with old method : 0.00038623809814453125 time for calcul the mask position with numpy : 0.01059412956237793 nb_pixel_total : 519 time to create 1 rle with old method : 0.001054525375366211 time for calcul the mask position with numpy : 0.010352373123168945 nb_pixel_total : 461 time to create 1 rle with old method : 0.0008258819580078125 time for calcul the mask position with numpy : 0.009458780288696289 nb_pixel_total : 188 time to create 1 rle with old method : 0.0003681182861328125 time for calcul the mask position with numpy : 0.010153532028198242 nb_pixel_total : 79 time to create 1 rle with old method : 0.00017905235290527344 time for calcul the mask position with numpy : 0.010826826095581055 nb_pixel_total : 232 time to create 1 rle with old method : 0.0007441043853759766 time for calcul the mask position with numpy : 0.011691093444824219 nb_pixel_total : 7 time to create 1 rle with old method : 7.152557373046875e-05 time for calcul the mask position with numpy : 0.011970996856689453 nb_pixel_total : 126 time to create 1 rle with old method : 0.0003178119659423828 create new chi : 1.6045911312103271 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0038292407989501953 batch 1 Loaded 144 chid ids of type : 4230 Number RLEs to save : 12009 TO DO : save crop sub photo not yet done ! save time : 0.8956236839294434 map_output_result : {1338802818: (0.0, 'Should be the crop_list due to order', 0.0), 1338802817: (0.0, 'Should be the crop_list due to order', 0.0), 1338802800: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1338802818, 1338802817, 1338802800] Looping around the photos to save general results len do output : 3 /1338802818.Didn't retrieve data . /1338802817.Didn't retrieve data . /1338802800.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802818', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802817', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802800', None, None, None, None, None, '2604476') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.024869203567504883 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.718841552734375 time spend to save output : 0.025179624557495117 total time spend for step 4 : 13.74402117729187 step5:crop_condition Fri Feb 21 12:21:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 444 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 161 About to insert : list_path_to_insert length 161 new photo from crops ! About to upload 161 photos upload in portfolio : 4869462 init cache_photo without model_param we have 161 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740136878_2618498 we have uploaded 161 photos in the portfolio 4869462 time of upload the photos Elapsed time : 55.1633780002594 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 4869462 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740136934_2618498 we have uploaded 56 photos in the portfolio 4869462 time of upload the photos Elapsed time : 21.234147548675537 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4869462 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740136956_2618498 we have uploaded 5 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.1923999786376953 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740136958_2618498 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.716055870056152 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 4869462 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740136966_2618498 we have uploaded 47 photos in the portfolio 4869462 time of upload the photos Elapsed time : 15.623308181762695 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1338802818, 1338802817, 1338802800] Looping around the photos to save general results len do output : 277 /1338813798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338813999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338814334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802818', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802817', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802800', None, None, None, None, None, '2604476') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 834 time used for this insertion : 0.04569363594055176 save_final save missing photos in datou_result : time spend for datou_step_exec : 105.81256341934204 time spend to save output : 0.13782548904418945 total time spend for step 5 : 105.95038890838623 step6:thcl Fri Feb 21 12:23:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.021453380584716797 time to convert the images to numpy array : 0.08417391777038574 time to import caffe and check if the image exist : 0.019720792770385742 time to convert the images to numpy array : 0.08648896217346191 time to import caffe and check if the image exist : 0.01932978630065918 time to convert the images to numpy array : 0.08935070037841797 time to import caffe and check if the image exist : 0.015223264694213867 time to convert the images to numpy array : 0.09712624549865723 time to import caffe and check if the image exist : 0.03457045555114746 time to convert the images to numpy array : 0.07905912399291992 time to import caffe and check if the image exist : 0.018238544464111328 time to convert the images to numpy array : 0.09679269790649414 time to import caffe and check if the image exist : 0.024143695831298828 time to convert the images to numpy array : 0.09426379203796387 time to import caffe and check if the image exist : 0.021971464157104492 time to convert the images to numpy array : 0.09655117988586426 time to import caffe and check if the image exist : 0.02947998046875 time to convert the images to numpy array : 0.08935213088989258 time to import caffe and check if the image exist : 0.019374608993530273 time to convert the images to numpy array : 0.10308837890625 total time to convert the images to numpy array : 0.3802304267883301 list photo_ids error: [] list photo_ids correct : [1338813940, 1338813941, 1338813942, 1338813943, 1338813944, 1338813945, 1338813946, 1338813947, 1338813948, 1338813949, 1338813950, 1338813951, 1338813952, 1338813953, 1338813954, 1338813956, 1338813957, 1338813958, 1338813959, 1338813960, 1338813961, 1338813967, 1338813968, 1338813969, 1338813970, 1338813971, 1338813972, 1338813973, 1338813912, 1338813913, 1338813914, 1338813915, 1338813916, 1338813917, 1338813918, 1338813919, 1338813920, 1338813921, 1338813922, 1338813923, 1338813924, 1338813925, 1338813926, 1338813927, 1338813928, 1338813929, 1338813930, 1338813931, 1338813932, 1338813933, 1338813934, 1338813935, 1338813936, 1338813937, 1338813938, 1338813939, 1338813798, 1338813799, 1338813800, 1338813801, 1338813802, 1338813803, 1338813804, 1338813805, 1338813806, 1338813807, 1338813808, 1338813809, 1338813810, 1338813811, 1338813813, 1338813814, 1338813815, 1338813816, 1338813817, 1338813818, 1338813819, 1338813820, 1338813821, 1338813822, 1338813823, 1338813824, 1338813825, 1338813826, 1338813827, 1338813828, 1338813829, 1338813830, 1338813831, 1338813832, 1338813833, 1338813834, 1338813835, 1338813836, 1338813837, 1338813838, 1338813839, 1338813840, 1338813841, 1338813842, 1338813843, 1338813844, 1338813845, 1338813846, 1338813847, 1338813848, 1338813849, 1338813850, 1338813851, 1338813852, 1338813853, 1338813854, 1338813883, 1338813884, 1338813885, 1338813886, 1338813887, 1338813889, 1338813890, 1338813891, 1338813892, 1338813893, 1338813894, 1338813895, 1338813896, 1338813897, 1338813898, 1338813899, 1338813900, 1338813901, 1338813902, 1338813903, 1338813904, 1338813905, 1338813906, 1338813907, 1338813908, 1338813909, 1338813910, 1338813911, 1338813855, 1338813856, 1338813857, 1338813858, 1338813859, 1338813860, 1338813861, 1338813862, 1338813863, 1338813864, 1338813865, 1338813866, 1338813867, 1338813868, 1338813869, 1338813870, 1338813871, 1338813872, 1338813873, 1338813874, 1338813875, 1338813876, 1338813877, 1338813878, 1338813879, 1338813880, 1338813881, 1338813882, 1338813974, 1338813975, 1338813976, 1338813977, 1338813978, 1338813979, 1338813980, 1338813981, 1338813983, 1338813984, 1338813985, 1338813986, 1338813987, 1338813988, 1338813990, 1338813991, 1338813992, 1338813993, 1338813994, 1338813995, 1338813996, 1338813997, 1338813998, 1338813999, 1338814000, 1338814001, 1338814002, 1338814003, 1338814035, 1338814036, 1338814037, 1338814043, 1338814045, 1338814047, 1338814232, 1338814235, 1338814238, 1338814241, 1338814244, 1338814249, 1338814252, 1338814255, 1338814258, 1338814260, 1338814262, 1338814264, 1338814266, 1338814268, 1338814270, 1338814272, 1338814274, 1338814276, 1338814278, 1338814280, 1338814282, 1338814284, 1338814004, 1338814005, 1338814006, 1338814007, 1338814008, 1338814009, 1338814010, 1338814011, 1338814012, 1338814013, 1338814014, 1338814015, 1338814016, 1338814017, 1338814018, 1338814019, 1338814020, 1338814021, 1338814022, 1338814023, 1338814024, 1338814027, 1338814028, 1338814029, 1338814030, 1338814031, 1338814033, 1338814034, 1338814286, 1338814288, 1338814290, 1338814292, 1338814293, 1338814294, 1338814295, 1338814296, 1338814297, 1338814298, 1338814300, 1338814302, 1338814304, 1338814306, 1338814308, 1338814310, 1338814312, 1338814314, 1338814316, 1338814318, 1338814321, 1338814325, 1338814327, 1338814331, 1338814334] number of photos to traite : 277 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3645 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3426 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.3368182182312012 time used to do the prediction : 1.026540994644165 save descriptor for thcl : 3237 time to traite the descriptors : 1.732898473739624 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1338813940 To insert : 1338813941 To insert : 1338813942 To insert : 1338813943 To insert : 1338813944 To insert : 1338813945 To insert : 1338813946 To insert : 1338813947 To insert : 1338813948 To insert : 1338813949 To insert : 1338813950 To insert : 1338813951 To insert : 1338813952 To insert : 1338813953 To insert : 1338813954 To insert : 1338813956 To insert : 1338813957 To insert : 1338813958 To insert : 1338813959 To insert : 1338813960 To insert : 1338813961 To insert : 1338813967 To insert : 1338813968 To insert : 1338813969 To insert : 1338813970 To insert : 1338813971 To insert : 1338813972 To insert : 1338813973 To insert : 1338813912 To insert : 1338813913 To insert : 1338813914 To insert : 1338813915 To insert : 1338813916 To insert : 1338813917 To insert : 1338813918 To insert : 1338813919 To insert : 1338813920 To insert : 1338813921 To insert : 1338813922 To insert : 1338813923 To insert : 1338813924 To insert : 1338813925 To insert : 1338813926 To insert : 1338813927 To insert : 1338813928 To insert : 1338813929 To insert : 1338813930 To insert : 1338813931 To insert : 1338813932 To insert : 1338813933 To insert : 1338813934 To insert : 1338813935 To insert : 1338813936 To insert : 1338813937 To insert : 1338813938 To insert : 1338813939 To insert : 1338813798 To insert : 1338813799 To insert : 1338813800 To insert : 1338813801 To insert : 1338813802 To insert : 1338813803 To insert : 1338813804 To insert : 1338813805 To insert : 1338813806 To insert : 1338813807 To insert : 1338813808 To insert : 1338813809 To insert : 1338813810 To insert : 1338813811 To insert : 1338813813 To insert : 1338813814 To insert : 1338813815 To insert : 1338813816 To insert : 1338813817 To insert : 1338813818 To insert : 1338813819 To insert : 1338813820 To insert : 1338813821 To insert : 1338813822 To insert : 1338813823 To insert : 1338813824 To insert : 1338813825 To insert : 1338813826 To insert : 1338813827 To insert : 1338813828 To insert : 1338813829 To insert : 1338813830 To insert : 1338813831 To insert : 1338813832 To insert : 1338813833 To insert : 1338813834 To insert : 1338813835 To insert : 1338813836 To insert : 1338813837 To insert : 1338813838 To insert : 1338813839 To insert : 1338813840 To insert : 1338813841 To insert : 1338813842 To insert : 1338813843 To insert : 1338813844 To insert : 1338813845 To insert : 1338813846 To insert : 1338813847 To insert : 1338813848 To insert : 1338813849 To insert : 1338813850 To insert : 1338813851 To insert : 1338813852 To insert : 1338813853 To insert : 1338813854 To insert : 1338813883 To insert : 1338813884 To insert : 1338813885 To insert : 1338813886 To insert : 1338813887 To insert : 1338813889 To insert : 1338813890 To insert : 1338813891 To insert : 1338813892 To insert : 1338813893 To insert : 1338813894 To insert : 1338813895 To insert : 1338813896 To insert : 1338813897 To insert : 1338813898 To insert : 1338813899 To insert : 1338813900 To insert : 1338813901 To insert : 1338813902 To insert : 1338813903 To insert : 1338813904 To insert : 1338813905 To insert : 1338813906 To insert : 1338813907 To insert : 1338813908 To insert : 1338813909 To insert : 1338813910 To insert : 1338813911 To insert : 1338813855 To insert : 1338813856 To insert : 1338813857 To insert : 1338813858 To insert : 1338813859 To insert : 1338813860 To insert : 1338813861 To insert : 1338813862 To insert : 1338813863 To insert : 1338813864 To insert : 1338813865 To insert : 1338813866 To insert : 1338813867 To insert : 1338813868 To insert : 1338813869 To insert : 1338813870 To insert : 1338813871 To insert : 1338813872 To insert : 1338813873 To insert : 1338813874 To insert : 1338813875 To insert : 1338813876 To insert : 1338813877 To insert : 1338813878 To insert : 1338813879 To insert : 1338813880 To insert : 1338813881 To insert : 1338813882 To insert : 1338813974 To insert : 1338813975 To insert : 1338813976 To insert : 1338813977 To insert : 1338813978 To insert : 1338813979 To insert : 1338813980 To insert : 1338813981 To insert : 1338813983 To insert : 1338813984 To insert : 1338813985 To insert : 1338813986 To insert : 1338813987 To insert : 1338813988 To insert : 1338813990 To insert : 1338813991 To insert : 1338813992 To insert : 1338813993 To insert : 1338813994 To insert : 1338813995 To insert : 1338813996 To insert : 1338813997 To insert : 1338813998 To insert : 1338813999 To insert : 1338814000 To insert : 1338814001 To insert : 1338814002 To insert : 1338814003 To insert : 1338814035 To insert : 1338814036 To insert : 1338814037 To insert : 1338814043 To insert : 1338814045 To insert : 1338814047 To insert : 1338814232 To insert : 1338814235 To insert : 1338814238 To insert : 1338814241 To insert : 1338814244 To insert : 1338814249 To insert : 1338814252 To insert : 1338814255 To insert : 1338814258 To insert : 1338814260 To insert : 1338814262 To insert : 1338814264 To insert : 1338814266 To insert : 1338814268 To insert : 1338814270 To insert : 1338814272 To insert : 1338814274 To insert : 1338814276 To insert : 1338814278 To insert : 1338814280 To insert : 1338814282 To insert : 1338814284 To insert : 1338814004 To insert : 1338814005 To insert : 1338814006 To insert : 1338814007 To insert : 1338814008 To insert : 1338814009 To insert : 1338814010 To insert : 1338814011 To insert : 1338814012 To insert : 1338814013 To insert : 1338814014 To insert : 1338814015 To insert : 1338814016 To insert : 1338814017 To insert : 1338814018 To insert : 1338814019 To insert : 1338814020 To insert : 1338814021 To insert : 1338814022 To insert : 1338814023 To insert : 1338814024 To insert : 1338814027 To insert : 1338814028 To insert : 1338814029 To insert : 1338814030 To insert : 1338814031 To insert : 1338814033 To insert : 1338814034 To insert : 1338814286 To insert : 1338814288 To insert : 1338814290 To insert : 1338814292 To insert : 1338814293 To insert : 1338814294 To insert : 1338814295 To insert : 1338814296 To insert : 1338814297 To insert : 1338814298 To insert : 1338814300 To insert : 1338814302 To insert : 1338814304 To insert : 1338814306 To insert : 1338814308 To insert : 1338814310 To insert : 1338814312 To insert : 1338814314 To insert : 1338814316 To insert : 1338814318 To insert : 1338814321 To insert : 1338814325 To insert : 1338814327 To insert : 1338814331 To insert : 1338814334 time to insert the descriptors : 63.86228370666504 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 428 time used for this insertion : 0.030724763870239258 save missing photos in datou_result : time spend for datou_step_exec : 72.24554586410522 time spend to save output : 0.0823671817779541 total time spend for step 6 : 72.32791304588318 step7:ventilate_hashtags_in_portfolio Fri Feb 21 12:24:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20724470 get user id for portfolio 20724470 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20724470 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Carton','Papier','Tetrapak','flou','metal','pet_fonce','carton','mal_croppe','PEHD','papier','Film_plastique','PET_clair','PET_fonce','refus','autre','pet_clair','pehd')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20724470 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Carton','Papier','Tetrapak','flou','metal','pet_fonce','carton','mal_croppe','PEHD','papier','Film_plastique','PET_clair','PET_fonce','refus','autre','pet_clair','pehd')) AND mptpi.`min_score`=0.6 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20724470 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Carton','Papier','Tetrapak','flou','metal','pet_fonce','carton','mal_croppe','PEHD','papier','Film_plastique','PET_clair','PET_fonce','refus','autre','pet_clair','pehd')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20724470 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Carton','Papier','Tetrapak','flou','metal','pet_fonce','carton','mal_croppe','PEHD','papier','Film_plastique','PET_clair','PET_fonce','refus','autre','pet_clair','pehd')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20725394,20725401,20725404,20725397,20725398,20725399,20725407,20725402,20725411,20725405,20725410,20725408,20725409?tags=environnement,carton,papier,tetrapak,flou,metal,pet_fonce,mal_croppe,pehd,film_plastique,pet_clair,refus,autre&datou_id_consolidate=4235&port_consolidate=20724470 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1338802818, 1338802817, 1338802800] Looping around the photos to save general results len do output : 1 /20724470. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802818', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802817', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802800', None, None, None, None, None, '2604476') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.016731739044189453 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.48747181892395 time spend to save output : 0.016952037811279297 total time spend for step 7 : 2.5044238567352295 step8:final Fri Feb 21 12:24:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1338802818: ('0.22249192295739598',), 1338802817: ('0.22249192295739598',), 1338802800: ('0.22249192295739598',)} new output for save of step final : {1338802818: ('0.22249192295739598',), 1338802817: ('0.22249192295739598',), 1338802800: ('0.22249192295739598',)} [1338802818, 1338802817, 1338802800] Looping around the photos to save general results len do output : 3 /1338802818.Didn't retrieve data . /1338802817.Didn't retrieve data . /1338802800.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802818', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802817', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802800', None, None, None, None, None, '2604476') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014598846435546875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.23106765747070312 time spend to save output : 0.014833450317382812 total time spend for step 8 : 0.24590110778808594 step9:velours_tree Fri Feb 21 12:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20725394,20725401,20725404,20725397,20725398,20725399,20725407,20725402,20725411,20725405,20725410,20725408,20725409 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725394 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725401 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725404 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725397 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725398 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725399 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725407 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725402 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725411 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725405 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725410 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725408 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20725409 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 277 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [3 2 0 3 0 3 2 2 2 2 2 2 1 0 2 0 1 0 0 0 1 0 1 2 0 1 0 0 0 0 0 0 0 2 0 0 0 1 0 1 0 2 0 0 0 3 0 1 1 5 3 2 0 0 0 0 2 2 0 0 5 3 3 2 0 3 0 4 2 0 0 1 2 0 0 0 1 0 2 0 1 0 1 0 0 0 0 0 0 0 1 1 0 0 0 0 0 1 2 0 0 0 3 0 0 0 2 2 2 0 0 5 3 0 3 1 2 2 2 0 0 1 0 2 0 0 0 1 2 0 0 0 2 1 3 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 2 0 2 3 0 1 3 3 2 0 2 1 5 0 0 2 2 1 0 0 0 4 1 5 0 5 1 0 3 1 0 1 2 0 1 0 0 0 0 4 2 5 0 3 5 1 5 0 2 0 1 0 0 0 0 4 2 5 3 0 5 1 0 0 3 0 3 4 1 0 3 0 2 2 0 0 1 0 2 2 2 0 0 2 2 1 0 0 0 0 1 3 3 0 3 3 2 3 0 2 1 1 2 3 0 0 1 3 0 3 3 0 2 0 1 3 0 3 1 3 3 0 2 0 3 3 3] Elapsed time: 0.07956552505493164 graph_id used : 79585 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20725394,20725401,20725404,20725397,20725398,20725399,20725407,20725402,20725411,20725405,20725410,20725408,20725409?tags=environnement,carton,papier,tetrapak,flou,metal,pet_fonce,mal_croppe,pehd,film_plastique,pet_clair,refus,autre&datou_id_consolidate=4235&port_consolidate=20724470&tree_id=79585 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1338802818, 1338802817, 1338802800] Looping around the photos to save general results len do output : 1 /20724470Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802818', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802817', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802800', None, None, None, None, None, '2604476') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013134479522705078 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.81247067451477 time spend to save output : 0.013696670532226562 total time spend for step 9 : 19.826167345046997 step10:send_mail_cod Fri Feb 21 12:24:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20724470_21-02-2025_12_24_36.pdf 20725383 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207253831740137076 20725386 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207253861740137077 20725379 imagette207253791740137078 20725380 imagette207253801740137078 20725381 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207253811740137078 20725389 imagette207253891740137078 20725384 imagette207253841740137079 20725393 imagette207253931740137079 20725387 imagette207253871740137079 20725392 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207253921740137079 20725390 imagette207253901740137079 20725391 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207253911740137079 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20724470 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20725394,20725401,20725404,20725397,20725398,20725399,20725407,20725402,20725411,20725405,20725410,20725408,20725409?tags=environnement,carton,papier,tetrapak,flou,metal,pet_fonce,mal_croppe,pehd,film_plastique,pet_clair,refus,autre&datou_id_consolidate=4235&port_consolidate=20724470&tree_id=79585 your option no_mail is active, we will not send the real mail to your client args[1338802818] : ((1338802818, -7.6365901971829615, 492609224), (1338802818, -0.5743752599330357, 501862349), '0.22249192295739598') We are sending mail with results at cod@fotonower.com args[1338802817] : ((1338802817, -7.639903479289979, 492609224), (1338802817, -0.5871953335184451, 501862349), '0.22249192295739598') We are sending mail with results at cod@fotonower.com args[1338802800] : ((1338802800, -7.6385903746191675, 492609224), (1338802800, -0.5899938092881594, 501862349), '0.22249192295739598') We are sending mail with results at cod@fotonower.com refus_total : 0.22249192295739598 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20724470 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20724470_21-02-2025_12_24_36.pdf results_Qualipapia_P20724470_21-02-2025_12_24_36.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20724470_21-02-2025_12_24_36.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20724470','results_Qualipapia_P20724470_21-02-2025_12_24_36.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20724470_21-02-2025_12_24_36.pdf','pdf','','0.16','0.22249192295739598') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1338802818, 1338802817, 1338802800] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802818', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802817', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802800', None, None, None, None, None, '2604476') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.015033483505249023 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.309327840805054 time spend to save output : 0.015254497528076172 total time spend for step 10 : 4.32458233833313 step11:split_time_score Fri Feb 21 12:24:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21022025 20724470 Nombre de photos uploadées : 3 / 23040 (0%) 21022025 20724470 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 21022025 20724470 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.049041748046875e-05 ??? elapsed_time : fill_and_build_computed_from_old_data 0.00029754638671875 elapsed_time : insert_dashboard_record_day_entry 0.028030872344970703 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2573507065795471 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20721177_21-02-2025_10_48_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20721177 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20721177 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20721853 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20721854 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20721855 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20721856 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20721857 order by id desc limit 1 Qualite : 0.2265827750072435 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20721858_21-02-2025_11_34_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20721858 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20721858 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20721859 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20722747 order by id desc limit 1 Qualite : 0.2238309474528959 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20722750_21-02-2025_11_49_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20722750 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20722750 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20724467 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20724468 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20724469 order by id desc limit 1 Qualite : 0.22249192295739598 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20724470_21-02-2025_12_24_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20724470 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20724470 AND mptpi.`type`=4230 To do Qualite : 0.23755400313927924 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20724471_21-02-2025_12_24_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20724471 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20724471 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21022025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1338802818, 1338802817, 1338802800] Looping around the photos to save general results len do output : 1 /20724470Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802818', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802817', None, None, None, None, None, '2604476') ('4234', None, None, None, None, None, None, None, '2604476') ('4234', '20724470', '1338802800', None, None, None, None, None, '2604476') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.0966942310333252 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.598864316940308 time spend to save output : 0.09693193435668945 total time spend for step 11 : 8.695796251296997 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 46.22user 29.99system 4:25.22elapsed 28%CPU (0avgtext+0avgdata 2892948maxresident)k 84504inputs+17960outputs (253major+3028306minor)pagefaults 0swaps