python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 356560 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2568975'] with mtr_portfolio_ids : ['20362230'] and first list_photo_ids : [] new path : /proc/356560/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.36156535148620605 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 8 16:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-08 16:20:31.570533: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-08 16:20:31.595053: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-08 16:20:31.596874: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f205c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-08 16:20:31.596928: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-08 16:20:31.600215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-08 16:20:31.891693: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3458b7f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-08 16:20:31.891738: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-08 16:20:31.892531: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-08 16:20:31.892872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-08 16:20:31.894942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-08 16:20:31.897062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-08 16:20:31.897374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-08 16:20:31.899599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-08 16:20:31.900681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-08 16:20:31.905280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-08 16:20:31.906746: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-08 16:20:31.906833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-08 16:20:31.907602: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-08 16:20:31.907619: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-08 16:20:31.907628: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-08 16:20:31.908935: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-08 16:20:32.166703: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-08 16:20:32.166803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-08 16:20:32.166839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-08 16:20:32.166866: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-08 16:20:32.166886: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-08 16:20:32.166924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-08 16:20:32.166956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-08 16:20:32.166979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-08 16:20:32.168770: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-08 16:20:32.170279: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-08 16:20:32.170326: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-08 16:20:32.170356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-08 16:20:32.170384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-08 16:20:32.170404: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-08 16:20:32.170423: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-08 16:20:32.170445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-08 16:20:32.170476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-08 16:20:32.172268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-08 16:20:32.172304: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-08 16:20:32.172315: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-08 16:20:32.172328: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-08 16:20:32.173859: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-08 16:20:38.844957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-08 16:20:39.039299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.43828 max: 148.90078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 361 time to create 1 rle with old method : 0.0009737014770507812 length of segment : 30 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0004589557647705078 length of segment : 33 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 851 time to create 1 rle with old method : 0.0017452239990234375 length of segment : 37 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00025773048400878906 length of segment : 31 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 837 time to create 1 rle with old method : 0.002233743667602539 length of segment : 33 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.00041794776916503906 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.02031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 915 time to create 1 rle with old method : 0.00206756591796875 length of segment : 43 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0019161701202392578 length of segment : 44 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 3364 time to create 1 rle with old method : 0.006552696228027344 length of segment : 100 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 33 time to create 1 rle with old method : 0.0001308917999267578 length of segment : 5 time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 2348 time to create 1 rle with old method : 0.00482940673828125 length of segment : 63 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00045371055603027344 length of segment : 21 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00010514259338378906 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00019979476928710938 length of segment : 41 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002655982971191406 length of segment : 28 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.00043487548828125 length of segment : 40 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 29 time to create 1 rle with old method : 7.963180541992188e-05 length of segment : 5 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 29 time to create 1 rle with old method : 7.128715515136719e-05 length of segment : 6 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004172325134277344 length of segment : 34 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 2668 time to create 1 rle with old method : 0.0034172534942626953 length of segment : 83 time for calcul the mask position with numpy : 0.000164031982421875 nb_pixel_total : 1839 time to create 1 rle with old method : 0.002227783203125 length of segment : 41 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0006010532379150391 length of segment : 43 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002295970916748047 length of segment : 13 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.00022029876708984375 length of segment : 35 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 3273 time to create 1 rle with old method : 0.003864288330078125 length of segment : 90 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003571510314941406 length of segment : 16 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1978 time to create 1 rle with old method : 0.0026502609252929688 length of segment : 49 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00024390220642089844 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -97.52813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.001245737075805664 length of segment : 28 time for calcul the mask position with numpy : 0.00012087821960449219 nb_pixel_total : 6780 time to create 1 rle with old method : 0.008392810821533203 length of segment : 115 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 1462 time to create 1 rle with old method : 0.0018885135650634766 length of segment : 36 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1123 time to create 1 rle with old method : 0.0016467571258544922 length of segment : 22 time for calcul the mask position with numpy : 0.00015544891357421875 nb_pixel_total : 1819 time to create 1 rle with old method : 0.0035097599029541016 length of segment : 101 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.46172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 10043 time to create 1 rle with old method : 0.01210784912109375 length of segment : 96 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0007550716400146484 length of segment : 26 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005588531494140625 length of segment : 32 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00021839141845703125 length of segment : 23 time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 9396 time to create 1 rle with old method : 0.011462688446044922 length of segment : 81 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0007529258728027344 length of segment : 26 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 236.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 106.27578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2841 time to create 1 rle with old method : 0.0035703182220458984 length of segment : 76 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007297992706298828 length of segment : 19 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006256103515625 length of segment : 54 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00020360946655273438 length of segment : 17 time for calcul the mask position with numpy : 0.0007884502410888672 nb_pixel_total : 74960 time to create 1 rle with old method : 0.08588910102844238 length of segment : 296 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006258487701416016 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -93.80234 max: 64.47734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.28203 max: 132.76406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004982948303222656 length of segment : 19 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.00021338462829589844 length of segment : 11 time for calcul the mask position with numpy : 0.0001647472381591797 nb_pixel_total : 7935 time to create 1 rle with old method : 0.009736061096191406 length of segment : 139 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003876686096191406 length of segment : 14 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 1019 time to create 1 rle with old method : 0.00148773193359375 length of segment : 22 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003941059112548828 length of segment : 20 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007882118225097656 length of segment : 27 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004093647003173828 length of segment : 20 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1587 time to create 1 rle with old method : 0.002151966094970703 length of segment : 43 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0012063980102539062 length of segment : 36 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 4371 time to create 1 rle with old method : 0.005250453948974609 length of segment : 94 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00039124488830566406 length of segment : 17 time for calcul the mask position with numpy : 0.0003113746643066406 nb_pixel_total : 7024 time to create 1 rle with old method : 0.008434295654296875 length of segment : 125 time for calcul the mask position with numpy : 0.00019693374633789062 nb_pixel_total : 4342 time to create 1 rle with old method : 0.0052912235260009766 length of segment : 91 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0006253719329833984 length of segment : 19 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004088878631591797 length of segment : 21 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005218982696533203 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -107.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00021958351135253906 length of segment : 13 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0007166862487792969 length of segment : 31 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006959438323974609 length of segment : 23 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001881122589111328 length of segment : 14 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003879070281982422 length of segment : 17 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.00074005126953125 length of segment : 30 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003921985626220703 length of segment : 25 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0004315376281738281 length of segment : 18 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005712509155273438 length of segment : 25 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1564 time to create 1 rle with old method : 0.001962423324584961 length of segment : 45 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 18 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003528594970703125 length of segment : 21 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.00048613548278808594 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.88359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 2132 time to create 1 rle with old method : 0.002633810043334961 length of segment : 138 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1241 time to create 1 rle with old method : 0.0015728473663330078 length of segment : 38 time for calcul the mask position with numpy : 0.00013947486877441406 nb_pixel_total : 1016 time to create 1 rle with old method : 0.0020487308502197266 length of segment : 112 time for calcul the mask position with numpy : 0.00012302398681640625 nb_pixel_total : 3481 time to create 1 rle with old method : 0.0044291019439697266 length of segment : 235 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.001031637191772461 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 234.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 108.44375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005345344543457031 length of segment : 36 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 4086 time to create 1 rle with old method : 0.005129575729370117 length of segment : 189 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00034356117248535156 length of segment : 26 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1462 time to create 1 rle with old method : 0.001890420913696289 length of segment : 71 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.001065969467163086 length of segment : 33 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00019359588623046875 length of segment : 20 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 809 time to create 1 rle with old method : 0.001058816909790039 length of segment : 33 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1434 time to create 1 rle with old method : 0.001825094223022461 length of segment : 69 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 3241 time to create 1 rle with old method : 0.004061222076416016 length of segment : 166 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 4410 time to create 1 rle with old method : 0.005298137664794922 length of segment : 235 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 4043 time to create 1 rle with old method : 0.0048046112060546875 length of segment : 198 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 54.31719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009343624114990234 nb_pixel_total : 106002 time to create 1 rle with old method : 0.11916732788085938 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005095005035400391 length of segment : 26 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006186962127685547 length of segment : 25 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002777576446533203 length of segment : 16 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1602 time to create 1 rle with old method : 0.0020122528076171875 length of segment : 40 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.000324249267578125 length of segment : 20 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.00042629241943359375 length of segment : 14 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 16 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1702 time to create 1 rle with old method : 0.0020813941955566406 length of segment : 42 time for calcul the mask position with numpy : 0.0001556873321533203 nb_pixel_total : 9860 time to create 1 rle with old method : 0.011635780334472656 length of segment : 164 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007455348968505859 length of segment : 23 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006721019744873047 length of segment : 33 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.00036835670471191406 length of segment : 14 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.00039267539978027344 length of segment : 14 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.75625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 25 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0009064674377441406 length of segment : 24 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00025773048400878906 length of segment : 22 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006802082061767578 length of segment : 39 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001671314239501953 length of segment : 12 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.000125885009765625 length of segment : 6 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00026226043701171875 length of segment : 17 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0008726119995117188 length of segment : 41 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00012445449829101562 length of segment : 15 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005106925964355469 length of segment : 20 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0004076957702636719 length of segment : 13 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0009243488311767578 length of segment : 43 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00013780593872070312 length of segment : 12 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00024271011352539062 length of segment : 22 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005002021789550781 length of segment : 28 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00014853477478027344 length of segment : 8 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00014853477478027344 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004837512969970703 length of segment : 18 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004668235778808594 length of segment : 15 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1354 time to create 1 rle with old method : 0.0016796588897705078 length of segment : 60 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.0006709098815917969 length of segment : 34 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 2930 time to create 1 rle with old method : 0.0035538673400878906 length of segment : 65 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 2402 time to create 1 rle with old method : 0.003140687942504883 length of segment : 62 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1325 time to create 1 rle with old method : 0.0016944408416748047 length of segment : 59 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004699230194091797 length of segment : 16 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004982948303222656 length of segment : 26 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.83047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005557537078857422 length of segment : 24 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005474090576171875 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003597736358642578 length of segment : 20 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003790855407714844 length of segment : 24 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005068778991699219 length of segment : 25 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1567 time to create 1 rle with old method : 0.002012491226196289 length of segment : 44 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1750 time to create 1 rle with old method : 0.002273082733154297 length of segment : 46 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001621246337890625 length of segment : 8 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.00022912025451660156 length of segment : 18 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002415180206298828 length of segment : 17 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002617835998535156 length of segment : 14 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003619194030761719 length of segment : 43 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.41484 max: 149.98672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.00040030479431152344 length of segment : 37 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0007340908050537109 length of segment : 27 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00021266937255859375 length of segment : 25 time for calcul the mask position with numpy : 0.0001647472381591797 nb_pixel_total : 3886 time to create 1 rle with old method : 0.006932258605957031 length of segment : 119 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 868 time to create 1 rle with old method : 0.0016541481018066406 length of segment : 41 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0011625289916992188 length of segment : 30 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0004811286926269531 length of segment : 32 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 917 time to create 1 rle with old method : 0.0017154216766357422 length of segment : 40 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0012063980102539062 length of segment : 31 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 4006 time to create 1 rle with old method : 0.0051233768463134766 length of segment : 122 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.93438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 51 time to create 1 rle with old method : 0.0001404285430908203 length of segment : 10 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00033473968505859375 length of segment : 37 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 2362 time to create 1 rle with old method : 0.0035486221313476562 length of segment : 85 time for calcul the mask position with numpy : 0.00016760826110839844 nb_pixel_total : 5155 time to create 1 rle with old method : 0.007126331329345703 length of segment : 94 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0005218982696533203 length of segment : 22 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2326 time to create 1 rle with old method : 0.002971172332763672 length of segment : 63 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 28 time to create 1 rle with old method : 7.748603820800781e-05 length of segment : 5 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 2 time to create 1 rle with old method : 2.1696090698242188e-05 length of segment : 1 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00028252601623535156 length of segment : 25 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 4288 time to create 1 rle with old method : 0.00548863410949707 length of segment : 93 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 28 time to create 1 rle with old method : 7.200241088867188e-05 length of segment : 5 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.00159454345703125 length of segment : 43 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 2228 time to create 1 rle with old method : 0.0030753612518310547 length of segment : 62 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00024008750915527344 length of segment : 12 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 2089 time to create 1 rle with old method : 0.0028679370880126953 length of segment : 60 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 881 time to create 1 rle with old method : 0.0012967586517333984 length of segment : 37 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00022912025451660156 length of segment : 19 time for calcul the mask position with numpy : 0.0002110004425048828 nb_pixel_total : 5975 time to create 1 rle with old method : 0.007778644561767578 length of segment : 211 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 1864 time to create 1 rle with old method : 0.0027701854705810547 length of segment : 59 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0009307861328125 length of segment : 58 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00032019615173339844 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -91.20000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00011682510375976562 nb_pixel_total : 3415 time to create 1 rle with old method : 0.004608631134033203 length of segment : 142 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 631 time to create 1 rle with old method : 0.00090789794921875 length of segment : 27 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 5841 time to create 1 rle with old method : 0.008944034576416016 length of segment : 117 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 2141 time to create 1 rle with old method : 0.0027484893798828125 length of segment : 84 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1231 time to create 1 rle with old method : 0.0017459392547607422 length of segment : 64 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 928 time to create 1 rle with old method : 0.0015223026275634766 length of segment : 37 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 1912 time to create 1 rle with old method : 0.0026085376739501953 length of segment : 54 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0006659030914306641 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.91875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.0002288818359375 nb_pixel_total : 9999 time to create 1 rle with old method : 0.01791071891784668 length of segment : 86 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0011200904846191406 length of segment : 27 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0005116462707519531 length of segment : 22 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.000675201416015625 length of segment : 26 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 233.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 108.20547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0007123947143554688 length of segment : 18 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 2191 time to create 1 rle with old method : 0.0028793811798095703 length of segment : 67 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006186962127685547 length of segment : 47 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.0001983642578125 length of segment : 10 time for calcul the mask position with numpy : 0.0006263256072998047 nb_pixel_total : 58565 time to create 1 rle with old method : 0.07701826095581055 length of segment : 259 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007104873657226562 length of segment : 49 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0002655982971191406 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -98.36484 max: 62.09453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.38359 max: 142.37344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0003781318664550781 length of segment : 10 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 19 time for calcul the mask position with numpy : 0.00022077560424804688 nb_pixel_total : 7357 time to create 1 rle with old method : 0.009136676788330078 length of segment : 125 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1042 time to create 1 rle with old method : 0.0014653205871582031 length of segment : 23 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005362033843994141 length of segment : 19 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0008556842803955078 length of segment : 26 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0006611347198486328 length of segment : 18 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004718303680419922 length of segment : 18 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 2754 time to create 1 rle with old method : 0.003554821014404297 length of segment : 52 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00039386749267578125 length of segment : 20 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0009121894836425781 length of segment : 26 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0010862350463867188 length of segment : 36 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.0010323524475097656 length of segment : 33 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 4607 time to create 1 rle with old method : 0.005384683609008789 length of segment : 89 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006649494171142578 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.97344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00022292137145996094 length of segment : 13 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.00048351287841796875 length of segment : 19 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004553794860839844 length of segment : 25 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00020551681518554688 length of segment : 14 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005421638488769531 length of segment : 24 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1449 time to create 1 rle with old method : 0.0018057823181152344 length of segment : 39 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1537 time to create 1 rle with old method : 0.0019469261169433594 length of segment : 44 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003314018249511719 length of segment : 18 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0008480548858642578 length of segment : 21 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0005025863647460938 length of segment : 21 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006651878356933594 length of segment : 29 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0006673336029052734 length of segment : 22 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.0003504753112792969 length of segment : 25 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.0010488033294677734 length of segment : 44 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007376670837402344 length of segment : 23 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 755 time to create 1 rle with old method : 0.0009794235229492188 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.52813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 2138 time to create 1 rle with old method : 0.002835988998413086 length of segment : 144 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0006411075592041016 length of segment : 29 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1258 time to create 1 rle with old method : 0.001615762710571289 length of segment : 39 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 2821 time to create 1 rle with old method : 0.0036127567291259766 length of segment : 40 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 1047 time to create 1 rle with old method : 0.001512289047241211 length of segment : 39 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0009796619415283203 length of segment : 36 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 234.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 110.38125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005588531494140625 length of segment : 40 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 3318 time to create 1 rle with old method : 0.004372119903564453 length of segment : 207 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006439685821533203 length of segment : 42 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003185272216796875 length of segment : 26 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1449 time to create 1 rle with old method : 0.0019025802612304688 length of segment : 69 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.0011217594146728516 length of segment : 33 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0003101825714111328 length of segment : 28 time for calcul the mask position with numpy : 0.0002837181091308594 nb_pixel_total : 4362 time to create 1 rle with old method : 0.0053980350494384766 length of segment : 214 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 51.21563 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008606910705566406 nb_pixel_total : 106247 time to create 1 rle with old method : 0.1269383430480957 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.50234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005409717559814453 length of segment : 26 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005941390991210938 length of segment : 33 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00027489662170410156 length of segment : 16 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006787776947021484 length of segment : 28 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0011663436889648438 length of segment : 51 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 21 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002307891845703125 length of segment : 9 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1363 time to create 1 rle with old method : 0.0016551017761230469 length of segment : 43 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003497600555419922 length of segment : 25 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0007047653198242188 length of segment : 25 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003566741943359375 length of segment : 13 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.00028896331787109375 length of segment : 17 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006566047668457031 length of segment : 47 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1417 time to create 1 rle with old method : 0.001767873764038086 length of segment : 43 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003046989440917969 length of segment : 24 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 3975 time to create 1 rle with old method : 0.004871845245361328 length of segment : 93 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002715587615966797 length of segment : 17 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007662773132324219 length of segment : 24 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.000766754150390625 length of segment : 24 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.79922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0007064342498779297 length of segment : 19 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00012183189392089844 length of segment : 6 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005340576171875 length of segment : 26 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0004520416259765625 length of segment : 21 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0006213188171386719 length of segment : 19 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0005509853363037109 length of segment : 28 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 909 time to create 1 rle with old method : 0.0013234615325927734 length of segment : 31 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00013327598571777344 length of segment : 8 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0006697177886962891 length of segment : 40 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1259 time to create 1 rle with old method : 0.0016257762908935547 length of segment : 62 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0007486343383789062 length of segment : 27 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00021123886108398438 length of segment : 14 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0004496574401855469 length of segment : 12 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005886554718017578 length of segment : 19 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.00048089027404785156 length of segment : 17 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00015687942504882812 length of segment : 17 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 2803 time to create 1 rle with old method : 0.0035903453826904297 length of segment : 52 time for calcul the mask position with numpy : 0.00011610984802246094 nb_pixel_total : 3249 time to create 1 rle with old method : 0.004428386688232422 length of segment : 64 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004913806915283203 length of segment : 18 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 3123 time to create 1 rle with old method : 0.003849029541015625 length of segment : 65 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 19 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.68984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003924369812011719 length of segment : 27 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005693435668945312 length of segment : 31 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007936954498291016 length of segment : 63 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001742839813232422 length of segment : 10 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005788803100585938 length of segment : 20 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0004000663757324219 length of segment : 18 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00018334388732910156 length of segment : 36 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00036525726318359375 length of segment : 25 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00029277801513671875 length of segment : 25 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 672 time to create 1 rle with old method : 0.0008985996246337891 length of segment : 38 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0004928112030029297 length of segment : 26 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002799034118652344 length of segment : 18 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.00043654441833496094 length of segment : 31 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00012302398681640625 length of segment : 9 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003559589385986328 length of segment : 28 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1845 time to create 1 rle with old method : 0.002370595932006836 length of segment : 51 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007274150848388672 length of segment : 29 time for calcul the mask position with numpy : 0.00043129920959472656 nb_pixel_total : 31962 time to create 1 rle with old method : 0.0364985466003418 length of segment : 217 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.80547 max: 150.29141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005252361297607422 length of segment : 26 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003192424774169922 length of segment : 33 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00018143653869628906 length of segment : 28 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 894 time to create 1 rle with old method : 0.001230001449584961 length of segment : 32 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 809 time to create 1 rle with old method : 0.0011086463928222656 length of segment : 37 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 3430 time to create 1 rle with old method : 0.004366874694824219 length of segment : 122 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0005214214324951172 length of segment : 13 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1926 time to create 1 rle with old method : 0.00258636474609375 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.93047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1245 time to create 1 rle with old method : 0.0016317367553710938 length of segment : 54 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 2281 time to create 1 rle with old method : 0.002860546112060547 length of segment : 61 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 2779 time to create 1 rle with old method : 0.0034389495849609375 length of segment : 68 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1059 time to create 1 rle with old method : 0.001489877700805664 length of segment : 55 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0003228187561035156 length of segment : 39 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 32 time to create 1 rle with old method : 7.462501525878906e-05 length of segment : 5 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2588 time to create 1 rle with old method : 0.003263235092163086 length of segment : 92 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00020551681518554688 length of segment : 27 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 21 time to create 1 rle with old method : 8.0108642578125e-05 length of segment : 3 length of segment : 0 time for calcul the mask position with numpy : 0.0001392364501953125 nb_pixel_total : 1757 time to create 1 rle with old method : 0.002309083938598633 length of segment : 48 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 27 time to create 1 rle with old method : 0.00012230873107910156 length of segment : 5 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 588 time to create 1 rle with old method : 0.0007867813110351562 length of segment : 33 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004417896270751953 length of segment : 23 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1608 time to create 1 rle with old method : 0.0019974708557128906 length of segment : 47 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1479 time to create 1 rle with old method : 0.0019092559814453125 length of segment : 43 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004553794860839844 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -92.97734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 6674 time to create 1 rle with old method : 0.009929418563842773 length of segment : 103 time for calcul the mask position with numpy : 0.00013208389282226562 nb_pixel_total : 4260 time to create 1 rle with old method : 0.005272865295410156 length of segment : 153 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0008339881896972656 length of segment : 23 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 1397 time to create 1 rle with old method : 0.00177764892578125 length of segment : 77 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1395 time to create 1 rle with old method : 0.001970529556274414 length of segment : 21 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1188 time to create 1 rle with old method : 0.0016312599182128906 length of segment : 35 time for calcul the mask position with numpy : 0.0005552768707275391 nb_pixel_total : 25803 time to create 1 rle with old method : 0.029145479202270508 length of segment : 321 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1645 time to create 1 rle with old method : 0.002077817916870117 length of segment : 71 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.51641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0009148120880126953 length of segment : 25 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0004642009735107422 length of segment : 27 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 237.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 114.25625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 3093 time to create 1 rle with old method : 0.003997087478637695 length of segment : 72 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.0008585453033447266 length of segment : 20 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001995563507080078 length of segment : 16 time for calcul the mask position with numpy : 0.0006198883056640625 nb_pixel_total : 56905 time to create 1 rle with old method : 0.06538820266723633 length of segment : 288 time for calcul the mask position with numpy : 0.0007188320159912109 nb_pixel_total : 69732 time to create 1 rle with old method : 0.08016729354858398 length of segment : 275 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 211.00000 molded_images shape: (1, 640, 640, 3) min: -98.85313 max: 66.49922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.05547 max: 137.09219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00048065185546875 length of segment : 17 time for calcul the mask position with numpy : 0.00018835067749023438 nb_pixel_total : 8062 time to create 1 rle with old method : 0.011032342910766602 length of segment : 135 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00037407875061035156 length of segment : 20 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0008363723754882812 length of segment : 25 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 937 time to create 1 rle with old method : 0.0013582706451416016 length of segment : 23 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.00091552734375 length of segment : 25 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0017087459564208984 length of segment : 61 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00023794174194335938 length of segment : 12 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0004470348358154297 length of segment : 20 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 851 time to create 1 rle with old method : 0.0015065670013427734 length of segment : 35 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 2719 time to create 1 rle with old method : 0.003350496292114258 length of segment : 132 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004153251647949219 length of segment : 18 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.001026153564453125 length of segment : 34 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 678 time to create 1 rle with old method : 0.0009188652038574219 length of segment : 27 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0007069110870361328 length of segment : 18 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 764 time to create 1 rle with old method : 0.0010170936584472656 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.14141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00022745132446289062 length of segment : 14 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007739067077636719 length of segment : 30 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004398822784423828 length of segment : 26 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00020313262939453125 length of segment : 15 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004982948303222656 length of segment : 23 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004780292510986328 length of segment : 19 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0007221698760986328 length of segment : 23 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00036716461181640625 length of segment : 22 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002956390380859375 length of segment : 19 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006804466247558594 length of segment : 29 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0005271434783935547 length of segment : 24 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 735 time to create 1 rle with old method : 0.000926971435546875 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.23516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 2142 time to create 1 rle with old method : 0.0026640892028808594 length of segment : 134 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1201 time to create 1 rle with old method : 0.0015649795532226562 length of segment : 40 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 34 time to create 1 rle with old method : 7.796287536621094e-05 length of segment : 6 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0015718936920166016 length of segment : 38 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 236.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 106.67031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005216598510742188 length of segment : 41 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1620 time to create 1 rle with old method : 0.0020744800567626953 length of segment : 80 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00016689300537109375 length of segment : 17 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003676414489746094 length of segment : 26 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 3413 time to create 1 rle with old method : 0.004281044006347656 length of segment : 226 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.001096487045288086 length of segment : 34 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0011010169982910156 length of segment : 32 time for calcul the mask position with numpy : 0.00011897087097167969 nb_pixel_total : 3064 time to create 1 rle with old method : 0.0037801265716552734 length of segment : 180 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 4181 time to create 1 rle with old method : 0.005105733871459961 length of segment : 204 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 179.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 52.29766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.84219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004918575286865234 length of segment : 30 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.0004124641418457031 length of segment : 21 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0007791519165039062 length of segment : 45 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0007829666137695312 length of segment : 27 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005609989166259766 length of segment : 21 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1324 time to create 1 rle with old method : 0.0017077922821044922 length of segment : 46 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 15 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0016858577728271484 length of segment : 64 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007791519165039062 length of segment : 22 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00033855438232421875 length of segment : 24 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.00030350685119628906 length of segment : 27 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002865791320800781 length of segment : 15 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1450 time to create 1 rle with old method : 0.0017409324645996094 length of segment : 72 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0008211135864257812 length of segment : 26 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005817413330078125 length of segment : 33 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00025177001953125 length of segment : 28 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1299 time to create 1 rle with old method : 0.0016591548919677734 length of segment : 43 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006163120269775391 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.48672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006499290466308594 length of segment : 21 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.0005130767822265625 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00015854835510253906 length of segment : 18 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0014395713806152344 length of segment : 47 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00014543533325195312 length of segment : 6 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005173683166503906 length of segment : 28 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00017547607421875 length of segment : 12 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1322 time to create 1 rle with old method : 0.0017087459564208984 length of segment : 57 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004723072052001953 length of segment : 27 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.00011467933654785156 length of segment : 6 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0002028942108154297 length of segment : 24 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.00034737586975097656 length of segment : 14 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0004265308380126953 length of segment : 14 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003209114074707031 length of segment : 18 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006597042083740234 length of segment : 39 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.00046896934509277344 length of segment : 17 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 2892 time to create 1 rle with old method : 0.003717184066772461 length of segment : 53 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 689 time to create 1 rle with old method : 0.0008945465087890625 length of segment : 29 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.000415802001953125 length of segment : 26 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00010609626770019531 length of segment : 7 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007140636444091797 length of segment : 39 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 3173 time to create 1 rle with old method : 0.0037887096405029297 length of segment : 64 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003542900085449219 length of segment : 24 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005130767822265625 length of segment : 18 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 2930 time to create 1 rle with old method : 0.0036039352416992188 length of segment : 55 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006930828094482422 length of segment : 35 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00030159950256347656 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00035500526428222656 length of segment : 23 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00017833709716796875 length of segment : 8 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005991458892822266 length of segment : 27 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00040268898010253906 length of segment : 59 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.000518798828125 length of segment : 18 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003879070281982422 length of segment : 24 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005135536193847656 length of segment : 26 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.000274658203125 length of segment : 19 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00035381317138671875 length of segment : 36 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003345012664794922 length of segment : 25 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1911 time to create 1 rle with old method : 0.002428293228149414 length of segment : 53 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.00034165382385253906 length of segment : 22 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004334449768066406 length of segment : 33 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.000453948974609375 length of segment : 18 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 15 time to create 1 rle with old method : 6.151199340820312e-05 length of segment : 3 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 34834 time to create 1 rle with old method : 0.04151439666748047 length of segment : 248 Detection mask done ! Trying to reset tf kernel 356924 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 417 tf kernel not reseted sub process len(results) : 438 len(list_Values) 438 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 438 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 438 chid ids of type : 4228 Number RLEs to save : 19687 save missing photos in datou_result : time spend for datou_step_exec : 25.81829261779785 time spend to save output : 3.3880364894866943 total time spend for step 1 : 29.206329107284546 step2:brightness Sat Feb 8 16:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739028028_356560_1335873097_bb91ce87dfc6071d9c5b3c0add3802ef.jpg treat image : temp/1739028028_356560_1335872919_b0c2ac748da20abbc240a5b426bf386f.jpg treat image : temp/1739028028_356560_1335872903_dc5b17a8799dce048c8a68b0c5d7bf3b.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.018563270568847656 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.012475728988647461 save missing photos in datou_result : time spend for datou_step_exec : 0.7344439029693604 time spend to save output : 0.03505444526672363 total time spend for step 2 : 0.769498348236084 step3:blur_detection Sat Feb 8 16:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739028028_356560_1335873097_bb91ce87dfc6071d9c5b3c0add3802ef.jpg resize: (1080, 1920) 1335873097 -7.591659387248769 treat image : temp/1739028028_356560_1335872919_b0c2ac748da20abbc240a5b426bf386f.jpg resize: (1080, 1920) 1335872919 -7.59078024681338 treat image : temp/1739028028_356560_1335872903_dc5b17a8799dce048c8a68b0c5d7bf3b.jpg resize: (1080, 1920) 1335872903 -7.582960013667187 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.018200159072875977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.01894974708557129 save missing photos in datou_result : time spend for datou_step_exec : 2.3168253898620605 time spend to save output : 0.04122662544250488 total time spend for step 3 : 2.3580520153045654 step4:rle_unique_nms_with_priority Sat Feb 8 16:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 438 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 139 nb_hashtags : 8 time to prepare the origin masks : 1.0352404117584229 time for calcul the mask position with numpy : 0.022441864013671875 nb_pixel_total : 1774013 time to create 1 rle with new method : 0.04701805114746094 time for calcul the mask position with numpy : 0.008346796035766602 nb_pixel_total : 55 time to create 1 rle with old method : 8.606910705566406e-05 time for calcul the mask position with numpy : 0.00804591178894043 nb_pixel_total : 1819 time to create 1 rle with old method : 0.002124786376953125 time for calcul the mask position with numpy : 0.008125066757202148 nb_pixel_total : 1462 time to create 1 rle with old method : 0.001720428466796875 time for calcul the mask position with numpy : 0.008307218551635742 nb_pixel_total : 74960 time to create 1 rle with old method : 0.0816946029663086 time for calcul the mask position with numpy : 0.008020162582397461 nb_pixel_total : 9 time to create 1 rle with old method : 2.1219253540039062e-05 time for calcul the mask position with numpy : 0.00806736946105957 nb_pixel_total : 150 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.00803065299987793 nb_pixel_total : 1839 time to create 1 rle with old method : 0.0021903514862060547 time for calcul the mask position with numpy : 0.008066654205322266 nb_pixel_total : 194 time to create 1 rle with old method : 0.00023603439331054688 time for calcul the mask position with numpy : 0.008003711700439453 nb_pixel_total : 128 time to create 1 rle with old method : 0.000164031982421875 time for calcul the mask position with numpy : 0.008132696151733398 nb_pixel_total : 161 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.008069038391113281 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.008054971694946289 nb_pixel_total : 915 time to create 1 rle with old method : 0.001119852066040039 time for calcul the mask position with numpy : 0.007767200469970703 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004317760467529297 time for calcul the mask position with numpy : 0.007888078689575195 nb_pixel_total : 174 time to create 1 rle with old method : 0.0001964569091796875 time for calcul the mask position with numpy : 0.007976055145263672 nb_pixel_total : 295 time to create 1 rle with old method : 0.0003294944763183594 time for calcul the mask position with numpy : 0.007815122604370117 nb_pixel_total : 851 time to create 1 rle with old method : 0.0009443759918212891 time for calcul the mask position with numpy : 0.00773310661315918 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003445148468017578 time for calcul the mask position with numpy : 0.007803678512573242 nb_pixel_total : 44 time to create 1 rle with old method : 8.726119995117188e-05 time for calcul the mask position with numpy : 0.007978677749633789 nb_pixel_total : 33 time to create 1 rle with old method : 3.9577484130859375e-05 time for calcul the mask position with numpy : 0.007900714874267578 nb_pixel_total : 29 time to create 1 rle with old method : 3.981590270996094e-05 time for calcul the mask position with numpy : 0.007753133773803711 nb_pixel_total : 27 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.008078813552856445 nb_pixel_total : 351 time to create 1 rle with old method : 0.00045943260192871094 time for calcul the mask position with numpy : 0.00794076919555664 nb_pixel_total : 2348 time to create 1 rle with old method : 0.002643585205078125 time for calcul the mask position with numpy : 0.008201360702514648 nb_pixel_total : 1978 time to create 1 rle with old method : 0.0022280216217041016 time for calcul the mask position with numpy : 0.007970333099365234 nb_pixel_total : 126 time to create 1 rle with old method : 0.00017142295837402344 time for calcul the mask position with numpy : 0.00810694694519043 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001380443572998047 time for calcul the mask position with numpy : 0.007969379425048828 nb_pixel_total : 2384 time to create 1 rle with old method : 0.002722501754760742 time for calcul the mask position with numpy : 0.008139610290527344 nb_pixel_total : 217 time to create 1 rle with old method : 0.00027441978454589844 time for calcul the mask position with numpy : 0.007885456085205078 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004019737243652344 time for calcul the mask position with numpy : 0.007705211639404297 nb_pixel_total : 331 time to create 1 rle with old method : 0.000347137451171875 time for calcul the mask position with numpy : 0.008041620254516602 nb_pixel_total : 42 time to create 1 rle with old method : 8.916854858398438e-05 time for calcul the mask position with numpy : 0.007793903350830078 nb_pixel_total : 3364 time to create 1 rle with old method : 0.0039014816284179688 time for calcul the mask position with numpy : 0.00796198844909668 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0010917186737060547 time for calcul the mask position with numpy : 0.007788896560668945 nb_pixel_total : 862 time to create 1 rle with old method : 0.0009629726409912109 time for calcul the mask position with numpy : 0.007889986038208008 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005941390991210938 time for calcul the mask position with numpy : 0.007727622985839844 nb_pixel_total : 35 time to create 1 rle with old method : 7.295608520507812e-05 time for calcul the mask position with numpy : 0.007988452911376953 nb_pixel_total : 1123 time to create 1 rle with old method : 0.0012936592102050781 time for calcul the mask position with numpy : 0.008095502853393555 nb_pixel_total : 6780 time to create 1 rle with old method : 0.0077893733978271484 time for calcul the mask position with numpy : 0.008014440536499023 nb_pixel_total : 507 time to create 1 rle with old method : 0.0005316734313964844 time for calcul the mask position with numpy : 0.007972478866577148 nb_pixel_total : 277 time to create 1 rle with old method : 0.000423431396484375 time for calcul the mask position with numpy : 0.008147001266479492 nb_pixel_total : 10043 time to create 1 rle with old method : 0.011180877685546875 time for calcul the mask position with numpy : 0.008197307586669922 nb_pixel_total : 3 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.008090496063232422 nb_pixel_total : 2841 time to create 1 rle with old method : 0.0034193992614746094 time for calcul the mask position with numpy : 0.008346080780029297 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006313323974609375 time for calcul the mask position with numpy : 0.00832986831665039 nb_pixel_total : 4371 time to create 1 rle with old method : 0.0051920413970947266 time for calcul the mask position with numpy : 0.00822758674621582 nb_pixel_total : 48 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.008165597915649414 nb_pixel_total : 3481 time to create 1 rle with old method : 0.0042574405670166016 time for calcul the mask position with numpy : 0.008287191390991211 nb_pixel_total : 4086 time to create 1 rle with old method : 0.0049648284912109375 time for calcul the mask position with numpy : 0.008099794387817383 nb_pixel_total : 1016 time to create 1 rle with old method : 0.001256704330444336 time for calcul the mask position with numpy : 0.008004188537597656 nb_pixel_total : 800 time to create 1 rle with old method : 0.0009510517120361328 time for calcul the mask position with numpy : 0.007955074310302734 nb_pixel_total : 1241 time to create 1 rle with old method : 0.001444101333618164 time for calcul the mask position with numpy : 0.008054018020629883 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004956722259521484 time for calcul the mask position with numpy : 0.0082244873046875 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002574920654296875 time for calcul the mask position with numpy : 0.008232831954956055 nb_pixel_total : 7935 time to create 1 rle with old method : 0.009317874908447266 time for calcul the mask position with numpy : 0.008302927017211914 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003008842468261719 time for calcul the mask position with numpy : 0.008295059204101562 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009312629699707031 time for calcul the mask position with numpy : 0.008188724517822266 nb_pixel_total : 26 time to create 1 rle with old method : 6.079673767089844e-05 time for calcul the mask position with numpy : 0.007891178131103516 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0018570423126220703 time for calcul the mask position with numpy : 0.008083820343017578 nb_pixel_total : 120 time to create 1 rle with old method : 0.0001544952392578125 time for calcul the mask position with numpy : 0.008028030395507812 nb_pixel_total : 127 time to create 1 rle with old method : 0.00016307830810546875 time for calcul the mask position with numpy : 0.008263826370239258 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002999305725097656 time for calcul the mask position with numpy : 0.009579181671142578 nb_pixel_total : 303 time to create 1 rle with old method : 0.00038814544677734375 time for calcul the mask position with numpy : 0.008496999740600586 nb_pixel_total : 2132 time to create 1 rle with old method : 0.002529621124267578 time for calcul the mask position with numpy : 0.008013486862182617 nb_pixel_total : 3241 time to create 1 rle with old method : 0.0038268566131591797 time for calcul the mask position with numpy : 0.008329153060913086 nb_pixel_total : 59 time to create 1 rle with old method : 7.867813110351562e-05 time for calcul the mask position with numpy : 0.008104085922241211 nb_pixel_total : 443 time to create 1 rle with old method : 0.00048661231994628906 time for calcul the mask position with numpy : 0.00805974006652832 nb_pixel_total : 257 time to create 1 rle with old method : 0.00030732154846191406 time for calcul the mask position with numpy : 0.008268594741821289 nb_pixel_total : 567 time to create 1 rle with old method : 0.0006554126739501953 time for calcul the mask position with numpy : 0.008141756057739258 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003147125244140625 time for calcul the mask position with numpy : 0.008343696594238281 nb_pixel_total : 533 time to create 1 rle with old method : 0.0006480216979980469 time for calcul the mask position with numpy : 0.00833272933959961 nb_pixel_total : 1587 time to create 1 rle with old method : 0.0018572807312011719 time for calcul the mask position with numpy : 0.008342504501342773 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004489421844482422 time for calcul the mask position with numpy : 0.00836324691772461 nb_pixel_total : 399 time to create 1 rle with old method : 0.0004820823669433594 time for calcul the mask position with numpy : 0.008117198944091797 nb_pixel_total : 275 time to create 1 rle with old method : 0.00031876564025878906 time for calcul the mask position with numpy : 0.008160114288330078 nb_pixel_total : 289 time to create 1 rle with old method : 0.00032639503479003906 time for calcul the mask position with numpy : 0.008262395858764648 nb_pixel_total : 117 time to create 1 rle with old method : 0.00014352798461914062 time for calcul the mask position with numpy : 0.008393287658691406 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003447532653808594 time for calcul the mask position with numpy : 0.008374214172363281 nb_pixel_total : 21 time to create 1 rle with old method : 4.100799560546875e-05 time for calcul the mask position with numpy : 0.008211135864257812 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007257461547851562 time for calcul the mask position with numpy : 0.00831151008605957 nb_pixel_total : 1462 time to create 1 rle with old method : 0.0018002986907958984 time for calcul the mask position with numpy : 0.008347272872924805 nb_pixel_total : 41 time to create 1 rle with old method : 8.559226989746094e-05 time for calcul the mask position with numpy : 0.008383750915527344 nb_pixel_total : 51 time to create 1 rle with old method : 8.535385131835938e-05 time for calcul the mask position with numpy : 0.008339405059814453 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003120899200439453 time for calcul the mask position with numpy : 0.008399248123168945 nb_pixel_total : 331 time to create 1 rle with old method : 0.00040912628173828125 time for calcul the mask position with numpy : 0.008354663848876953 nb_pixel_total : 131 time to create 1 rle with old method : 0.00015807151794433594 time for calcul the mask position with numpy : 0.008382081985473633 nb_pixel_total : 1564 time to create 1 rle with old method : 0.0018842220306396484 time for calcul the mask position with numpy : 0.008377790451049805 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006237030029296875 time for calcul the mask position with numpy : 0.008359909057617188 nb_pixel_total : 224 time to create 1 rle with old method : 0.00027871131896972656 time for calcul the mask position with numpy : 0.009092569351196289 nb_pixel_total : 106002 time to create 1 rle with old method : 0.1184380054473877 time for calcul the mask position with numpy : 0.008313894271850586 nb_pixel_total : 282 time to create 1 rle with old method : 0.00035071372985839844 time for calcul the mask position with numpy : 0.008246421813964844 nb_pixel_total : 104 time to create 1 rle with old method : 0.00016355514526367188 time for calcul the mask position with numpy : 0.00835561752319336 nb_pixel_total : 1602 time to create 1 rle with old method : 0.0018465518951416016 time for calcul the mask position with numpy : 0.00835275650024414 nb_pixel_total : 81 time to create 1 rle with old method : 0.00010418891906738281 time for calcul the mask position with numpy : 0.008250713348388672 nb_pixel_total : 213 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.008297920227050781 nb_pixel_total : 9860 time to create 1 rle with old method : 0.011531591415405273 time for calcul the mask position with numpy : 0.008214712142944336 nb_pixel_total : 616 time to create 1 rle with old method : 0.0007750988006591797 time for calcul the mask position with numpy : 0.008247852325439453 nb_pixel_total : 343 time to create 1 rle with old method : 0.00042128562927246094 time for calcul the mask position with numpy : 0.008348226547241211 nb_pixel_total : 651 time to create 1 rle with old method : 0.0007901191711425781 time for calcul the mask position with numpy : 0.008290767669677734 nb_pixel_total : 1354 time to create 1 rle with old method : 0.0015702247619628906 time for calcul the mask position with numpy : 0.008243322372436523 nb_pixel_total : 72 time to create 1 rle with old method : 0.00010442733764648438 time for calcul the mask position with numpy : 0.008249998092651367 nb_pixel_total : 4 time to create 1 rle with old method : 1.239776611328125e-05 time for calcul the mask position with numpy : 0.008213520050048828 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006453990936279297 time for calcul the mask position with numpy : 0.008316993713378906 nb_pixel_total : 147 time to create 1 rle with old method : 0.00018167495727539062 time for calcul the mask position with numpy : 0.008213043212890625 nb_pixel_total : 80 time to create 1 rle with old method : 0.00010776519775390625 time for calcul the mask position with numpy : 0.008111238479614258 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004742145538330078 time for calcul the mask position with numpy : 0.008278369903564453 nb_pixel_total : 257 time to create 1 rle with old method : 0.00030684471130371094 time for calcul the mask position with numpy : 0.008330583572387695 nb_pixel_total : 173 time to create 1 rle with old method : 0.00021767616271972656 time for calcul the mask position with numpy : 0.008234739303588867 nb_pixel_total : 2930 time to create 1 rle with old method : 0.0034532546997070312 time for calcul the mask position with numpy : 0.008125782012939453 nb_pixel_total : 1567 time to create 1 rle with old method : 0.0017895698547363281 time for calcul the mask position with numpy : 0.008311986923217773 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002741813659667969 time for calcul the mask position with numpy : 0.008186101913452148 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.008246421813964844 nb_pixel_total : 159 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.008328676223754883 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005202293395996094 time for calcul the mask position with numpy : 0.008344173431396484 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005590915679931641 time for calcul the mask position with numpy : 0.008328676223754883 nb_pixel_total : 176 time to create 1 rle with old method : 0.00020575523376464844 time for calcul the mask position with numpy : 0.008252382278442383 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002300739288330078 time for calcul the mask position with numpy : 0.008356809616088867 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004601478576660156 time for calcul the mask position with numpy : 0.008286476135253906 nb_pixel_total : 368 time to create 1 rle with old method : 0.00042724609375 time for calcul the mask position with numpy : 0.008080482482910156 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006449222564697266 time for calcul the mask position with numpy : 0.008268356323242188 nb_pixel_total : 2402 time to create 1 rle with old method : 0.00274658203125 time for calcul the mask position with numpy : 0.008241653442382812 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004298686981201172 time for calcul the mask position with numpy : 0.00819253921508789 nb_pixel_total : 19 time to create 1 rle with old method : 4.315376281738281e-05 time for calcul the mask position with numpy : 0.00817561149597168 nb_pixel_total : 528 time to create 1 rle with old method : 0.0006306171417236328 time for calcul the mask position with numpy : 0.008148431777954102 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003204345703125 time for calcul the mask position with numpy : 0.008154630661010742 nb_pixel_total : 662 time to create 1 rle with old method : 0.0007870197296142578 time for calcul the mask position with numpy : 0.008182287216186523 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001304149627685547 time for calcul the mask position with numpy : 0.007939577102661133 nb_pixel_total : 182 time to create 1 rle with old method : 0.00021219253540039062 time for calcul the mask position with numpy : 0.008355855941772461 nb_pixel_total : 79 time to create 1 rle with old method : 0.00011157989501953125 time for calcul the mask position with numpy : 0.008149385452270508 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001621246337890625 time for calcul the mask position with numpy : 0.008278608322143555 nb_pixel_total : 252 time to create 1 rle with old method : 0.00029659271240234375 time for calcul the mask position with numpy : 0.008049964904785156 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004534721374511719 time for calcul the mask position with numpy : 0.008144378662109375 nb_pixel_total : 16 time to create 1 rle with old method : 4.410743713378906e-05 time for calcul the mask position with numpy : 0.00830388069152832 nb_pixel_total : 78 time to create 1 rle with old method : 0.00010013580322265625 time for calcul the mask position with numpy : 0.008219480514526367 nb_pixel_total : 321 time to create 1 rle with old method : 0.0003714561462402344 time for calcul the mask position with numpy : 0.008374929428100586 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003097057342529297 time for calcul the mask position with numpy : 0.008364439010620117 nb_pixel_total : 28 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.008797645568847656 nb_pixel_total : 193 time to create 1 rle with old method : 0.000308990478515625 time for calcul the mask position with numpy : 0.009659290313720703 nb_pixel_total : 95 time to create 1 rle with old method : 0.00012803077697753906 time for calcul the mask position with numpy : 0.008342742919921875 nb_pixel_total : 61 time to create 1 rle with old method : 9.012222290039062e-05 create new chi : 1.5563852787017822 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0061664581298828125 batch 1 Loaded 140 chid ids of type : 4230 Number RLEs to save : 12023 TO DO : save crop sub photo not yet done ! save time : 0.9593327045440674 nb_obj : 153 nb_hashtags : 8 time to prepare the origin masks : 2.4069650173187256 time for calcul the mask position with numpy : 0.02195000648498535 nb_pixel_total : 1749484 time to create 1 rle with new method : 0.04889559745788574 time for calcul the mask position with numpy : 0.007173299789428711 nb_pixel_total : 51 time to create 1 rle with old method : 0.0001232624053955078 time for calcul the mask position with numpy : 0.011116743087768555 nb_pixel_total : 2141 time to create 1 rle with old method : 0.002546072006225586 time for calcul the mask position with numpy : 0.010418891906738281 nb_pixel_total : 3415 time to create 1 rle with old method : 0.0043888092041015625 time for calcul the mask position with numpy : 0.009783029556274414 nb_pixel_total : 12 time to create 1 rle with old method : 4.57763671875e-05 time for calcul the mask position with numpy : 0.006693363189697266 nb_pixel_total : 138 time to create 1 rle with old method : 0.0001773834228515625 time for calcul the mask position with numpy : 0.006527423858642578 nb_pixel_total : 160 time to create 1 rle with old method : 0.00022220611572265625 time for calcul the mask position with numpy : 0.006028413772583008 nb_pixel_total : 164 time to create 1 rle with old method : 0.000213623046875 time for calcul the mask position with numpy : 0.006143331527709961 nb_pixel_total : 44 time to create 1 rle with old method : 0.00010013580322265625 time for calcul the mask position with numpy : 0.005857944488525391 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003407001495361328 time for calcul the mask position with numpy : 0.00598597526550293 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006537437438964844 time for calcul the mask position with numpy : 0.00743865966796875 nb_pixel_total : 58565 time to create 1 rle with old method : 0.06642532348632812 time for calcul the mask position with numpy : 0.0063288211822509766 nb_pixel_total : 868 time to create 1 rle with old method : 0.0010809898376464844 time for calcul the mask position with numpy : 0.006087303161621094 nb_pixel_total : 388 time to create 1 rle with old method : 0.0004401206970214844 time for calcul the mask position with numpy : 0.005867719650268555 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002579689025878906 time for calcul the mask position with numpy : 0.006072998046875 nb_pixel_total : 332 time to create 1 rle with old method : 0.00038242340087890625 time for calcul the mask position with numpy : 0.005939483642578125 nb_pixel_total : 108 time to create 1 rle with old method : 0.00014328956604003906 time for calcul the mask position with numpy : 0.006015777587890625 nb_pixel_total : 28 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.005846738815307617 nb_pixel_total : 44 time to create 1 rle with old method : 8.535385131835938e-05 time for calcul the mask position with numpy : 0.005727529525756836 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007832050323486328 time for calcul the mask position with numpy : 0.005743503570556641 nb_pixel_total : 40 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.006147146224975586 nb_pixel_total : 28 time to create 1 rle with old method : 5.316734313964844e-05 time for calcul the mask position with numpy : 0.0059566497802734375 nb_pixel_total : 2 time to create 1 rle with old method : 2.3603439331054688e-05 time for calcul the mask position with numpy : 0.006021261215209961 nb_pixel_total : 95 time to create 1 rle with old method : 0.00013828277587890625 time for calcul the mask position with numpy : 0.005916595458984375 nb_pixel_total : 2317 time to create 1 rle with old method : 0.002691507339477539 time for calcul the mask position with numpy : 0.006289958953857422 nb_pixel_total : 2089 time to create 1 rle with old method : 0.002304553985595703 time for calcul the mask position with numpy : 0.006133556365966797 nb_pixel_total : 35 time to create 1 rle with old method : 9.775161743164062e-05 time for calcul the mask position with numpy : 0.006199836730957031 nb_pixel_total : 1912 time to create 1 rle with old method : 0.0021393299102783203 time for calcul the mask position with numpy : 0.006178617477416992 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001506805419921875 time for calcul the mask position with numpy : 0.006737709045410156 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007722377777099609 time for calcul the mask position with numpy : 0.0059967041015625 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002808570861816406 time for calcul the mask position with numpy : 0.00609898567199707 nb_pixel_total : 551 time to create 1 rle with old method : 0.0007305145263671875 time for calcul the mask position with numpy : 0.005979776382446289 nb_pixel_total : 3886 time to create 1 rle with old method : 0.004447460174560547 time for calcul the mask position with numpy : 0.0058748722076416016 nb_pixel_total : 5155 time to create 1 rle with old method : 0.00605010986328125 time for calcul the mask position with numpy : 0.0057675838470458984 nb_pixel_total : 297 time to create 1 rle with old method : 0.0005373954772949219 time for calcul the mask position with numpy : 0.005986690521240234 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0011446475982666016 time for calcul the mask position with numpy : 0.0057582855224609375 nb_pixel_total : 2362 time to create 1 rle with old method : 0.002627134323120117 time for calcul the mask position with numpy : 0.0058786869049072266 nb_pixel_total : 5975 time to create 1 rle with old method : 0.006493330001831055 time for calcul the mask position with numpy : 0.005759000778198242 nb_pixel_total : 27 time to create 1 rle with old method : 6.127357482910156e-05 time for calcul the mask position with numpy : 0.005853176116943359 nb_pixel_total : 631 time to create 1 rle with old method : 0.0007522106170654297 time for calcul the mask position with numpy : 0.005718231201171875 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005795955657958984 time for calcul the mask position with numpy : 0.007172822952270508 nb_pixel_total : 928 time to create 1 rle with old method : 0.001049041748046875 time for calcul the mask position with numpy : 0.009420394897460938 nb_pixel_total : 5841 time to create 1 rle with old method : 0.006409883499145508 time for calcul the mask position with numpy : 0.009206056594848633 nb_pixel_total : 19 time to create 1 rle with old method : 4.76837158203125e-05 time for calcul the mask position with numpy : 0.009601831436157227 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005352497100830078 time for calcul the mask position with numpy : 0.009587526321411133 nb_pixel_total : 9999 time to create 1 rle with old method : 0.011411190032958984 time for calcul the mask position with numpy : 0.009800434112548828 nb_pixel_total : 106 time to create 1 rle with old method : 0.00016069412231445312 time for calcul the mask position with numpy : 0.009731054306030273 nb_pixel_total : 2191 time to create 1 rle with old method : 0.0026178359985351562 time for calcul the mask position with numpy : 0.012577056884765625 nb_pixel_total : 881 time to create 1 rle with old method : 0.0010280609130859375 time for calcul the mask position with numpy : 0.009609699249267578 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006363391876220703 time for calcul the mask position with numpy : 0.009597063064575195 nb_pixel_total : 4607 time to create 1 rle with old method : 0.004988908767700195 time for calcul the mask position with numpy : 0.009848356246948242 nb_pixel_total : 3318 time to create 1 rle with old method : 0.003879547119140625 time for calcul the mask position with numpy : 0.009673118591308594 nb_pixel_total : 509 time to create 1 rle with old method : 0.00064849853515625 time for calcul the mask position with numpy : 0.009677648544311523 nb_pixel_total : 755 time to create 1 rle with old method : 0.0009114742279052734 time for calcul the mask position with numpy : 0.009659767150878906 nb_pixel_total : 758 time to create 1 rle with old method : 0.0009462833404541016 time for calcul the mask position with numpy : 0.009845256805419922 nb_pixel_total : 1258 time to create 1 rle with old method : 0.001520395278930664 time for calcul the mask position with numpy : 0.009892463684082031 nb_pixel_total : 7357 time to create 1 rle with old method : 0.008333683013916016 time for calcul the mask position with numpy : 0.009778261184692383 nb_pixel_total : 214 time to create 1 rle with old method : 0.0002727508544921875 time for calcul the mask position with numpy : 0.009818553924560547 nb_pixel_total : 836 time to create 1 rle with old method : 0.0010383129119873047 time for calcul the mask position with numpy : 0.009890556335449219 nb_pixel_total : 86 time to create 1 rle with old method : 0.000125885009765625 time for calcul the mask position with numpy : 0.009832382202148438 nb_pixel_total : 4362 time to create 1 rle with old method : 0.004954814910888672 time for calcul the mask position with numpy : 0.009873151779174805 nb_pixel_total : 206 time to create 1 rle with old method : 0.00026345252990722656 time for calcul the mask position with numpy : 0.009882211685180664 nb_pixel_total : 144 time to create 1 rle with old method : 0.00023055076599121094 time for calcul the mask position with numpy : 0.00972127914428711 nb_pixel_total : 2138 time to create 1 rle with old method : 0.0025064945220947266 time for calcul the mask position with numpy : 0.010026693344116211 nb_pixel_total : 18 time to create 1 rle with old method : 4.38690185546875e-05 time for calcul the mask position with numpy : 0.010405302047729492 nb_pixel_total : 24 time to create 1 rle with old method : 5.2928924560546875e-05 time for calcul the mask position with numpy : 0.010511159896850586 nb_pixel_total : 26 time to create 1 rle with old method : 7.963180541992188e-05 time for calcul the mask position with numpy : 0.010428905487060547 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005767345428466797 time for calcul the mask position with numpy : 0.010690689086914062 nb_pixel_total : 768 time to create 1 rle with old method : 0.0008962154388427734 time for calcul the mask position with numpy : 0.010357856750488281 nb_pixel_total : 8 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.009998083114624023 nb_pixel_total : 154 time to create 1 rle with old method : 0.0002872943878173828 time for calcul the mask position with numpy : 0.010157346725463867 nb_pixel_total : 492 time to create 1 rle with old method : 0.0005757808685302734 time for calcul the mask position with numpy : 0.01033639907836914 nb_pixel_total : 297 time to create 1 rle with old method : 0.000385284423828125 time for calcul the mask position with numpy : 0.010604143142700195 nb_pixel_total : 614 time to create 1 rle with old method : 0.0007517337799072266 time for calcul the mask position with numpy : 0.006503105163574219 nb_pixel_total : 1047 time to create 1 rle with old method : 0.0013356208801269531 time for calcul the mask position with numpy : 0.006040096282958984 nb_pixel_total : 391 time to create 1 rle with old method : 0.00048542022705078125 time for calcul the mask position with numpy : 0.006119251251220703 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.006102085113525391 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.00600123405456543 nb_pixel_total : 243 time to create 1 rle with old method : 0.0002799034118652344 time for calcul the mask position with numpy : 0.0060577392578125 nb_pixel_total : 313 time to create 1 rle with old method : 0.00038313865661621094 time for calcul the mask position with numpy : 0.005959272384643555 nb_pixel_total : 117 time to create 1 rle with old method : 0.00016379356384277344 time for calcul the mask position with numpy : 0.00586247444152832 nb_pixel_total : 274 time to create 1 rle with old method : 0.00034356117248535156 time for calcul the mask position with numpy : 0.0060765743255615234 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007522106170654297 time for calcul the mask position with numpy : 0.005889415740966797 nb_pixel_total : 36 time to create 1 rle with old method : 7.2479248046875e-05 time for calcul the mask position with numpy : 0.005896806716918945 nb_pixel_total : 1449 time to create 1 rle with old method : 0.0016565322875976562 time for calcul the mask position with numpy : 0.005701303482055664 nb_pixel_total : 314 time to create 1 rle with old method : 0.00040268898010253906 time for calcul the mask position with numpy : 0.005791187286376953 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004401206970214844 time for calcul the mask position with numpy : 0.006306886672973633 nb_pixel_total : 356 time to create 1 rle with old method : 0.00045990943908691406 time for calcul the mask position with numpy : 0.005842685699462891 nb_pixel_total : 133 time to create 1 rle with old method : 0.00017547607421875 time for calcul the mask position with numpy : 0.0057468414306640625 nb_pixel_total : 1449 time to create 1 rle with old method : 0.0017237663269042969 time for calcul the mask position with numpy : 0.006045818328857422 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003540515899658203 time for calcul the mask position with numpy : 0.00602412223815918 nb_pixel_total : 2821 time to create 1 rle with old method : 0.0032639503479003906 time for calcul the mask position with numpy : 0.005973339080810547 nb_pixel_total : 41 time to create 1 rle with old method : 8.940696716308594e-05 time for calcul the mask position with numpy : 0.005908489227294922 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005371570587158203 time for calcul the mask position with numpy : 0.0061359405517578125 nb_pixel_total : 220 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.006811380386352539 nb_pixel_total : 106247 time to create 1 rle with old method : 0.11512637138366699 time for calcul the mask position with numpy : 0.0062863826751708984 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005757808685302734 time for calcul the mask position with numpy : 0.0060749053955078125 nb_pixel_total : 58 time to create 1 rle with old method : 0.0001270771026611328 time for calcul the mask position with numpy : 0.00604701042175293 nb_pixel_total : 1363 time to create 1 rle with old method : 0.0016760826110839844 time for calcul the mask position with numpy : 0.005985736846923828 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005612373352050781 time for calcul the mask position with numpy : 0.006197929382324219 nb_pixel_total : 314 time to create 1 rle with old method : 0.0003809928894042969 time for calcul the mask position with numpy : 0.0060117244720458984 nb_pixel_total : 1259 time to create 1 rle with old method : 0.0015349388122558594 time for calcul the mask position with numpy : 0.0060307979583740234 nb_pixel_total : 15 time to create 1 rle with old method : 5.936622619628906e-05 time for calcul the mask position with numpy : 0.006012916564941406 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006818771362304688 time for calcul the mask position with numpy : 0.006190776824951172 nb_pixel_total : 31408 time to create 1 rle with old method : 0.03456854820251465 time for calcul the mask position with numpy : 0.005959987640380859 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002689361572265625 time for calcul the mask position with numpy : 0.0058155059814453125 nb_pixel_total : 388 time to create 1 rle with old method : 0.00044465065002441406 time for calcul the mask position with numpy : 0.006035566329956055 nb_pixel_total : 71 time to create 1 rle with old method : 0.00010609626770019531 time for calcul the mask position with numpy : 0.005941867828369141 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.005919694900512695 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005364418029785156 time for calcul the mask position with numpy : 0.005965232849121094 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002617835998535156 time for calcul the mask position with numpy : 0.0058879852294921875 nb_pixel_total : 247 time to create 1 rle with old method : 0.0002994537353515625 time for calcul the mask position with numpy : 0.006020545959472656 nb_pixel_total : 3249 time to create 1 rle with old method : 0.0036296844482421875 time for calcul the mask position with numpy : 0.0058116912841796875 nb_pixel_total : 12 time to create 1 rle with old method : 6.580352783203125e-05 time for calcul the mask position with numpy : 0.005819082260131836 nb_pixel_total : 1845 time to create 1 rle with old method : 0.002115488052368164 time for calcul the mask position with numpy : 0.005856513977050781 nb_pixel_total : 214 time to create 1 rle with old method : 0.00027823448181152344 time for calcul the mask position with numpy : 0.005858898162841797 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011730194091796875 time for calcul the mask position with numpy : 0.0057871341705322266 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006101131439208984 time for calcul the mask position with numpy : 0.005894899368286133 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005431175231933594 time for calcul the mask position with numpy : 0.006043910980224609 nb_pixel_total : 187 time to create 1 rle with old method : 0.00023889541625976562 time for calcul the mask position with numpy : 0.0060253143310546875 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.0060956478118896484 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005426406860351562 time for calcul the mask position with numpy : 0.0060236454010009766 nb_pixel_total : 381 time to create 1 rle with old method : 0.0004754066467285156 time for calcul the mask position with numpy : 0.005694389343261719 nb_pixel_total : 506 time to create 1 rle with old method : 0.0005893707275390625 time for calcul the mask position with numpy : 0.005979299545288086 nb_pixel_total : 909 time to create 1 rle with old method : 0.0011055469512939453 time for calcul the mask position with numpy : 0.006051301956176758 nb_pixel_total : 136 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.006002664566040039 nb_pixel_total : 2803 time to create 1 rle with old method : 0.0033652782440185547 time for calcul the mask position with numpy : 0.0060579776763916016 nb_pixel_total : 672 time to create 1 rle with old method : 0.0008387565612792969 time for calcul the mask position with numpy : 0.0058934688568115234 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003745555877685547 time for calcul the mask position with numpy : 0.006136417388916016 nb_pixel_total : 10 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.005978584289550781 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004451274871826172 time for calcul the mask position with numpy : 0.00633549690246582 nb_pixel_total : 36 time to create 1 rle with old method : 6.67572021484375e-05 time for calcul the mask position with numpy : 0.00626826286315918 nb_pixel_total : 263 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.006140470504760742 nb_pixel_total : 330 time to create 1 rle with old method : 0.00040721893310546875 time for calcul the mask position with numpy : 0.0063934326171875 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006902217864990234 time for calcul the mask position with numpy : 0.006075859069824219 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006520748138427734 time for calcul the mask position with numpy : 0.005987405776977539 nb_pixel_total : 3975 time to create 1 rle with old method : 0.004669189453125 time for calcul the mask position with numpy : 0.0059947967529296875 nb_pixel_total : 866 time to create 1 rle with old method : 0.0009953975677490234 time for calcul the mask position with numpy : 0.006097555160522461 nb_pixel_total : 278 time to create 1 rle with old method : 0.00031566619873046875 time for calcul the mask position with numpy : 0.006436824798583984 nb_pixel_total : 203 time to create 1 rle with old method : 0.0003204345703125 time for calcul the mask position with numpy : 0.005969047546386719 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002551078796386719 time for calcul the mask position with numpy : 0.008257389068603516 nb_pixel_total : 78 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.00820779800415039 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002658367156982422 time for calcul the mask position with numpy : 0.00824427604675293 nb_pixel_total : 390 time to create 1 rle with old method : 0.00046634674072265625 time for calcul the mask position with numpy : 0.008146286010742188 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001239776611328125 time for calcul the mask position with numpy : 0.008314132690429688 nb_pixel_total : 17 time to create 1 rle with old method : 3.9577484130859375e-05 time for calcul the mask position with numpy : 0.008152008056640625 nb_pixel_total : 12 time to create 1 rle with old method : 3.647804260253906e-05 time for calcul the mask position with numpy : 0.008265256881713867 nb_pixel_total : 323 time to create 1 rle with old method : 0.000377655029296875 time for calcul the mask position with numpy : 0.008028268814086914 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003390312194824219 time for calcul the mask position with numpy : 0.00810384750366211 nb_pixel_total : 74 time to create 1 rle with old method : 9.441375732421875e-05 time for calcul the mask position with numpy : 0.00821065902709961 nb_pixel_total : 203 time to create 1 rle with old method : 0.00023365020751953125 time for calcul the mask position with numpy : 0.00820016860961914 nb_pixel_total : 7 time to create 1 rle with old method : 2.4318695068359375e-05 time for calcul the mask position with numpy : 0.008149147033691406 nb_pixel_total : 118 time to create 1 rle with old method : 0.00013709068298339844 time for calcul the mask position with numpy : 0.008038520812988281 nb_pixel_total : 60 time to create 1 rle with old method : 7.867813110351562e-05 create new chi : 1.5409510135650635 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016927719116210938 batch 1 Loaded 154 chid ids of type : 4230 Number RLEs to save : 13018 TO DO : save crop sub photo not yet done ! save time : 1.0074729919433594 nb_obj : 138 nb_hashtags : 6 time to prepare the origin masks : 1.4318995475769043 time for calcul the mask position with numpy : 0.02146124839782715 nb_pixel_total : 1839261 time to create 1 rle with new method : 0.0361936092376709 time for calcul the mask position with numpy : 0.011136770248413086 nb_pixel_total : 4260 time to create 1 rle with old method : 0.005189180374145508 time for calcul the mask position with numpy : 0.010712385177612305 nb_pixel_total : 25740 time to create 1 rle with old method : 0.0325312614440918 time for calcul the mask position with numpy : 0.0064449310302734375 nb_pixel_total : 1397 time to create 1 rle with old method : 0.001720428466796875 time for calcul the mask position with numpy : 0.0065004825592041016 nb_pixel_total : 127 time to create 1 rle with old method : 0.00030112266540527344 time for calcul the mask position with numpy : 0.006481170654296875 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004277229309082031 time for calcul the mask position with numpy : 0.006073713302612305 nb_pixel_total : 1757 time to create 1 rle with old method : 0.002076387405395508 time for calcul the mask position with numpy : 0.00632929801940918 nb_pixel_total : 13580 time to create 1 rle with old method : 0.016052722930908203 time for calcul the mask position with numpy : 0.006413936614990234 nb_pixel_total : 149 time to create 1 rle with old method : 0.00019812583923339844 time for calcul the mask position with numpy : 0.006228208541870117 nb_pixel_total : 1926 time to create 1 rle with old method : 0.0024094581604003906 time for calcul the mask position with numpy : 0.0065021514892578125 nb_pixel_total : 183 time to create 1 rle with old method : 0.00023746490478515625 time for calcul the mask position with numpy : 0.006760835647583008 nb_pixel_total : 894 time to create 1 rle with old method : 0.0010972023010253906 time for calcul the mask position with numpy : 0.006922006607055664 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002655982971191406 time for calcul the mask position with numpy : 0.0068511962890625 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001785755157470703 time for calcul the mask position with numpy : 0.006409645080566406 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005002021789550781 time for calcul the mask position with numpy : 0.0063626766204833984 nb_pixel_total : 1059 time to create 1 rle with old method : 0.0013115406036376953 time for calcul the mask position with numpy : 0.006151914596557617 nb_pixel_total : 197 time to create 1 rle with old method : 0.00025725364685058594 time for calcul the mask position with numpy : 0.0061109066009521484 nb_pixel_total : 32 time to create 1 rle with old method : 8.511543273925781e-05 time for calcul the mask position with numpy : 0.006089210510253906 nb_pixel_total : 32 time to create 1 rle with old method : 5.984306335449219e-05 time for calcul the mask position with numpy : 0.006762027740478516 nb_pixel_total : 56905 time to create 1 rle with old method : 0.06490349769592285 time for calcul the mask position with numpy : 0.0064487457275390625 nb_pixel_total : 27 time to create 1 rle with old method : 5.435943603515625e-05 time for calcul the mask position with numpy : 0.006200313568115234 nb_pixel_total : 21 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.006254434585571289 nb_pixel_total : 312 time to create 1 rle with old method : 0.0003917217254638672 time for calcul the mask position with numpy : 0.006276369094848633 nb_pixel_total : 21 time to create 1 rle with old method : 6.151199340820312e-05 time for calcul the mask position with numpy : 0.0060498714447021484 nb_pixel_total : 2281 time to create 1 rle with old method : 0.0026252269744873047 time for calcul the mask position with numpy : 0.0068569183349609375 nb_pixel_total : 1608 time to create 1 rle with old method : 0.0019333362579345703 time for calcul the mask position with numpy : 0.006842851638793945 nb_pixel_total : 110 time to create 1 rle with old method : 0.00017189979553222656 time for calcul the mask position with numpy : 0.007054567337036133 nb_pixel_total : 3430 time to create 1 rle with old method : 0.00412750244140625 time for calcul the mask position with numpy : 0.006360530853271484 nb_pixel_total : 116 time to create 1 rle with old method : 0.00016450881958007812 time for calcul the mask position with numpy : 0.006267070770263672 nb_pixel_total : 2779 time to create 1 rle with old method : 0.003385305404663086 time for calcul the mask position with numpy : 0.006190299987792969 nb_pixel_total : 284 time to create 1 rle with old method : 0.00037169456481933594 time for calcul the mask position with numpy : 0.006201028823852539 nb_pixel_total : 1245 time to create 1 rle with old method : 0.0015141963958740234 time for calcul the mask position with numpy : 0.006870746612548828 nb_pixel_total : 2588 time to create 1 rle with old method : 0.003099203109741211 time for calcul the mask position with numpy : 0.0059967041015625 nb_pixel_total : 588 time to create 1 rle with old method : 0.000713348388671875 time for calcul the mask position with numpy : 0.006201267242431641 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006451606750488281 time for calcul the mask position with numpy : 0.006524324417114258 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005927085876464844 time for calcul the mask position with numpy : 0.0061686038970947266 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0016987323760986328 time for calcul the mask position with numpy : 0.006159305572509766 nb_pixel_total : 6674 time to create 1 rle with old method : 0.007969856262207031 time for calcul the mask position with numpy : 0.00616455078125 nb_pixel_total : 3093 time to create 1 rle with old method : 0.0037016868591308594 time for calcul the mask position with numpy : 0.0066070556640625 nb_pixel_total : 528 time to create 1 rle with old method : 0.0007991790771484375 time for calcul the mask position with numpy : 0.0061457157135009766 nb_pixel_total : 2719 time to create 1 rle with old method : 0.0032689571380615234 time for calcul the mask position with numpy : 0.006345510482788086 nb_pixel_total : 3413 time to create 1 rle with old method : 0.0039348602294921875 time for calcul the mask position with numpy : 0.006314516067504883 nb_pixel_total : 220 time to create 1 rle with old method : 0.00031757354736328125 time for calcul the mask position with numpy : 0.0062406063079833984 nb_pixel_total : 735 time to create 1 rle with old method : 0.0008642673492431641 time for calcul the mask position with numpy : 0.010141134262084961 nb_pixel_total : 1201 time to create 1 rle with old method : 0.0014367103576660156 time for calcul the mask position with numpy : 0.010147571563720703 nb_pixel_total : 8062 time to create 1 rle with old method : 0.009075403213500977 time for calcul the mask position with numpy : 0.011266946792602539 nb_pixel_total : 200 time to create 1 rle with old method : 0.00028061866760253906 time for calcul the mask position with numpy : 0.010304450988769531 nb_pixel_total : 245 time to create 1 rle with old method : 0.00031185150146484375 time for calcul the mask position with numpy : 0.010320901870727539 nb_pixel_total : 678 time to create 1 rle with old method : 0.0008130073547363281 time for calcul the mask position with numpy : 0.010230064392089844 nb_pixel_total : 90 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.010050773620605469 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009751319885253906 time for calcul the mask position with numpy : 0.010139942169189453 nb_pixel_total : 41 time to create 1 rle with old method : 0.0001068115234375 time for calcul the mask position with numpy : 0.010833024978637695 nb_pixel_total : 4181 time to create 1 rle with old method : 0.00475001335144043 time for calcul the mask position with numpy : 0.011175870895385742 nb_pixel_total : 109 time to create 1 rle with old method : 0.00015091896057128906 time for calcul the mask position with numpy : 0.010237932205200195 nb_pixel_total : 150 time to create 1 rle with old method : 0.00020599365234375 time for calcul the mask position with numpy : 0.010623455047607422 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004162788391113281 time for calcul the mask position with numpy : 0.010558605194091797 nb_pixel_total : 2142 time to create 1 rle with old method : 0.0025691986083984375 time for calcul the mask position with numpy : 0.011210918426513672 nb_pixel_total : 45 time to create 1 rle with old method : 8.20159912109375e-05 time for calcul the mask position with numpy : 0.007930994033813477 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006284713745117188 time for calcul the mask position with numpy : 0.007105112075805664 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.006427764892578125 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006470680236816406 time for calcul the mask position with numpy : 0.0063402652740478516 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003998279571533203 time for calcul the mask position with numpy : 0.006768941879272461 nb_pixel_total : 575 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.0062367916107177734 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006744861602783203 time for calcul the mask position with numpy : 0.006311655044555664 nb_pixel_total : 34 time to create 1 rle with old method : 6.937980651855469e-05 time for calcul the mask position with numpy : 0.007081031799316406 nb_pixel_total : 1124 time to create 1 rle with old method : 0.0014262199401855469 time for calcul the mask position with numpy : 0.006595134735107422 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005002021789550781 time for calcul the mask position with numpy : 0.006551265716552734 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003178119659423828 time for calcul the mask position with numpy : 0.006452322006225586 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004677772521972656 time for calcul the mask position with numpy : 0.0063440799713134766 nb_pixel_total : 125 time to create 1 rle with old method : 0.00017261505126953125 time for calcul the mask position with numpy : 0.006330251693725586 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003542900085449219 time for calcul the mask position with numpy : 0.00644373893737793 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006730556488037109 time for calcul the mask position with numpy : 0.006520509719848633 nb_pixel_total : 1620 time to create 1 rle with old method : 0.002002716064453125 time for calcul the mask position with numpy : 0.006239414215087891 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004551410675048828 time for calcul the mask position with numpy : 0.006811618804931641 nb_pixel_total : 5 time to create 1 rle with old method : 3.7670135498046875e-05 time for calcul the mask position with numpy : 0.006275653839111328 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0014963150024414062 time for calcul the mask position with numpy : 0.006335258483886719 nb_pixel_total : 138 time to create 1 rle with old method : 0.00017762184143066406 time for calcul the mask position with numpy : 0.00616002082824707 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006437301635742188 time for calcul the mask position with numpy : 0.006182432174682617 nb_pixel_total : 206 time to create 1 rle with old method : 0.00026702880859375 time for calcul the mask position with numpy : 0.00616765022277832 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005061626434326172 time for calcul the mask position with numpy : 0.0061533451080322266 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005717277526855469 time for calcul the mask position with numpy : 0.006178617477416992 nb_pixel_total : 1324 time to create 1 rle with old method : 0.0015964508056640625 time for calcul the mask position with numpy : 0.00618433952331543 nb_pixel_total : 12 time to create 1 rle with old method : 6.890296936035156e-05 time for calcul the mask position with numpy : 0.006785869598388672 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005595684051513672 time for calcul the mask position with numpy : 0.006335735321044922 nb_pixel_total : 319 time to create 1 rle with old method : 0.0004448890686035156 time for calcul the mask position with numpy : 0.006544351577758789 nb_pixel_total : 34834 time to create 1 rle with old method : 0.03920388221740723 time for calcul the mask position with numpy : 0.006586790084838867 nb_pixel_total : 1322 time to create 1 rle with old method : 0.0015540122985839844 time for calcul the mask position with numpy : 0.0063135623931884766 nb_pixel_total : 547 time to create 1 rle with old method : 0.00067901611328125 time for calcul the mask position with numpy : 0.006342649459838867 nb_pixel_total : 164 time to create 1 rle with old method : 0.00023627281188964844 time for calcul the mask position with numpy : 0.006913661956787109 nb_pixel_total : 184 time to create 1 rle with old method : 0.0002472400665283203 time for calcul the mask position with numpy : 0.006212949752807617 nb_pixel_total : 366 time to create 1 rle with old method : 0.00045990943908691406 time for calcul the mask position with numpy : 0.006218910217285156 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003402233123779297 time for calcul the mask position with numpy : 0.006285667419433594 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005366802215576172 time for calcul the mask position with numpy : 0.006118297576904297 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003490447998046875 time for calcul the mask position with numpy : 0.006125926971435547 nb_pixel_total : 198 time to create 1 rle with old method : 0.00025272369384765625 time for calcul the mask position with numpy : 0.0064356327056884766 nb_pixel_total : 3173 time to create 1 rle with old method : 0.00382232666015625 time for calcul the mask position with numpy : 0.006349325180053711 nb_pixel_total : 1911 time to create 1 rle with old method : 0.0023276805877685547 time for calcul the mask position with numpy : 0.006697177886962891 nb_pixel_total : 217 time to create 1 rle with old method : 0.0003192424774169922 time for calcul the mask position with numpy : 0.006997108459472656 nb_pixel_total : 222 time to create 1 rle with old method : 0.000286102294921875 time for calcul the mask position with numpy : 0.006285905838012695 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003342628479003906 time for calcul the mask position with numpy : 0.00633549690246582 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005791187286376953 time for calcul the mask position with numpy : 0.006386280059814453 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005533695220947266 time for calcul the mask position with numpy : 0.00635981559753418 nb_pixel_total : 14 time to create 1 rle with old method : 4.0531158447265625e-05 time for calcul the mask position with numpy : 0.006350517272949219 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002849102020263672 time for calcul the mask position with numpy : 0.006963253021240234 nb_pixel_total : 16 time to create 1 rle with old method : 5.054473876953125e-05 time for calcul the mask position with numpy : 0.00660252571105957 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002644062042236328 time for calcul the mask position with numpy : 0.006773948669433594 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005202293395996094 time for calcul the mask position with numpy : 0.007110118865966797 nb_pixel_total : 368 time to create 1 rle with old method : 0.000457763671875 time for calcul the mask position with numpy : 0.006348133087158203 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005881786346435547 time for calcul the mask position with numpy : 0.006336688995361328 nb_pixel_total : 44 time to create 1 rle with old method : 7.677078247070312e-05 time for calcul the mask position with numpy : 0.0063707828521728516 nb_pixel_total : 209 time to create 1 rle with old method : 0.00025177001953125 time for calcul the mask position with numpy : 0.006367206573486328 nb_pixel_total : 63 time to create 1 rle with old method : 0.0001361370086669922 time for calcul the mask position with numpy : 0.006203413009643555 nb_pixel_total : 2892 time to create 1 rle with old method : 0.0034971237182617188 time for calcul the mask position with numpy : 0.006808042526245117 nb_pixel_total : 75 time to create 1 rle with old method : 0.0001285076141357422 time for calcul the mask position with numpy : 0.006441593170166016 nb_pixel_total : 258 time to create 1 rle with old method : 0.000316619873046875 time for calcul the mask position with numpy : 0.006570100784301758 nb_pixel_total : 1450 time to create 1 rle with old method : 0.0017409324645996094 time for calcul the mask position with numpy : 0.006127834320068359 nb_pixel_total : 4 time to create 1 rle with old method : 2.7179718017578125e-05 time for calcul the mask position with numpy : 0.006220579147338867 nb_pixel_total : 387 time to create 1 rle with old method : 0.00048542022705078125 time for calcul the mask position with numpy : 0.006285190582275391 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.006441593170166016 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001513957977294922 time for calcul the mask position with numpy : 0.006212949752807617 nb_pixel_total : 15 time to create 1 rle with old method : 4.100799560546875e-05 time for calcul the mask position with numpy : 0.0062181949615478516 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0015974044799804688 time for calcul the mask position with numpy : 0.00676727294921875 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006358623504638672 time for calcul the mask position with numpy : 0.006354570388793945 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003082752227783203 time for calcul the mask position with numpy : 0.006875276565551758 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003685951232910156 time for calcul the mask position with numpy : 0.006185054779052734 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0014188289642333984 time for calcul the mask position with numpy : 0.006192684173583984 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001506805419921875 time for calcul the mask position with numpy : 0.006336688995361328 nb_pixel_total : 689 time to create 1 rle with old method : 0.0008704662322998047 time for calcul the mask position with numpy : 0.00613093376159668 nb_pixel_total : 9 time to create 1 rle with old method : 3.457069396972656e-05 time for calcul the mask position with numpy : 0.006205320358276367 nb_pixel_total : 98 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.006186008453369141 nb_pixel_total : 356 time to create 1 rle with old method : 0.00043320655822753906 time for calcul the mask position with numpy : 0.006795644760131836 nb_pixel_total : 42 time to create 1 rle with old method : 9.1552734375e-05 time for calcul the mask position with numpy : 0.006388664245605469 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004189014434814453 time for calcul the mask position with numpy : 0.006575822830200195 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004124641418457031 time for calcul the mask position with numpy : 0.00621485710144043 nb_pixel_total : 57 time to create 1 rle with old method : 8.559226989746094e-05 time for calcul the mask position with numpy : 0.0061740875244140625 nb_pixel_total : 195 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.0061779022216796875 nb_pixel_total : 105 time to create 1 rle with old method : 0.00014448165893554688 time for calcul the mask position with numpy : 0.0064241886138916016 nb_pixel_total : 37 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.00691676139831543 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011658668518066406 create new chi : 1.2947735786437988 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016300678253173828 batch 1 Loaded 139 chid ids of type : 4230 Number RLEs to save : 12609 TO DO : save crop sub photo not yet done ! save time : 0.8082637786865234 map_output_result : {1335873097: (0.0, 'Should be the crop_list due to order', 0.0), 1335872919: (0.0, 'Should be the crop_list due to order', 0.0), 1335872903: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1335873097, 1335872919, 1335872903] Looping around the photos to save general results len do output : 3 /1335873097.Didn't retrieve data . /1335872919.Didn't retrieve data . /1335872903.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335873097', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872919', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872903', None, None, None, None, None, '2568975') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.017119884490966797 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.584657192230225 time spend to save output : 0.017480850219726562 total time spend for step 4 : 12.602138042449951 step5:crop_condition Sat Feb 8 16:21:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 433 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 152 About to insert : list_path_to_insert length 152 new photo from crops ! About to upload 152 photos upload in portfolio : 4869462 init cache_photo without model_param we have 152 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739028076_356560 we have uploaded 152 photos in the portfolio 4869462 time of upload the photos Elapsed time : 32.35843849182129 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 64 About to insert : list_path_to_insert length 64 new photo from crops ! About to upload 64 photos upload in portfolio : 4869462 init cache_photo without model_param we have 64 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739028109_356560 we have uploaded 64 photos in the portfolio 4869462 time of upload the photos Elapsed time : 17.67698907852173 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 4869462 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739028127_356560 we have uploaded 7 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.8059561252593994 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 59 About to insert : list_path_to_insert length 59 new photo from crops ! About to upload 59 photos upload in portfolio : 4869462 init cache_photo without model_param we have 59 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739028130_356560 we have uploaded 59 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.821168422698975 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739028143_356560 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7129204273223877 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1335873097, 1335872919, 1335872903] Looping around the photos to save general results len do output : 284 /1335882217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335882789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335873097', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872919', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872903', None, None, None, None, None, '2568975') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 855 time used for this insertion : 0.04788851737976074 save_final save missing photos in datou_result : time spend for datou_step_exec : 70.18290281295776 time spend to save output : 0.11690354347229004 total time spend for step 5 : 70.29980635643005 step6:thcl Sat Feb 8 16:22:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.002349853515625 time to convert the images to numpy array : 0.015869617462158203 time to import caffe and check if the image exist : 0.045250892639160156 time to convert the images to numpy array : 0.021410703659057617 time to import caffe and check if the image exist : 0.020898818969726562 time to convert the images to numpy array : 0.05113387107849121 time to import caffe and check if the image exist : 0.00892019271850586 time to convert the images to numpy array : 0.07435345649719238 time to import caffe and check if the image exist : 0.0385289192199707 time to convert the images to numpy array : 0.05566143989562988 time to import caffe and check if the image exist : 0.03080296516418457 time to convert the images to numpy array : 0.06637072563171387 time to import caffe and check if the image exist : 0.07525777816772461 time to convert the images to numpy array : 0.03734612464904785 time to import caffe and check if the image exist : 0.0936744213104248 time to convert the images to numpy array : 0.027032852172851562 time to import caffe and check if the image exist : 0.07420706748962402 time to convert the images to numpy array : 0.047519683837890625 time to import caffe and check if the image exist : 0.09043169021606445 time to convert the images to numpy array : 0.03146505355834961 total time to convert the images to numpy array : 0.5131473541259766 list photo_ids error: [] list photo_ids correct : [1335882298, 1335882299, 1335882300, 1335882301, 1335882302, 1335882303, 1335882304, 1335882305, 1335882306, 1335882308, 1335882309, 1335882310, 1335882311, 1335882313, 1335882314, 1335882315, 1335882316, 1335882317, 1335882318, 1335882319, 1335882320, 1335882321, 1335882322, 1335882323, 1335882324, 1335882325, 1335882326, 1335882327, 1335882328, 1335882728, 1335882730, 1335882732, 1335882734, 1335882736, 1335882738, 1335882740, 1335882742, 1335882744, 1335882746, 1335882748, 1335882750, 1335882752, 1335882754, 1335882756, 1335882758, 1335882760, 1335882762, 1335882764, 1335882766, 1335882768, 1335882787, 1335882789, 1335882669, 1335882671, 1335882673, 1335882675, 1335882678, 1335882680, 1335882682, 1335882684, 1335882686, 1335882688, 1335882690, 1335882692, 1335882694, 1335882696, 1335882698, 1335882700, 1335882702, 1335882704, 1335882706, 1335882708, 1335882710, 1335882712, 1335882714, 1335882716, 1335882718, 1335882720, 1335882722, 1335882724, 1335882726, 1335882331, 1335882335, 1335882339, 1335882342, 1335882345, 1335882349, 1335882353, 1335882357, 1335882360, 1335882364, 1335882368, 1335882372, 1335882375, 1335882379, 1335882384, 1335882388, 1335882392, 1335882395, 1335882399, 1335882403, 1335882405, 1335882406, 1335882407, 1335882408, 1335882409, 1335882410, 1335882411, 1335882412, 1335882413, 1335882493, 1335882494, 1335882495, 1335882496, 1335882497, 1335882498, 1335882499, 1335882500, 1335882501, 1335882502, 1335882503, 1335882504, 1335882505, 1335882506, 1335882507, 1335882508, 1335882509, 1335882510, 1335882511, 1335882512, 1335882513, 1335882514, 1335882515, 1335882516, 1335882517, 1335882518, 1335882519, 1335882520, 1335882521, 1335882443, 1335882444, 1335882445, 1335882446, 1335882447, 1335882448, 1335882450, 1335882471, 1335882472, 1335882473, 1335882474, 1335882475, 1335882476, 1335882477, 1335882478, 1335882479, 1335882480, 1335882481, 1335882482, 1335882483, 1335882484, 1335882485, 1335882486, 1335882487, 1335882488, 1335882489, 1335882490, 1335882491, 1335882492, 1335882217, 1335882218, 1335882219, 1335882220, 1335882221, 1335882222, 1335882223, 1335882224, 1335882225, 1335882226, 1335882227, 1335882228, 1335882229, 1335882230, 1335882231, 1335882232, 1335882233, 1335882234, 1335882235, 1335882236, 1335882237, 1335882238, 1335882239, 1335882240, 1335882242, 1335882244, 1335882245, 1335882246, 1335882248, 1335882522, 1335882523, 1335882524, 1335882525, 1335882526, 1335882527, 1335882528, 1335882529, 1335882530, 1335882531, 1335882532, 1335882533, 1335882534, 1335882536, 1335882537, 1335882538, 1335882540, 1335882541, 1335882542, 1335882543, 1335882651, 1335882653, 1335882655, 1335882657, 1335882659, 1335882661, 1335882663, 1335882665, 1335882667, 1335882249, 1335882253, 1335882256, 1335882259, 1335882263, 1335882267, 1335882271, 1335882275, 1335882277, 1335882278, 1335882279, 1335882280, 1335882281, 1335882282, 1335882283, 1335882284, 1335882285, 1335882286, 1335882287, 1335882288, 1335882289, 1335882290, 1335882291, 1335882292, 1335882293, 1335882294, 1335882295, 1335882296, 1335882297, 1335882414, 1335882415, 1335882416, 1335882417, 1335882418, 1335882419, 1335882420, 1335882421, 1335882422, 1335882423, 1335882424, 1335882425, 1335882426, 1335882427, 1335882428, 1335882429, 1335882430, 1335882431, 1335882432, 1335882433, 1335882434, 1335882435, 1335882436, 1335882437, 1335882438, 1335882439, 1335882440, 1335882441, 1335882442] number of photos to traite : 284 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5706 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5487 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.4555375576019287 time used to do the prediction : 1.049952745437622 save descriptor for thcl : 3237 time to traite the descriptors : 1.6816051006317139 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1335882298 To insert : 1335882299 To insert : 1335882300 To insert : 1335882301 To insert : 1335882302 To insert : 1335882303 To insert : 1335882304 To insert : 1335882305 To insert : 1335882306 To insert : 1335882308 To insert : 1335882309 To insert : 1335882310 To insert : 1335882311 To insert : 1335882313 To insert : 1335882314 To insert : 1335882315 To insert : 1335882316 To insert : 1335882317 To insert : 1335882318 To insert : 1335882319 To insert : 1335882320 To insert : 1335882321 To insert : 1335882322 To insert : 1335882323 To insert : 1335882324 To insert : 1335882325 To insert : 1335882326 To insert : 1335882327 To insert : 1335882328 To insert : 1335882728 To insert : 1335882730 To insert : 1335882732 To insert : 1335882734 To insert : 1335882736 To insert : 1335882738 To insert : 1335882740 To insert : 1335882742 To insert : 1335882744 To insert : 1335882746 To insert : 1335882748 To insert : 1335882750 To insert : 1335882752 To insert : 1335882754 To insert : 1335882756 To insert : 1335882758 To insert : 1335882760 To insert : 1335882762 To insert : 1335882764 To insert : 1335882766 To insert : 1335882768 To insert : 1335882787 To insert : 1335882789 To insert : 1335882669 To insert : 1335882671 To insert : 1335882673 To insert : 1335882675 To insert : 1335882678 To insert : 1335882680 To insert : 1335882682 To insert : 1335882684 To insert : 1335882686 To insert : 1335882688 To insert : 1335882690 To insert : 1335882692 To insert : 1335882694 To insert : 1335882696 To insert : 1335882698 To insert : 1335882700 To insert : 1335882702 To insert : 1335882704 To insert : 1335882706 To insert : 1335882708 To insert : 1335882710 To insert : 1335882712 To insert : 1335882714 To insert : 1335882716 To insert : 1335882718 To insert : 1335882720 To insert : 1335882722 To insert : 1335882724 To insert : 1335882726 To insert : 1335882331 To insert : 1335882335 To insert : 1335882339 To insert : 1335882342 To insert : 1335882345 To insert : 1335882349 To insert : 1335882353 To insert : 1335882357 To insert : 1335882360 To insert : 1335882364 To insert : 1335882368 To insert : 1335882372 To insert : 1335882375 To insert : 1335882379 To insert : 1335882384 To insert : 1335882388 To insert : 1335882392 To insert : 1335882395 To insert : 1335882399 To insert : 1335882403 To insert : 1335882405 To insert : 1335882406 To insert : 1335882407 To insert : 1335882408 To insert : 1335882409 To insert : 1335882410 To insert : 1335882411 To insert : 1335882412 To insert : 1335882413 To insert : 1335882493 To insert : 1335882494 To insert : 1335882495 To insert : 1335882496 To insert : 1335882497 To insert : 1335882498 To insert : 1335882499 To insert : 1335882500 To insert : 1335882501 To insert : 1335882502 To insert : 1335882503 To insert : 1335882504 To insert : 1335882505 To insert : 1335882506 To insert : 1335882507 To insert : 1335882508 To insert : 1335882509 To insert : 1335882510 To insert : 1335882511 To insert : 1335882512 To insert : 1335882513 To insert : 1335882514 To insert : 1335882515 To insert : 1335882516 To insert : 1335882517 To insert : 1335882518 To insert : 1335882519 To insert : 1335882520 To insert : 1335882521 To insert : 1335882443 To insert : 1335882444 To insert : 1335882445 To insert : 1335882446 To insert : 1335882447 To insert : 1335882448 To insert : 1335882450 To insert : 1335882471 To insert : 1335882472 To insert : 1335882473 To insert : 1335882474 To insert : 1335882475 To insert : 1335882476 To insert : 1335882477 To insert : 1335882478 To insert : 1335882479 To insert : 1335882480 To insert : 1335882481 To insert : 1335882482 To insert : 1335882483 To insert : 1335882484 To insert : 1335882485 To insert : 1335882486 To insert : 1335882487 To insert : 1335882488 To insert : 1335882489 To insert : 1335882490 To insert : 1335882491 To insert : 1335882492 To insert : 1335882217 To insert : 1335882218 To insert : 1335882219 To insert : 1335882220 To insert : 1335882221 To insert : 1335882222 To insert : 1335882223 To insert : 1335882224 To insert : 1335882225 To insert : 1335882226 To insert : 1335882227 To insert : 1335882228 To insert : 1335882229 To insert : 1335882230 To insert : 1335882231 To insert : 1335882232 To insert : 1335882233 To insert : 1335882234 To insert : 1335882235 To insert : 1335882236 To insert : 1335882237 To insert : 1335882238 To insert : 1335882239 To insert : 1335882240 To insert : 1335882242 To insert : 1335882244 To insert : 1335882245 To insert : 1335882246 To insert : 1335882248 To insert : 1335882522 To insert : 1335882523 To insert : 1335882524 To insert : 1335882525 To insert : 1335882526 To insert : 1335882527 To insert : 1335882528 To insert : 1335882529 To insert : 1335882530 To insert : 1335882531 To insert : 1335882532 To insert : 1335882533 To insert : 1335882534 To insert : 1335882536 To insert : 1335882537 To insert : 1335882538 To insert : 1335882540 To insert : 1335882541 To insert : 1335882542 To insert : 1335882543 To insert : 1335882651 To insert : 1335882653 To insert : 1335882655 To insert : 1335882657 To insert : 1335882659 To insert : 1335882661 To insert : 1335882663 To insert : 1335882665 To insert : 1335882667 To insert : 1335882249 To insert : 1335882253 To insert : 1335882256 To insert : 1335882259 To insert : 1335882263 To insert : 1335882267 To insert : 1335882271 To insert : 1335882275 To insert : 1335882277 To insert : 1335882278 To insert : 1335882279 To insert : 1335882280 To insert : 1335882281 To insert : 1335882282 To insert : 1335882283 To insert : 1335882284 To insert : 1335882285 To insert : 1335882286 To insert : 1335882287 To insert : 1335882288 To insert : 1335882289 To insert : 1335882290 To insert : 1335882291 To insert : 1335882292 To insert : 1335882293 To insert : 1335882294 To insert : 1335882295 To insert : 1335882296 To insert : 1335882297 To insert : 1335882414 To insert : 1335882415 To insert : 1335882416 To insert : 1335882417 To insert : 1335882418 To insert : 1335882419 To insert : 1335882420 To insert : 1335882421 To insert : 1335882422 To insert : 1335882423 To insert : 1335882424 To insert : 1335882425 To insert : 1335882426 To insert : 1335882427 To insert : 1335882428 To insert : 1335882429 To insert : 1335882430 To insert : 1335882431 To insert : 1335882432 To insert : 1335882433 To insert : 1335882434 To insert : 1335882435 To insert : 1335882436 To insert : 1335882437 To insert : 1335882438 To insert : 1335882439 To insert : 1335882440 To insert : 1335882441 To insert : 1335882442 time to insert the descriptors : 48.61765933036804 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 425 time used for this insertion : 0.034087419509887695 save missing photos in datou_result : time spend for datou_step_exec : 57.351593017578125 time spend to save output : 0.0857551097869873 total time spend for step 6 : 57.43734812736511 step7:ventilate_hashtags_in_portfolio Sat Feb 8 16:23:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20362230 get user id for portfolio 20362230 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362230 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','PET_clair','refus','flou','PET_fonce','environnement','mal_croppe','carton','Papier','Carton','autre','Tetrapak','pet_fonce','PEHD','Film_plastique','pet_clair','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362230 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','PET_clair','refus','flou','PET_fonce','environnement','mal_croppe','carton','Papier','Carton','autre','Tetrapak','pet_fonce','PEHD','Film_plastique','pet_clair','papier')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362230 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','PET_clair','refus','flou','PET_fonce','environnement','mal_croppe','carton','Papier','Carton','autre','Tetrapak','pet_fonce','PEHD','Film_plastique','pet_clair','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362230 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','PET_clair','refus','flou','PET_fonce','environnement','mal_croppe','carton','Papier','Carton','autre','Tetrapak','pet_fonce','PEHD','Film_plastique','pet_clair','papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20362410,20362424,20362426,20362413,20362414,20362423,20362416,20362417,20362420,20362427,20362421,20362422,20362425?tags=metal,pehd,pet_clair,refus,flou,pet_fonce,environnement,mal_croppe,carton,papier,autre,tetrapak,film_plastique&datou_id_consolidate=4235&port_consolidate=20362230 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1335873097, 1335872919, 1335872903] Looping around the photos to save general results len do output : 1 /20362230. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335873097', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872919', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872903', None, None, None, None, None, '2568975') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012782573699951172 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.803612470626831 time spend to save output : 0.013095378875732422 total time spend for step 7 : 5.8167078495025635 step8:final Sat Feb 8 16:23:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1335873097: ('0.25971977410426256',), 1335872919: ('0.25971977410426256',), 1335872903: ('0.25971977410426256',)} new output for save of step final : {1335873097: ('0.25971977410426256',), 1335872919: ('0.25971977410426256',), 1335872903: ('0.25971977410426256',)} [1335873097, 1335872919, 1335872903] Looping around the photos to save general results len do output : 3 /1335873097.Didn't retrieve data . /1335872919.Didn't retrieve data . /1335872903.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335873097', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872919', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872903', None, None, None, None, None, '2568975') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012833356857299805 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11483120918273926 time spend to save output : 0.01308584213256836 total time spend for step 8 : 0.12791705131530762 step9:velours_tree Sat Feb 8 16:23:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20362410,20362424,20362426,20362413,20362414,20362423,20362416,20362417,20362420,20362427,20362421,20362422,20362425 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362410 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362424 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362426 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362413 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362414 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362423 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362416 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362417 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362420 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362427 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362421 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362422 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362425 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 284 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 0 3 1 0 1 0 0 0 1 3 4 4 4 4 0 3 4 0 2 2 3 3 4 4 1 4 3 3 0 3 0 4 0 3 3 3 3 0 0 3 0 3 0 0 0 2 3 0 3 3 1 0 0 0 2 0 0 1 3 4 4 4 4 4 3 0 1 4 0 0 2 1 2 3 4 0 0 4 3 3 3 3 0 3 1 3 3 2 3 0 3 0 0 4 3 1 0 3 0 3 3 2 3 0 3 1 0 0 0 1 0 1 0 1 3 4 4 4 4 4 1 0 3 4 0 3 2 2 4 3 0 0 4 4 3 4 3 0 4 2 3 3 2 3 3 0 2 3 3 3 3 0 1 3 3 2 4 1 1 3 4 4 3 3 3 1 2 3 1 1 3 1 1 1 3 0 3 3 2 1 1 3 3 4 4 3 2 3 3 0 3 1 3 4 1 4 1 3 5 3 3 3 1 4 4 0 0 3 4 1 3 2 4 1 3 4 1 4 0 1 4 4 5 0 0 0 4 2 2 2 4 5 0 3 0 3 3 0 0 0 3 0 0 0 5 0 0 0 4 2 2 3 0 3 1 0 0 0 3 0 0 0 0 0 0 0 0 0 0 4 2 2 5 3 0 0 0 0 0 0 0 2 0] Elapsed time: 0.06080436706542969 graph_id used : 77005 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20362410,20362424,20362426,20362413,20362414,20362423,20362416,20362417,20362420,20362427,20362421,20362422,20362425?tags=metal,pehd,pet_clair,refus,flou,pet_fonce,environnement,mal_croppe,carton,papier,autre,tetrapak,film_plastique&datou_id_consolidate=4235&port_consolidate=20362230&tree_id=77005 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1335873097, 1335872919, 1335872903] Looping around the photos to save general results len do output : 1 /20362230Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335873097', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872919', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872903', None, None, None, None, None, '2568975') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012206315994262695 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.000022888183594 time spend to save output : 0.012605905532836914 total time spend for step 9 : 20.01262879371643 step10:send_mail_cod Sat Feb 8 16:23:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20362230_08-02-2025_16_23_47.pdf 20362392 imagette203623921739028227 20362406 change filename to text .change filename to text .imagette203624061739028227 20362408 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203624081739028227 20362395 imagette203623951739028227 20362396 imagette203623961739028227 20362405 imagette203624051739028227 20362399 imagette203623991739028227 20362402 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203624021739028227 20362409 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203624091739028228 20362403 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203624031739028229 20362404 imagette203624041739028230 20362407 imagette203624071739028230 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20362230 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20362410,20362424,20362426,20362413,20362414,20362423,20362416,20362417,20362420,20362427,20362421,20362422,20362425?tags=metal,pehd,pet_clair,refus,flou,pet_fonce,environnement,mal_croppe,carton,papier,autre,tetrapak,film_plastique&datou_id_consolidate=4235&port_consolidate=20362230&tree_id=77005 your option no_mail is active, we will not send the real mail to your client args[1335873097] : ((1335873097, -7.591659387248769, 492609224), (1335873097, -0.4924659956661899, 501862349), '0.25971977410426256') apple ((1335873097, -7.591659387248769, 492609224), (1335873097, -0.4924659956661899, 501862349), '0.25971977410426256') We are sending mail with results at cod@fotonower.com args[1335872919] : ((1335872919, -7.59078024681338, 492609224), (1335872919, -0.49433684224624724, 501862349), '0.25971977410426256') apple ((1335872919, -7.59078024681338, 492609224), (1335872919, -0.49433684224624724, 501862349), '0.25971977410426256') We are sending mail with results at cod@fotonower.com args[1335872903] : ((1335872903, -7.582960013667187, 492609224), (1335872903, -0.5014346155204303, 501862349), '0.25971977410426256') apple ((1335872903, -7.582960013667187, 492609224), (1335872903, -0.5014346155204303, 501862349), '0.25971977410426256') We are sending mail with results at cod@fotonower.com refus_total : 0.25971977410426256 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20362230 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362230_08-02-2025_16_23_47.pdf results_Qualipapia_P20362230_08-02-2025_16_23_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362230_08-02-2025_16_23_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20362230','results_Qualipapia_P20362230_08-02-2025_16_23_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362230_08-02-2025_16_23_47.pdf','pdf','','0.15','0.25971977410426256') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1335873097, 1335872919, 1335872903] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335873097', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872919', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872903', None, None, None, None, None, '2568975') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013029336929321289 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.065811634063721 time spend to save output : 0.013275146484375 total time spend for step 10 : 4.079086780548096 step11:split_time_score Sat Feb 8 16:23:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08022025 20362230 Nombre de photos uploadées : 3 / 23040 (0%) 08022025 20362230 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 08022025 20362230 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 7.62939453125e-06 ??? elapsed_time : fill_and_build_computed_from_old_data 0.000278472900390625 elapsed_time : insert_dashboard_record_day_entry 0.02285909652709961 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362227 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362228 order by id desc limit 1 Qualite : 0.22223092092802155 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362229_08-02-2025_16_10_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362229 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362229 AND mptpi.`type`=4230 To do Qualite : 0.25971977410426256 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362230_08-02-2025_16_23_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362230 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362230 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362231 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08022025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1335873097, 1335872919, 1335872903] Looping around the photos to save general results len do output : 1 /20362230Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335873097', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872919', None, None, None, None, None, '2568975') ('4234', None, None, None, None, None, None, None, '2568975') ('4234', '20362230', '1335872903', None, None, None, None, None, '2568975') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.01341390609741211 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.801886796951294 time spend to save output : 0.013589859008789062 total time spend for step 11 : 2.815476655960083 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 45.46user 26.36system 3:29.36elapsed 34%CPU (0avgtext+0avgdata 2917596maxresident)k 159312inputs+17824outputs (7major+2790014minor)pagefaults 0swaps