python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3649848 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 8>5 please execute split_portfolio.py -i 20957652 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2627713'] with mtr_portfolio_ids : ['20957652'] and first list_photo_ids : [] new path : /proc/3649848/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.601935863494873 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 3 00:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6509 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-03 00:20:33.748506: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-03 00:20:33.756484: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-03 00:20:33.758025: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fcca8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-03 00:20:33.758077: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-03 00:20:33.760972: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-03 00:20:34.002448: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x220ce6b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-03 00:20:34.002501: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-03 00:20:34.003794: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 00:20:34.004607: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 00:20:34.009012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 00:20:34.012341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 00:20:34.013829: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 00:20:34.018190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 00:20:34.019928: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 00:20:34.027477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 00:20:34.029010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 00:20:34.029100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 00:20:34.029918: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-03 00:20:34.029937: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-03 00:20:34.029949: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-03 00:20:34.031586: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5976 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-03 00:20:34.488722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 00:20:34.488800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 00:20:34.488817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 00:20:34.488832: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 00:20:34.488847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 00:20:34.488862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 00:20:34.488876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 00:20:34.488891: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 00:20:34.489973: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 00:20:34.491603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 00:20:34.491650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 00:20:34.491666: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 00:20:34.491680: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 00:20:34.491694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 00:20:34.491708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 00:20:34.491722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 00:20:34.491736: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 00:20:34.492821: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 00:20:34.492855: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-03 00:20:34.492864: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-03 00:20:34.492872: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-03 00:20:34.494000: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5976 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-03 00:20:42.377787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 00:20:42.570681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.61406 max: 150.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.0015826225280761719 length of segment : 55 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.001184701919555664 length of segment : 38 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0008845329284667969 length of segment : 25 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 756 time to create 1 rle with old method : 0.0014586448669433594 length of segment : 55 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 1094 time to create 1 rle with old method : 0.002110719680786133 length of segment : 41 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0005786418914794922 length of segment : 20 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 850 time to create 1 rle with old method : 0.001651763916015625 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.11406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 2374 time to create 1 rle with old method : 0.003143787384033203 length of segment : 46 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 783 time to create 1 rle with old method : 0.0010788440704345703 length of segment : 47 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.0002460479736328125 length of segment : 16 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0010390281677246094 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.98125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1138 time to create 1 rle with old method : 0.0016787052154541016 length of segment : 64 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1611 time to create 1 rle with old method : 0.0021224021911621094 length of segment : 44 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0007333755493164062 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.14141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 22 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006649494171142578 length of segment : 55 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 2912 time to create 1 rle with old method : 0.003579854965209961 length of segment : 227 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00037550926208496094 length of segment : 21 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 240.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 124.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0008134841918945312 length of segment : 20 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 583 time to create 1 rle with old method : 0.0007541179656982422 length of segment : 57 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1476 time to create 1 rle with old method : 0.0019948482513427734 length of segment : 37 time for calcul the mask position with numpy : 0.0006134510040283203 nb_pixel_total : 61851 time to create 1 rle with old method : 0.07307147979736328 length of segment : 242 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 192.00000 molded_images shape: (1, 640, 640, 3) min: -98.15703 max: 70.54141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.30547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 2691 time to create 1 rle with old method : 0.0035119056701660156 length of segment : 55 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0006668567657470703 length of segment : 21 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00022912025451660156 length of segment : 20 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0016090869903564453 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.96953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005981922149658203 length of segment : 41 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.0010113716125488281 length of segment : 32 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003483295440673828 length of segment : 17 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 2127 time to create 1 rle with old method : 0.002785205841064453 length of segment : 40 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0009224414825439453 length of segment : 21 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0008816719055175781 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.85234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0004086494445800781 length of segment : 42 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 1461 time to create 1 rle with old method : 0.0018787384033203125 length of segment : 102 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 734 time to create 1 rle with old method : 0.0009813308715820312 length of segment : 36 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1327 time to create 1 rle with old method : 0.001737356185913086 length of segment : 40 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1024 time to create 1 rle with old method : 0.0015206336975097656 length of segment : 33 time for calcul the mask position with numpy : 0.00047898292541503906 nb_pixel_total : 20174 time to create 1 rle with old method : 0.024667739868164062 length of segment : 566 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 1341 time to create 1 rle with old method : 0.00179290771484375 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 243.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 105.42031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 1760 time to create 1 rle with old method : 0.0022957324981689453 length of segment : 82 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1483 time to create 1 rle with old method : 0.0019154548645019531 length of segment : 112 time for calcul the mask position with numpy : 0.0001838207244873047 nb_pixel_total : 3845 time to create 1 rle with old method : 0.0046405792236328125 length of segment : 197 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.00044655799865722656 length of segment : 41 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 808 time to create 1 rle with old method : 0.0010912418365478516 length of segment : 34 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003914833068847656 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 17.00000 max: 190.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 72.22109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009119510650634766 nb_pixel_total : 102782 time to create 1 rle with old method : 0.12448716163635254 length of segment : 285 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.44375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1900 time to create 1 rle with old method : 0.002530336380004883 length of segment : 41 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003304481506347656 length of segment : 18 time for calcul the mask position with numpy : 0.0001366138458251953 nb_pixel_total : 4149 time to create 1 rle with old method : 0.00525975227355957 length of segment : 99 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 884 time to create 1 rle with old method : 0.0016796588897705078 length of segment : 40 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 3091 time to create 1 rle with old method : 0.004415273666381836 length of segment : 45 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.000985860824584961 length of segment : 32 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 450 time to create 1 rle with old method : 0.0007112026214599609 length of segment : 26 time for calcul the mask position with numpy : 0.00011992454528808594 nb_pixel_total : 4638 time to create 1 rle with old method : 0.0067598819732666016 length of segment : 93 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.14297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.000278472900390625 length of segment : 16 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003809928894042969 length of segment : 21 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0007517337799072266 length of segment : 37 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.00036907196044921875 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0004322528839111328 length of segment : 16 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.00039696693420410156 length of segment : 16 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0007574558258056641 length of segment : 34 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.0008523464202880859 length of segment : 50 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008182525634765625 length of segment : 51 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0006194114685058594 length of segment : 32 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0006003379821777344 length of segment : 23 length of segment : 0 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00012612342834472656 length of segment : 7 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.000591278076171875 nb_pixel_total : 37335 time to create 1 rle with old method : 0.04500293731689453 length of segment : 232 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 41 time to create 1 rle with old method : 9.822845458984375e-05 length of segment : 18 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005059242248535156 length of segment : 33 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.90703 max: 150.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0011572837829589844 length of segment : 57 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00063323974609375 length of segment : 23 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0012302398681640625 length of segment : 59 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005304813385009766 length of segment : 24 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 876 time to create 1 rle with old method : 0.0012280941009521484 length of segment : 39 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.001207590103149414 length of segment : 36 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 2051 time to create 1 rle with old method : 0.002735614776611328 length of segment : 30 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 775 time to create 1 rle with old method : 0.0011532306671142578 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.34844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 2457 time to create 1 rle with old method : 0.0032455921173095703 length of segment : 45 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 46 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 838 time to create 1 rle with old method : 0.0011248588562011719 length of segment : 42 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0010068416595458984 length of segment : 38 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2551 time to create 1 rle with old method : 0.003281831741333008 length of segment : 91 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.80547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1811 time to create 1 rle with old method : 0.0026090145111083984 length of segment : 46 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 1873 time to create 1 rle with old method : 0.0026979446411132812 length of segment : 45 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 3936 time to create 1 rle with old method : 0.0050122737884521484 length of segment : 54 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 1394 time to create 1 rle with old method : 0.001781463623046875 length of segment : 34 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0008890628814697266 length of segment : 15 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0015969276428222656 length of segment : 67 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 3044 time to create 1 rle with old method : 0.003880739212036133 length of segment : 59 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0007719993591308594 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.59844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003943443298339844 length of segment : 24 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0004031658172607422 length of segment : 21 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00012803077697753906 length of segment : 22 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006008148193359375 length of segment : 51 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 2462 time to create 1 rle with old method : 0.0029404163360595703 length of segment : 260 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00040602684020996094 length of segment : 20 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 252.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.96328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0007836818695068359 length of segment : 19 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006866455078125 length of segment : 55 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 65888 time to create 1 rle with old method : 0.07646679878234863 length of segment : 285 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0008895397186279297 length of segment : 63 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1375 time to create 1 rle with old method : 0.0018596649169921875 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 190.00000 molded_images shape: (1, 640, 640, 3) min: -92.62188 max: 73.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.50078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005958080291748047 length of segment : 19 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2685 time to create 1 rle with old method : 0.0033936500549316406 length of segment : 57 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002067089080810547 length of segment : 19 time for calcul the mask position with numpy : 0.0003254413604736328 nb_pixel_total : 13560 time to create 1 rle with old method : 0.01561284065246582 length of segment : 221 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 24 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005254745483398438 length of segment : 25 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0006046295166015625 length of segment : 27 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1485 time to create 1 rle with old method : 0.0018782615661621094 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.85625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1996 time to create 1 rle with old method : 0.002637624740600586 length of segment : 40 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 719 time to create 1 rle with old method : 0.0009477138519287109 length of segment : 30 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005948543548583984 length of segment : 17 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.00116729736328125 length of segment : 66 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.98516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1725 time to create 1 rle with old method : 0.002180814743041992 length of segment : 106 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003955364227294922 length of segment : 41 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 17396 time to create 1 rle with old method : 0.020563125610351562 length of segment : 467 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1303 time to create 1 rle with old method : 0.0017042160034179688 length of segment : 40 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.001024007797241211 length of segment : 36 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 795 time to create 1 rle with old method : 0.0009424686431884766 length of segment : 38 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 244.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 106.04531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0015952587127685547 length of segment : 84 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 3548 time to create 1 rle with old method : 0.0045185089111328125 length of segment : 194 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.000400543212890625 length of segment : 27 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1324 time to create 1 rle with old method : 0.0018358230590820312 length of segment : 90 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.0010187625885009766 length of segment : 87 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004279613494873047 length of segment : 30 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.00046825408935546875 length of segment : 24 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004773139953613281 length of segment : 43 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 820 time to create 1 rle with old method : 0.0011856555938720703 length of segment : 44 Processing 1 images image shape: (280, 400, 3) min: 9.00000 max: 191.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.31484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009586811065673828 nb_pixel_total : 103271 time to create 1 rle with old method : 0.11935067176818848 length of segment : 285 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.56484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 4367 time to create 1 rle with old method : 0.005510568618774414 length of segment : 91 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 947 time to create 1 rle with old method : 0.0012857913970947266 length of segment : 43 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 659 time to create 1 rle with old method : 0.0009646415710449219 length of segment : 30 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2745 time to create 1 rle with old method : 0.004037141799926758 length of segment : 41 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1743 time to create 1 rle with old method : 0.002363443374633789 length of segment : 40 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00027942657470703125 length of segment : 17 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 6371 time to create 1 rle with old method : 0.007888555526733398 length of segment : 102 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0008082389831542969 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.86953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003635883331298828 length of segment : 20 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00025844573974609375 length of segment : 17 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005838871002197266 length of segment : 31 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004277229309082031 length of segment : 16 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00040984153747558594 length of segment : 23 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004088878631591797 length of segment : 16 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0008497238159179688 length of segment : 54 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005948543548583984 length of segment : 32 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0007369518280029297 length of segment : 47 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.89687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005657672882080078 length of segment : 32 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002613067626953125 length of segment : 18 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0006184577941894531 length of segment : 22 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 8 time to create 1 rle with old method : 3.528594970703125e-05 length of segment : 2 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.000568389892578125 nb_pixel_total : 39383 time to create 1 rle with old method : 0.04555845260620117 length of segment : 243 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.78203 max: 150.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 720 time to create 1 rle with old method : 0.0010209083557128906 length of segment : 52 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 855 time to create 1 rle with old method : 0.0011856555938720703 length of segment : 34 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005924701690673828 length of segment : 29 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003883838653564453 length of segment : 19 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 581 time to create 1 rle with old method : 0.000835418701171875 length of segment : 30 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.001241445541381836 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.13359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 2646 time to create 1 rle with old method : 0.003217935562133789 length of segment : 52 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 981 time to create 1 rle with old method : 0.0011703968048095703 length of segment : 45 time for calcul the mask position with numpy : 2.7179718017578125e-05 nb_pixel_total : 53 time to create 1 rle with old method : 9.512901306152344e-05 length of segment : 7 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 1055 time to create 1 rle with old method : 0.001390695571899414 length of segment : 42 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.000339508056640625 length of segment : 28 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003731250762939453 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.39531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1706 time to create 1 rle with old method : 0.0022668838500976562 length of segment : 45 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0017800331115722656 length of segment : 32 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1063 time to create 1 rle with old method : 0.001485586166381836 length of segment : 53 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1827 time to create 1 rle with old method : 0.002565145492553711 length of segment : 40 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0007853507995605469 length of segment : 14 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1031 time to create 1 rle with old method : 0.0013966560363769531 length of segment : 33 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0007441043853759766 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.19219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00032591819763183594 length of segment : 22 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005741119384765625 length of segment : 48 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004076957702636719 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 248.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0008442401885986328 length of segment : 19 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 639 time to create 1 rle with old method : 0.0008695125579833984 length of segment : 54 time for calcul the mask position with numpy : 0.0005352497100830078 nb_pixel_total : 44237 time to create 1 rle with old method : 0.051671504974365234 length of segment : 235 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 191.00000 molded_images shape: (1, 640, 640, 3) min: -92.67266 max: 72.81484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.37188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006814002990722656 length of segment : 21 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 2757 time to create 1 rle with old method : 0.0036973953247070312 length of segment : 58 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001850128173828125 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.84063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0009510517120361328 length of segment : 31 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1792 time to create 1 rle with old method : 0.0023763179779052734 length of segment : 36 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006203651428222656 length of segment : 39 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0007052421569824219 length of segment : 19 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0006692409515380859 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.46172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0004181861877441406 length of segment : 46 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 1664 time to create 1 rle with old method : 0.0020520687103271484 length of segment : 108 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0016603469848632812 length of segment : 39 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.0009531974792480469 length of segment : 36 time for calcul the mask position with numpy : 0.0004558563232421875 nb_pixel_total : 24379 time to create 1 rle with old method : 0.02944636344909668 length of segment : 629 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 848 time to create 1 rle with old method : 0.001129150390625 length of segment : 30 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1394 time to create 1 rle with old method : 0.001800537109375 length of segment : 49 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 243.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 105.42031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1819 time to create 1 rle with old method : 0.0023200511932373047 length of segment : 94 time for calcul the mask position with numpy : 0.00018644332885742188 nb_pixel_total : 3803 time to create 1 rle with old method : 0.004584550857543945 length of segment : 188 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 1614 time to create 1 rle with old method : 0.002068758010864258 length of segment : 82 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004184246063232422 length of segment : 31 Processing 1 images image shape: (280, 400, 3) min: 5.00000 max: 184.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 72.52578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008978843688964844 nb_pixel_total : 104906 time to create 1 rle with old method : 0.1129448413848877 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001876354217529297 length of segment : 22 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 2956 time to create 1 rle with old method : 0.0039157867431640625 length of segment : 46 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0008816719055175781 length of segment : 33 time for calcul the mask position with numpy : 0.00012111663818359375 nb_pixel_total : 4351 time to create 1 rle with old method : 0.0060765743255615234 length of segment : 83 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1754 time to create 1 rle with old method : 0.002402067184448242 length of segment : 38 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0008997917175292969 length of segment : 39 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.0008006095886230469 length of segment : 32 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004799365997314453 length of segment : 25 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 4435 time to create 1 rle with old method : 0.005470752716064453 length of segment : 81 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0013816356658935547 length of segment : 28 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0008602142333984375 length of segment : 38 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.01406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002491474151611328 length of segment : 16 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0004372596740722656 length of segment : 16 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0008368492126464844 length of segment : 33 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.000370025634765625 length of segment : 19 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.00041604042053222656 length of segment : 21 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002529621124267578 length of segment : 7 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 708 time to create 1 rle with old method : 0.0009138584136962891 length of segment : 51 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 740 time to create 1 rle with old method : 0.00090789794921875 length of segment : 53 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005404949188232422 length of segment : 35 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006325244903564453 length of segment : 23 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002779960632324219 length of segment : 20 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 52 time to create 1 rle with old method : 0.00011420249938964844 length of segment : 7 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 48 time to create 1 rle with old method : 9.72747802734375e-05 length of segment : 17 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 38124 time to create 1 rle with old method : 0.04386258125305176 length of segment : 248 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 30 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 20 time to create 1 rle with old method : 4.935264587402344e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.43828 max: 150.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0009942054748535156 length of segment : 52 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005645751953125 length of segment : 26 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006797313690185547 length of segment : 26 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 30 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0005822181701660156 length of segment : 36 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003650188446044922 length of segment : 36 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 687 time to create 1 rle with old method : 0.0009462833404541016 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.86406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2713 time to create 1 rle with old method : 0.003203153610229492 length of segment : 52 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0006430149078369141 length of segment : 32 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.00034308433532714844 length of segment : 27 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 2433 time to create 1 rle with old method : 0.003042459487915039 length of segment : 90 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001556873321533203 length of segment : 15 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00030875205993652344 length of segment : 18 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00035762786865234375 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.15703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1827 time to create 1 rle with old method : 0.0023050308227539062 length of segment : 45 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0019059181213378906 length of segment : 34 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0016312599182128906 length of segment : 53 time for calcul the mask position with numpy : 0.0002048015594482422 nb_pixel_total : 3374 time to create 1 rle with old method : 0.004519939422607422 length of segment : 88 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0007307529449462891 length of segment : 12 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 1138 time to create 1 rle with old method : 0.0015103816986083984 length of segment : 37 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1733 time to create 1 rle with old method : 0.0024042129516601562 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.00033783912658691406 length of segment : 24 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00033354759216308594 length of segment : 19 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.000583648681640625 length of segment : 48 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0006747245788574219 length of segment : 23 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00014638900756835938 length of segment : 21 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 248.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.79141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0010001659393310547 length of segment : 18 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1457 time to create 1 rle with old method : 0.0019154548645019531 length of segment : 39 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0007641315460205078 length of segment : 59 time for calcul the mask position with numpy : 0.0005776882171630859 nb_pixel_total : 55989 time to create 1 rle with old method : 0.06153273582458496 length of segment : 262 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 190.00000 molded_images shape: (1, 640, 640, 3) min: -100.70000 max: 72.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.32109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00022745132446289062 length of segment : 19 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 3091 time to create 1 rle with old method : 0.003896951675415039 length of segment : 59 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0006506443023681641 length of segment : 20 time for calcul the mask position with numpy : 0.0002956390380859375 nb_pixel_total : 10609 time to create 1 rle with old method : 0.012556314468383789 length of segment : 208 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1489 time to create 1 rle with old method : 0.001821279525756836 length of segment : 58 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005860328674316406 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.45781 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0008730888366699219 length of segment : 30 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0008139610290527344 length of segment : 20 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00017380714416503906 length of segment : 13 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0007081031799316406 length of segment : 45 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0007078647613525391 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 1912 time to create 1 rle with old method : 0.002225160598754883 length of segment : 118 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 43 time for calcul the mask position with numpy : 0.00028634071350097656 nb_pixel_total : 10659 time to create 1 rle with old method : 0.013660669326782227 length of segment : 452 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1280 time to create 1 rle with old method : 0.0015540122985839844 length of segment : 39 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0010101795196533203 length of segment : 36 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 1384 time to create 1 rle with old method : 0.0016040802001953125 length of segment : 45 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 110.40078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1639 time to create 1 rle with old method : 0.0021479129791259766 length of segment : 86 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 3931 time to create 1 rle with old method : 0.004574298858642578 length of segment : 196 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1394 time to create 1 rle with old method : 0.0017039775848388672 length of segment : 72 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1294 time to create 1 rle with old method : 0.0018453598022460938 length of segment : 72 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0005123615264892578 length of segment : 44 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004153251647949219 length of segment : 28 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 631 time to create 1 rle with old method : 0.0008478164672851562 length of segment : 55 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 180.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 65.47109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009310245513916016 nb_pixel_total : 105055 time to create 1 rle with old method : 0.11922240257263184 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.17422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 3748 time to create 1 rle with old method : 0.0043544769287109375 length of segment : 79 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0008349418640136719 length of segment : 31 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 2995 time to create 1 rle with old method : 0.0037581920623779297 length of segment : 47 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.0008447170257568359 length of segment : 40 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003299713134765625 length of segment : 15 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006265640258789062 length of segment : 52 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008699893951416016 length of segment : 34 time for calcul the mask position with numpy : 0.00013375282287597656 nb_pixel_total : 6547 time to create 1 rle with old method : 0.008071422576904297 length of segment : 91 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00013303756713867188 length of segment : 14 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 872 time to create 1 rle with old method : 0.0012052059173583984 length of segment : 32 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1068 time to create 1 rle with old method : 0.0014972686767578125 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.64687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002486705780029297 length of segment : 17 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003917217254638672 length of segment : 22 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003845691680908203 length of segment : 15 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00036907196044921875 length of segment : 22 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0007193088531494141 length of segment : 38 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 729 time to create 1 rle with old method : 0.0009272098541259766 length of segment : 53 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 631 time to create 1 rle with old method : 0.0008118152618408203 length of segment : 50 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006439685821533203 length of segment : 23 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005903244018554688 length of segment : 29 length of segment : 0 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004000663757324219 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00024962425231933594 length of segment : 17 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0005202293395996094 nb_pixel_total : 37341 time to create 1 rle with old method : 0.044103145599365234 length of segment : 236 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 20 time to create 1 rle with old method : 5.888938903808594e-05 length of segment : 4 time for calcul the mask position with numpy : 0.00037169456481933594 nb_pixel_total : 32579 time to create 1 rle with old method : 0.03702902793884277 length of segment : 239 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.72344 max: 150.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.0011754035949707031 length of segment : 56 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0010967254638671875 length of segment : 50 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005764961242675781 length of segment : 26 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0010366439819335938 length of segment : 41 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 859 time to create 1 rle with old method : 0.001184225082397461 length of segment : 34 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.0011370182037353516 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.03203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003757476806640625 length of segment : 30 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00016570091247558594 length of segment : 18 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 2734 time to create 1 rle with old method : 0.003858804702758789 length of segment : 52 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004994869232177734 length of segment : 31 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006859302520751953 length of segment : 39 time for calcul the mask position with numpy : 0.00018286705017089844 nb_pixel_total : 162 time to create 1 rle with old method : 0.00028967857360839844 length of segment : 48 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.68438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1747 time to create 1 rle with old method : 0.002082347869873047 length of segment : 35 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0017390251159667969 length of segment : 28 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1845 time to create 1 rle with old method : 0.0023529529571533203 length of segment : 45 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006971359252929688 length of segment : 14 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1506 time to create 1 rle with old method : 0.001961231231689453 length of segment : 39 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006914138793945312 length of segment : 14 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 6185 time to create 1 rle with old method : 0.007692813873291016 length of segment : 116 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00032401084899902344 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003879070281982422 length of segment : 22 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.0009622573852539062 length of segment : 68 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005199909210205078 length of segment : 49 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003962516784667969 length of segment : 24 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.81875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007939338684082031 length of segment : 18 time for calcul the mask position with numpy : 0.0006945133209228516 nb_pixel_total : 70266 time to create 1 rle with old method : 0.08353734016418457 length of segment : 270 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 192.00000 molded_images shape: (1, 640, 640, 3) min: -95.05938 max: 73.92031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.06719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00021648406982421875 length of segment : 17 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2995 time to create 1 rle with old method : 0.0038542747497558594 length of segment : 64 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 588 time to create 1 rle with old method : 0.0008428096771240234 length of segment : 27 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004942417144775391 length of segment : 22 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0017549991607666016 length of segment : 53 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 2422 time to create 1 rle with old method : 0.003251791000366211 length of segment : 49 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.000614166259765625 length of segment : 24 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1298 time to create 1 rle with old method : 0.0016269683837890625 length of segment : 49 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004889965057373047 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.85625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1926 time to create 1 rle with old method : 0.0026006698608398438 length of segment : 39 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 740 time to create 1 rle with old method : 0.0010275840759277344 length of segment : 30 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005772113800048828 length of segment : 41 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.000431060791015625 length of segment : 12 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00023174285888671875 length of segment : 9 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00026106834411621094 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.29766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.00039577484130859375 length of segment : 44 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1485 time to create 1 rle with old method : 0.0018782615661621094 length of segment : 98 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 797 time to create 1 rle with old method : 0.0009696483612060547 length of segment : 35 time for calcul the mask position with numpy : 0.00030994415283203125 nb_pixel_total : 16104 time to create 1 rle with old method : 0.020160913467407227 length of segment : 568 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0016109943389892578 length of segment : 39 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1365 time to create 1 rle with old method : 0.001836538314819336 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 241.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 103.31875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1083 time to create 1 rle with old method : 0.0015025138854980469 length of segment : 127 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1441 time to create 1 rle with old method : 0.0018451213836669922 length of segment : 100 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003952980041503906 length of segment : 30 time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 3883 time to create 1 rle with old method : 0.004609346389770508 length of segment : 189 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003879070281982422 length of segment : 24 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003762245178222656 length of segment : 28 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003275871276855469 length of segment : 39 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006411075592041016 length of segment : 50 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 68.65078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008761882781982422 nb_pixel_total : 103590 time to create 1 rle with old method : 0.14360761642456055 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.17422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008630752563476562 length of segment : 29 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002856254577636719 length of segment : 16 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2985 time to create 1 rle with old method : 0.0038251876831054688 length of segment : 47 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 940 time to create 1 rle with old method : 0.001226663589477539 length of segment : 43 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 3831 time to create 1 rle with old method : 0.004824638366699219 length of segment : 78 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1555 time to create 1 rle with old method : 0.0020499229431152344 length of segment : 41 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003192424774169922 length of segment : 23 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 924 time to create 1 rle with old method : 0.0012066364288330078 length of segment : 41 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.39297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00024199485778808594 length of segment : 17 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003802776336669922 length of segment : 21 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.0008835792541503906 length of segment : 35 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003731250762939453 length of segment : 15 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003914833068847656 length of segment : 22 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0008184909820556641 length of segment : 52 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.000858306884765625 length of segment : 53 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.0008604526519775391 length of segment : 53 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.83828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004100799560546875 length of segment : 36 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 43 time to create 1 rle with old method : 0.00018906593322753906 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00026869773864746094 length of segment : 18 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 46 time to create 1 rle with old method : 0.00012636184692382812 length of segment : 12 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.0001888275146484375 length of segment : 6 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005519390106201172 length of segment : 23 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006625652313232422 length of segment : 23 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005576610565185547 length of segment : 24 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0004985332489013672 nb_pixel_total : 38330 time to create 1 rle with old method : 0.043909311294555664 length of segment : 244 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006296634674072266 length of segment : 31 Detection mask done ! Trying to reset tf kernel 3650566 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1220 tf kernel not reseted sub process len(results) : 387 len(list_Values) 387 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 387 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6509 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 387 chid ids of type : 4228 Number RLEs to save : 22223 save missing photos in datou_result : time spend for datou_step_exec : 31.596761226654053 time spend to save output : 2.479069709777832 total time spend for step 1 : 34.075830936431885 step2:brightness Mon Mar 3 00:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740957629_3649848_1340531863_8866c5b8f77e264a21040148eca95a30.jpg treat image : temp/1740957629_3649848_1340531860_82ce556f808e186a5a4186da330790dd.jpg treat image : temp/1740957629_3649848_1340531854_280e123166717ae21dbf56830d3cc89f.jpg treat image : temp/1740957629_3649848_1340531839_604b17142105a617656005c62df7b114.jpg treat image : temp/1740957629_3649848_1340531838_b03b2b51e706950c9bcc9b2377b29af3.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.011912345886230469 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.011930227279663086 save missing photos in datou_result : time spend for datou_step_exec : 1.1974878311157227 time spend to save output : 0.02846670150756836 total time spend for step 2 : 1.225954532623291 step3:blur_detection Mon Mar 3 00:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740957629_3649848_1340531863_8866c5b8f77e264a21040148eca95a30.jpg resize: (1080, 1920) 1340531863 -7.493017494540149 treat image : temp/1740957629_3649848_1340531860_82ce556f808e186a5a4186da330790dd.jpg resize: (1080, 1920) 1340531860 -7.49966880629878 treat image : temp/1740957629_3649848_1340531854_280e123166717ae21dbf56830d3cc89f.jpg resize: (1080, 1920) 1340531854 -7.490771693496328 treat image : temp/1740957629_3649848_1340531839_604b17142105a617656005c62df7b114.jpg resize: (1080, 1920) 1340531839 -7.492886147534862 treat image : temp/1740957629_3649848_1340531838_b03b2b51e706950c9bcc9b2377b29af3.jpg resize: (1080, 1920) 1340531838 -7.4933372632378905 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.012679100036621094 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.011983156204223633 save missing photos in datou_result : time spend for datou_step_exec : 5.624048471450806 time spend to save output : 0.029401302337646484 total time spend for step 3 : 5.653449773788452 step4:rle_unique_nms_with_priority Mon Mar 3 00:21:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 387 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 68 nb_hashtags : 6 time to prepare the origin masks : 1.0531387329101562 time for calcul the mask position with numpy : 0.2502875328063965 nb_pixel_total : 1799488 time to create 1 rle with new method : 0.08450865745544434 time for calcul the mask position with numpy : 0.008656024932861328 nb_pixel_total : 87 time to create 1 rle with old method : 0.00018548965454101562 time for calcul the mask position with numpy : 0.008611202239990234 nb_pixel_total : 783 time to create 1 rle with old method : 0.0009558200836181641 time for calcul the mask position with numpy : 0.008608579635620117 nb_pixel_total : 75 time to create 1 rle with old method : 0.00013184547424316406 time for calcul the mask position with numpy : 0.008669137954711914 nb_pixel_total : 625 time to create 1 rle with old method : 0.000789642333984375 time for calcul the mask position with numpy : 0.008594036102294922 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001609325408935547 time for calcul the mask position with numpy : 0.008375883102416992 nb_pixel_total : 115 time to create 1 rle with old method : 0.000171661376953125 time for calcul the mask position with numpy : 0.00806283950805664 nb_pixel_total : 805 time to create 1 rle with old method : 0.0009677410125732422 time for calcul the mask position with numpy : 0.008145570755004883 nb_pixel_total : 221 time to create 1 rle with old method : 0.00024700164794921875 time for calcul the mask position with numpy : 0.00823068618774414 nb_pixel_total : 1094 time to create 1 rle with old method : 0.0011992454528808594 time for calcul the mask position with numpy : 0.007970333099365234 nb_pixel_total : 2374 time to create 1 rle with old method : 0.0026962757110595703 time for calcul the mask position with numpy : 0.008045196533203125 nb_pixel_total : 61851 time to create 1 rle with old method : 0.06648564338684082 time for calcul the mask position with numpy : 0.007999658584594727 nb_pixel_total : 1611 time to create 1 rle with old method : 0.0017163753509521484 time for calcul the mask position with numpy : 0.007795095443725586 nb_pixel_total : 2658 time to create 1 rle with old method : 0.0029366016387939453 time for calcul the mask position with numpy : 0.008026599884033203 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002434253692626953 time for calcul the mask position with numpy : 0.007940053939819336 nb_pixel_total : 583 time to create 1 rle with old method : 0.0006201267242431641 time for calcul the mask position with numpy : 0.00797581672668457 nb_pixel_total : 154 time to create 1 rle with old method : 0.00017499923706054688 time for calcul the mask position with numpy : 0.00822901725769043 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.008217573165893555 nb_pixel_total : 1138 time to create 1 rle with old method : 0.001407623291015625 time for calcul the mask position with numpy : 0.008255720138549805 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005831718444824219 time for calcul the mask position with numpy : 0.008083105087280273 nb_pixel_total : 449 time to create 1 rle with old method : 0.0004985332489013672 time for calcul the mask position with numpy : 0.007988214492797852 nb_pixel_total : 1476 time to create 1 rle with old method : 0.001581430435180664 time for calcul the mask position with numpy : 0.007975101470947266 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006558895111083984 time for calcul the mask position with numpy : 0.007903814315795898 nb_pixel_total : 20174 time to create 1 rle with old method : 0.021480083465576172 time for calcul the mask position with numpy : 0.007685184478759766 nb_pixel_total : 742 time to create 1 rle with old method : 0.0007679462432861328 time for calcul the mask position with numpy : 0.0076122283935546875 nb_pixel_total : 734 time to create 1 rle with old method : 0.0007739067077636719 time for calcul the mask position with numpy : 0.00797724723815918 nb_pixel_total : 2127 time to create 1 rle with old method : 0.0022661685943603516 time for calcul the mask position with numpy : 0.0077495574951171875 nb_pixel_total : 1327 time to create 1 rle with old method : 0.001382589340209961 time for calcul the mask position with numpy : 0.008017539978027344 nb_pixel_total : 84 time to create 1 rle with old method : 0.00012636184692382812 time for calcul the mask position with numpy : 0.008142471313476562 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003402233123779297 time for calcul the mask position with numpy : 0.008156776428222656 nb_pixel_total : 783 time to create 1 rle with old method : 0.0009491443634033203 time for calcul the mask position with numpy : 0.008053302764892578 nb_pixel_total : 121 time to create 1 rle with old method : 0.00018286705017089844 time for calcul the mask position with numpy : 0.00810384750366211 nb_pixel_total : 1760 time to create 1 rle with old method : 0.002043008804321289 time for calcul the mask position with numpy : 0.008048295974731445 nb_pixel_total : 3845 time to create 1 rle with old method : 0.0042688846588134766 time for calcul the mask position with numpy : 0.007889986038208008 nb_pixel_total : 315 time to create 1 rle with old method : 0.00035190582275390625 time for calcul the mask position with numpy : 0.008086681365966797 nb_pixel_total : 567 time to create 1 rle with old method : 0.0006301403045654297 time for calcul the mask position with numpy : 0.008046865463256836 nb_pixel_total : 47 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.008162498474121094 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005137920379638672 time for calcul the mask position with numpy : 0.007984638214111328 nb_pixel_total : 1461 time to create 1 rle with old method : 0.0015902519226074219 time for calcul the mask position with numpy : 0.008178949356079102 nb_pixel_total : 223 time to create 1 rle with old method : 0.000255584716796875 time for calcul the mask position with numpy : 0.008094072341918945 nb_pixel_total : 2691 time to create 1 rle with old method : 0.003109455108642578 time for calcul the mask position with numpy : 0.008077859878540039 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003466606140136719 time for calcul the mask position with numpy : 0.008157730102539062 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0015027523040771484 time for calcul the mask position with numpy : 0.008168697357177734 nb_pixel_total : 1024 time to create 1 rle with old method : 0.001264333724975586 time for calcul the mask position with numpy : 0.00809335708618164 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005664825439453125 time for calcul the mask position with numpy : 0.00830984115600586 nb_pixel_total : 145 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.008742332458496094 nb_pixel_total : 102782 time to create 1 rle with old method : 0.11525321006774902 time for calcul the mask position with numpy : 0.008330345153808594 nb_pixel_total : 409 time to create 1 rle with old method : 0.00045013427734375 time for calcul the mask position with numpy : 0.008162975311279297 nb_pixel_total : 41 time to create 1 rle with old method : 5.507469177246094e-05 time for calcul the mask position with numpy : 0.008117437362670898 nb_pixel_total : 37335 time to create 1 rle with old method : 0.0406336784362793 time for calcul the mask position with numpy : 0.00802469253540039 nb_pixel_total : 3091 time to create 1 rle with old method : 0.0034046173095703125 time for calcul the mask position with numpy : 0.007904052734375 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007002353668212891 time for calcul the mask position with numpy : 0.008016109466552734 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.007879495620727539 nb_pixel_total : 267 time to create 1 rle with old method : 0.00031375885009765625 time for calcul the mask position with numpy : 0.007889747619628906 nb_pixel_total : 4149 time to create 1 rle with old method : 0.0044994354248046875 time for calcul the mask position with numpy : 0.007880210876464844 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006313323974609375 time for calcul the mask position with numpy : 0.008216381072998047 nb_pixel_total : 526 time to create 1 rle with old method : 0.0006251335144042969 time for calcul the mask position with numpy : 0.008163213729858398 nb_pixel_total : 10 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.008117198944091797 nb_pixel_total : 1900 time to create 1 rle with old method : 0.0021262168884277344 time for calcul the mask position with numpy : 0.00814962387084961 nb_pixel_total : 50 time to create 1 rle with old method : 6.580352783203125e-05 time for calcul the mask position with numpy : 0.008240938186645508 nb_pixel_total : 884 time to create 1 rle with old method : 0.0009324550628662109 time for calcul the mask position with numpy : 0.008144140243530273 nb_pixel_total : 362 time to create 1 rle with old method : 0.00039649009704589844 time for calcul the mask position with numpy : 0.008142948150634766 nb_pixel_total : 269 time to create 1 rle with old method : 0.0002923011779785156 time for calcul the mask position with numpy : 0.008099794387817383 nb_pixel_total : 284 time to create 1 rle with old method : 0.00033164024353027344 time for calcul the mask position with numpy : 0.008271455764770508 nb_pixel_total : 5 time to create 1 rle with old method : 1.3589859008789062e-05 time for calcul the mask position with numpy : 0.009721994400024414 nb_pixel_total : 450 time to create 1 rle with old method : 0.0005517005920410156 time for calcul the mask position with numpy : 0.008217334747314453 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002512931823730469 time for calcul the mask position with numpy : 0.008396625518798828 nb_pixel_total : 539 time to create 1 rle with old method : 0.000640869140625 time for calcul the mask position with numpy : 0.008327245712280273 nb_pixel_total : 569 time to create 1 rle with old method : 0.0006632804870605469 create new chi : 1.2036290168762207 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.010065317153930664 batch 1 Loaded 69 chid ids of type : 4230 Number RLEs to save : 8653 TO DO : save crop sub photo not yet done ! save time : 0.5444588661193848 nb_obj : 82 nb_hashtags : 7 time to prepare the origin masks : 1.7298378944396973 time for calcul the mask position with numpy : 0.5123128890991211 nb_pixel_total : 1760888 time to create 1 rle with new method : 0.07997941970825195 time for calcul the mask position with numpy : 0.007813215255737305 nb_pixel_total : 40 time to create 1 rle with old method : 8.511543273925781e-05 time for calcul the mask position with numpy : 0.005612850189208984 nb_pixel_total : 838 time to create 1 rle with old method : 0.0009553432464599609 time for calcul the mask position with numpy : 0.0064318180084228516 nb_pixel_total : 65888 time to create 1 rle with old method : 0.07638835906982422 time for calcul the mask position with numpy : 0.006376981735229492 nb_pixel_total : 2051 time to create 1 rle with old method : 0.002270936965942383 time for calcul the mask position with numpy : 0.005724430084228516 nb_pixel_total : 291 time to create 1 rle with old method : 0.00034046173095703125 time for calcul the mask position with numpy : 0.005838155746459961 nb_pixel_total : 133 time to create 1 rle with old method : 0.000202178955078125 time for calcul the mask position with numpy : 0.0058307647705078125 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006093978881835938 time for calcul the mask position with numpy : 0.009606361389160156 nb_pixel_total : 831 time to create 1 rle with old method : 0.0011818408966064453 time for calcul the mask position with numpy : 0.010925054550170898 nb_pixel_total : 386 time to create 1 rle with old method : 0.00046324729919433594 time for calcul the mask position with numpy : 0.009376764297485352 nb_pixel_total : 10 time to create 1 rle with old method : 3.123283386230469e-05 time for calcul the mask position with numpy : 0.009175300598144531 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.009081125259399414 nb_pixel_total : 3044 time to create 1 rle with old method : 0.0031795501708984375 time for calcul the mask position with numpy : 0.009057760238647461 nb_pixel_total : 2457 time to create 1 rle with old method : 0.0025904178619384766 time for calcul the mask position with numpy : 0.00968170166015625 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0014188289642333984 time for calcul the mask position with numpy : 0.00960850715637207 nb_pixel_total : 1811 time to create 1 rle with old method : 0.0020949840545654297 time for calcul the mask position with numpy : 0.009750604629516602 nb_pixel_total : 2212 time to create 1 rle with old method : 0.002490997314453125 time for calcul the mask position with numpy : 0.009680032730102539 nb_pixel_total : 726 time to create 1 rle with old method : 0.0009298324584960938 time for calcul the mask position with numpy : 0.009522676467895508 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003695487976074219 time for calcul the mask position with numpy : 0.006013631820678711 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006000995635986328 time for calcul the mask position with numpy : 0.005851268768310547 nb_pixel_total : 2551 time to create 1 rle with old method : 0.002664327621459961 time for calcul the mask position with numpy : 0.005712985992431641 nb_pixel_total : 267 time to create 1 rle with old method : 0.00030112266540527344 time for calcul the mask position with numpy : 0.005873441696166992 nb_pixel_total : 705 time to create 1 rle with old method : 0.0007677078247070312 time for calcul the mask position with numpy : 0.00572967529296875 nb_pixel_total : 274 time to create 1 rle with old method : 0.000308990478515625 time for calcul the mask position with numpy : 0.005914449691772461 nb_pixel_total : 79 time to create 1 rle with old method : 0.00010275840759277344 time for calcul the mask position with numpy : 0.005927085876464844 nb_pixel_total : 3936 time to create 1 rle with old method : 0.0045013427734375 time for calcul the mask position with numpy : 0.0062520503997802734 nb_pixel_total : 1873 time to create 1 rle with old method : 0.002185344696044922 time for calcul the mask position with numpy : 0.0063059329986572266 nb_pixel_total : 476 time to create 1 rle with old method : 0.0005424022674560547 time for calcul the mask position with numpy : 0.006091594696044922 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007236003875732422 time for calcul the mask position with numpy : 0.005899906158447266 nb_pixel_total : 31 time to create 1 rle with old method : 7.843971252441406e-05 time for calcul the mask position with numpy : 0.005967140197753906 nb_pixel_total : 1375 time to create 1 rle with old method : 0.0016164779663085938 time for calcul the mask position with numpy : 0.006068229675292969 nb_pixel_total : 1394 time to create 1 rle with old method : 0.0016078948974609375 time for calcul the mask position with numpy : 0.0062787532806396484 nb_pixel_total : 551 time to create 1 rle with old method : 0.0007002353668212891 time for calcul the mask position with numpy : 0.006333589553833008 nb_pixel_total : 17370 time to create 1 rle with old method : 0.019098520278930664 time for calcul the mask position with numpy : 0.006106376647949219 nb_pixel_total : 719 time to create 1 rle with old method : 0.0008208751678466797 time for calcul the mask position with numpy : 0.006316423416137695 nb_pixel_total : 37 time to create 1 rle with old method : 7.867813110351562e-05 time for calcul the mask position with numpy : 0.005990266799926758 nb_pixel_total : 773 time to create 1 rle with old method : 0.0008645057678222656 time for calcul the mask position with numpy : 0.006124734878540039 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003414154052734375 time for calcul the mask position with numpy : 0.005758762359619141 nb_pixel_total : 1996 time to create 1 rle with old method : 0.0023467540740966797 time for calcul the mask position with numpy : 0.005661725997924805 nb_pixel_total : 1303 time to create 1 rle with old method : 0.0016698837280273438 time for calcul the mask position with numpy : 0.005526542663574219 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004401206970214844 time for calcul the mask position with numpy : 0.005763053894042969 nb_pixel_total : 300 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.00731968879699707 nb_pixel_total : 12884 time to create 1 rle with old method : 0.015001535415649414 time for calcul the mask position with numpy : 0.005944728851318359 nb_pixel_total : 820 time to create 1 rle with old method : 0.0009064674377441406 time for calcul the mask position with numpy : 0.005923271179199219 nb_pixel_total : 3548 time to create 1 rle with old method : 0.004039287567138672 time for calcul the mask position with numpy : 0.005851268768310547 nb_pixel_total : 335 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.0056591033935546875 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0012538433074951172 time for calcul the mask position with numpy : 0.005703449249267578 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003120899200439453 time for calcul the mask position with numpy : 0.005851268768310547 nb_pixel_total : 403 time to create 1 rle with old method : 0.00046563148498535156 time for calcul the mask position with numpy : 0.006052255630493164 nb_pixel_total : 21 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.005885601043701172 nb_pixel_total : 6 time to create 1 rle with old method : 3.075599670410156e-05 time for calcul the mask position with numpy : 0.005748748779296875 nb_pixel_total : 51 time to create 1 rle with old method : 7.486343383789062e-05 time for calcul the mask position with numpy : 0.005788326263427734 nb_pixel_total : 865 time to create 1 rle with old method : 0.0009334087371826172 time for calcul the mask position with numpy : 0.005776405334472656 nb_pixel_total : 1725 time to create 1 rle with old method : 0.0019297599792480469 time for calcul the mask position with numpy : 0.00600743293762207 nb_pixel_total : 491 time to create 1 rle with old method : 0.0005681514739990234 time for calcul the mask position with numpy : 0.0062291622161865234 nb_pixel_total : 2685 time to create 1 rle with old method : 0.0033898353576660156 time for calcul the mask position with numpy : 0.006648540496826172 nb_pixel_total : 289 time to create 1 rle with old method : 0.00036597251892089844 time for calcul the mask position with numpy : 0.006146669387817383 nb_pixel_total : 1485 time to create 1 rle with old method : 0.0018165111541748047 time for calcul the mask position with numpy : 0.006506919860839844 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005183219909667969 time for calcul the mask position with numpy : 0.006203174591064453 nb_pixel_total : 143 time to create 1 rle with old method : 0.00018715858459472656 time for calcul the mask position with numpy : 0.007000923156738281 nb_pixel_total : 103271 time to create 1 rle with old method : 0.13158345222473145 time for calcul the mask position with numpy : 0.006073474884033203 nb_pixel_total : 6370 time to create 1 rle with old method : 0.007354736328125 time for calcul the mask position with numpy : 0.006285667419433594 nb_pixel_total : 39383 time to create 1 rle with old method : 0.04468345642089844 time for calcul the mask position with numpy : 0.0062961578369140625 nb_pixel_total : 414 time to create 1 rle with old method : 0.0004799365997314453 time for calcul the mask position with numpy : 0.005877971649169922 nb_pixel_total : 2745 time to create 1 rle with old method : 0.0032911300659179688 time for calcul the mask position with numpy : 0.00684046745300293 nb_pixel_total : 686 time to create 1 rle with old method : 0.0008914470672607422 time for calcul the mask position with numpy : 0.006043195724487305 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002827644348144531 time for calcul the mask position with numpy : 0.005995273590087891 nb_pixel_total : 7 time to create 1 rle with old method : 3.838539123535156e-05 time for calcul the mask position with numpy : 0.008088827133178711 nb_pixel_total : 619 time to create 1 rle with old method : 0.0008862018585205078 time for calcul the mask position with numpy : 0.008484363555908203 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003485679626464844 time for calcul the mask position with numpy : 0.00853729248046875 nb_pixel_total : 4367 time to create 1 rle with old method : 0.005208015441894531 time for calcul the mask position with numpy : 0.010151863098144531 nb_pixel_total : 635 time to create 1 rle with old method : 0.0013089179992675781 time for calcul the mask position with numpy : 0.011442422866821289 nb_pixel_total : 269 time to create 1 rle with old method : 0.00040340423583984375 time for calcul the mask position with numpy : 0.009061574935913086 nb_pixel_total : 1743 time to create 1 rle with old method : 0.0020525455474853516 time for calcul the mask position with numpy : 0.008176803588867188 nb_pixel_total : 947 time to create 1 rle with old method : 0.0011026859283447266 time for calcul the mask position with numpy : 0.008307456970214844 nb_pixel_total : 413 time to create 1 rle with old method : 0.00043582916259765625 time for calcul the mask position with numpy : 0.008222579956054688 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.008354663848876953 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003364086151123047 time for calcul the mask position with numpy : 0.008264541625976562 nb_pixel_total : 8 time to create 1 rle with old method : 1.7881393432617188e-05 time for calcul the mask position with numpy : 0.008266210556030273 nb_pixel_total : 183 time to create 1 rle with old method : 0.000274658203125 time for calcul the mask position with numpy : 0.008354902267456055 nb_pixel_total : 468 time to create 1 rle with old method : 0.000560760498046875 time for calcul the mask position with numpy : 0.00824284553527832 nb_pixel_total : 417 time to create 1 rle with old method : 0.0004944801330566406 time for calcul the mask position with numpy : 0.008353233337402344 nb_pixel_total : 173 time to create 1 rle with old method : 0.00020933151245117188 create new chi : 1.5540242195129395 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014293193817138672 batch 1 Loaded 83 chid ids of type : 4230 Number RLEs to save : 10215 TO DO : save crop sub photo not yet done ! save time : 2.27551007270813 nb_obj : 71 nb_hashtags : 6 time to prepare the origin masks : 1.4011173248291016 time for calcul the mask position with numpy : 0.0185239315032959 nb_pixel_total : 1807286 time to create 1 rle with new method : 0.032468318939208984 time for calcul the mask position with numpy : 0.006148338317871094 nb_pixel_total : 257 time to create 1 rle with old method : 0.0002942085266113281 time for calcul the mask position with numpy : 0.0057642459869384766 nb_pixel_total : 1055 time to create 1 rle with old method : 0.0012695789337158203 time for calcul the mask position with numpy : 0.005821943283081055 nb_pixel_total : 16 time to create 1 rle with old method : 7.104873657226562e-05 time for calcul the mask position with numpy : 0.006005287170410156 nb_pixel_total : 855 time to create 1 rle with old method : 0.0009632110595703125 time for calcul the mask position with numpy : 0.005900859832763672 nb_pixel_total : 50 time to create 1 rle with old method : 9.131431579589844e-05 time for calcul the mask position with numpy : 0.005817890167236328 nb_pixel_total : 39 time to create 1 rle with old method : 7.05718994140625e-05 time for calcul the mask position with numpy : 0.0059392452239990234 nb_pixel_total : 720 time to create 1 rle with old method : 0.0008976459503173828 time for calcul the mask position with numpy : 0.006196498870849609 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003731250762939453 time for calcul the mask position with numpy : 0.0061397552490234375 nb_pixel_total : 2646 time to create 1 rle with old method : 0.0030286312103271484 time for calcul the mask position with numpy : 0.006186485290527344 nb_pixel_total : 44237 time to create 1 rle with old method : 0.050380706787109375 time for calcul the mask position with numpy : 0.005934238433837891 nb_pixel_total : 53 time to create 1 rle with old method : 8.225440979003906e-05 time for calcul the mask position with numpy : 0.006259441375732422 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0014262199401855469 time for calcul the mask position with numpy : 0.006086111068725586 nb_pixel_total : 1706 time to create 1 rle with old method : 0.0018689632415771484 time for calcul the mask position with numpy : 0.0060689449310302734 nb_pixel_total : 229 time to create 1 rle with old method : 0.0002684593200683594 time for calcul the mask position with numpy : 0.00574040412902832 nb_pixel_total : 639 time to create 1 rle with old method : 0.00069427490234375 time for calcul the mask position with numpy : 0.0060160160064697266 nb_pixel_total : 981 time to create 1 rle with old method : 0.0011322498321533203 time for calcul the mask position with numpy : 0.005964994430541992 nb_pixel_total : 1827 time to create 1 rle with old method : 0.0022211074829101562 time for calcul the mask position with numpy : 0.006185293197631836 nb_pixel_total : 420 time to create 1 rle with old method : 0.0007989406585693359 time for calcul the mask position with numpy : 0.006621360778808594 nb_pixel_total : 494 time to create 1 rle with old method : 0.0005986690521240234 time for calcul the mask position with numpy : 0.0059757232666015625 nb_pixel_total : 26 time to create 1 rle with old method : 8.797645568847656e-05 time for calcul the mask position with numpy : 0.0061376094818115234 nb_pixel_total : 266 time to create 1 rle with old method : 0.00032591819763183594 time for calcul the mask position with numpy : 0.00588226318359375 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0015261173248291016 time for calcul the mask position with numpy : 0.006143331527709961 nb_pixel_total : 15 time to create 1 rle with old method : 5.936622619628906e-05 time for calcul the mask position with numpy : 0.006038665771484375 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006678104400634766 time for calcul the mask position with numpy : 0.006161689758300781 nb_pixel_total : 24074 time to create 1 rle with old method : 0.02670598030090332 time for calcul the mask position with numpy : 0.00635838508605957 nb_pixel_total : 726 time to create 1 rle with old method : 0.0008249282836914062 time for calcul the mask position with numpy : 0.006056547164916992 nb_pixel_total : 716 time to create 1 rle with old method : 0.0007681846618652344 time for calcul the mask position with numpy : 0.005957603454589844 nb_pixel_total : 1792 time to create 1 rle with old method : 0.0021369457244873047 time for calcul the mask position with numpy : 0.006009578704833984 nb_pixel_total : 1287 time to create 1 rle with old method : 0.001481771469116211 time for calcul the mask position with numpy : 0.005971193313598633 nb_pixel_total : 310 time to create 1 rle with old method : 0.00036978721618652344 time for calcul the mask position with numpy : 0.006087541580200195 nb_pixel_total : 1819 time to create 1 rle with old method : 0.0019392967224121094 time for calcul the mask position with numpy : 0.005994319915771484 nb_pixel_total : 3803 time to create 1 rle with old method : 0.0042877197265625 time for calcul the mask position with numpy : 0.005777120590209961 nb_pixel_total : 65 time to create 1 rle with old method : 0.00013303756713867188 time for calcul the mask position with numpy : 0.006111860275268555 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005505084991455078 time for calcul the mask position with numpy : 0.005819082260131836 nb_pixel_total : 13 time to create 1 rle with old method : 5.364418029785156e-05 time for calcul the mask position with numpy : 0.0060002803802490234 nb_pixel_total : 444 time to create 1 rle with old method : 0.0004856586456298828 time for calcul the mask position with numpy : 0.0059626102447509766 nb_pixel_total : 1664 time to create 1 rle with old method : 0.0018301010131835938 time for calcul the mask position with numpy : 0.005903482437133789 nb_pixel_total : 2757 time to create 1 rle with old method : 0.0031380653381347656 time for calcul the mask position with numpy : 0.0058934688568115234 nb_pixel_total : 1394 time to create 1 rle with old method : 0.001722574234008789 time for calcul the mask position with numpy : 0.006003379821777344 nb_pixel_total : 303 time to create 1 rle with old method : 0.00033473968505859375 time for calcul the mask position with numpy : 0.0059926509857177734 nb_pixel_total : 848 time to create 1 rle with old method : 0.0010416507720947266 time for calcul the mask position with numpy : 0.006440639495849609 nb_pixel_total : 476 time to create 1 rle with old method : 0.0005841255187988281 time for calcul the mask position with numpy : 0.005927085876464844 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001544952392578125 time for calcul the mask position with numpy : 0.00652313232421875 nb_pixel_total : 104906 time to create 1 rle with old method : 0.1194145679473877 time for calcul the mask position with numpy : 0.006020784378051758 nb_pixel_total : 4435 time to create 1 rle with old method : 0.0047762393951416016 time for calcul the mask position with numpy : 0.005815029144287109 nb_pixel_total : 465 time to create 1 rle with old method : 0.00054931640625 time for calcul the mask position with numpy : 0.006215572357177734 nb_pixel_total : 38124 time to create 1 rle with old method : 0.043320417404174805 time for calcul the mask position with numpy : 0.006196022033691406 nb_pixel_total : 48 time to create 1 rle with old method : 7.700920104980469e-05 time for calcul the mask position with numpy : 0.005834817886352539 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001373291015625 time for calcul the mask position with numpy : 0.006153106689453125 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0011878013610839844 time for calcul the mask position with numpy : 0.006318330764770508 nb_pixel_total : 2956 time to create 1 rle with old method : 0.0034155845642089844 time for calcul the mask position with numpy : 0.005902290344238281 nb_pixel_total : 37 time to create 1 rle with old method : 6.341934204101562e-05 time for calcul the mask position with numpy : 0.00579833984375 nb_pixel_total : 708 time to create 1 rle with old method : 0.0008401870727539062 time for calcul the mask position with numpy : 0.005813121795654297 nb_pixel_total : 169 time to create 1 rle with old method : 0.00020432472229003906 time for calcul the mask position with numpy : 0.005753278732299805 nb_pixel_total : 665 time to create 1 rle with old method : 0.0007507801055908203 time for calcul the mask position with numpy : 0.005765676498413086 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003039836883544922 time for calcul the mask position with numpy : 0.005873680114746094 nb_pixel_total : 4342 time to create 1 rle with old method : 0.005002737045288086 time for calcul the mask position with numpy : 0.0058438777923583984 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007283687591552734 time for calcul the mask position with numpy : 0.0058078765869140625 nb_pixel_total : 1754 time to create 1 rle with old method : 0.001962900161743164 time for calcul the mask position with numpy : 0.005838632583618164 nb_pixel_total : 22 time to create 1 rle with old method : 6.389617919921875e-05 time for calcul the mask position with numpy : 0.005916595458984375 nb_pixel_total : 383 time to create 1 rle with old method : 0.00045990943908691406 time for calcul the mask position with numpy : 0.0058362483978271484 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007302761077880859 time for calcul the mask position with numpy : 0.005838632583618164 nb_pixel_total : 266 time to create 1 rle with old method : 0.00032591819763183594 time for calcul the mask position with numpy : 0.005787849426269531 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003478527069091797 time for calcul the mask position with numpy : 0.0058557987213134766 nb_pixel_total : 20 time to create 1 rle with old method : 3.9577484130859375e-05 time for calcul the mask position with numpy : 0.005989789962768555 nb_pixel_total : 1 time to create 1 rle with old method : 2.002716064453125e-05 time for calcul the mask position with numpy : 0.006021261215209961 nb_pixel_total : 52 time to create 1 rle with old method : 0.00012087821960449219 time for calcul the mask position with numpy : 0.005917787551879883 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003604888916015625 time for calcul the mask position with numpy : 0.006050825119018555 nb_pixel_total : 622 time to create 1 rle with old method : 0.0007452964782714844 time for calcul the mask position with numpy : 0.005998373031616211 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.00575566291809082 nb_pixel_total : 158 time to create 1 rle with old method : 0.0001800060272216797 create new chi : 0.7834212779998779 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0012242794036865234 batch 1 Loaded 72 chid ids of type : 4230 Number RLEs to save : 8260 TO DO : save crop sub photo not yet done ! save time : 0.49892306327819824 nb_obj : 80 nb_hashtags : 6 time to prepare the origin masks : 1.3153116703033447 time for calcul the mask position with numpy : 0.06420564651489258 nb_pixel_total : 1789305 time to create 1 rle with new method : 0.30689096450805664 time for calcul the mask position with numpy : 0.006618022918701172 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005433559417724609 time for calcul the mask position with numpy : 0.00633549690246582 nb_pixel_total : 3374 time to create 1 rle with old method : 0.003605365753173828 time for calcul the mask position with numpy : 0.00632023811340332 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001666545867919922 time for calcul the mask position with numpy : 0.006309986114501953 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004279613494873047 time for calcul the mask position with numpy : 0.006365299224853516 nb_pixel_total : 27 time to create 1 rle with old method : 6.389617919921875e-05 time for calcul the mask position with numpy : 0.006339550018310547 nb_pixel_total : 95 time to create 1 rle with old method : 0.00015854835510253906 time for calcul the mask position with numpy : 0.006322383880615234 nb_pixel_total : 286 time to create 1 rle with old method : 0.00033736228942871094 time for calcul the mask position with numpy : 0.0064508914947509766 nb_pixel_total : 252 time to create 1 rle with old method : 0.0002970695495605469 time for calcul the mask position with numpy : 0.00982522964477539 nb_pixel_total : 12 time to create 1 rle with old method : 6.67572021484375e-05 time for calcul the mask position with numpy : 0.0077304840087890625 nb_pixel_total : 415 time to create 1 rle with old method : 0.0006418228149414062 time for calcul the mask position with numpy : 0.006943941116333008 nb_pixel_total : 78 time to create 1 rle with old method : 0.00012421607971191406 time for calcul the mask position with numpy : 0.006000518798828125 nb_pixel_total : 757 time to create 1 rle with old method : 0.000926971435546875 time for calcul the mask position with numpy : 0.006306886672973633 nb_pixel_total : 2713 time to create 1 rle with old method : 0.003263711929321289 time for calcul the mask position with numpy : 0.006491661071777344 nb_pixel_total : 55989 time to create 1 rle with old method : 0.06397128105163574 time for calcul the mask position with numpy : 0.006194353103637695 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0015850067138671875 time for calcul the mask position with numpy : 0.0061187744140625 nb_pixel_total : 1827 time to create 1 rle with old method : 0.0021207332611083984 time for calcul the mask position with numpy : 0.006124019622802734 nb_pixel_total : 239 time to create 1 rle with old method : 0.0002930164337158203 time for calcul the mask position with numpy : 0.006052255630493164 nb_pixel_total : 612 time to create 1 rle with old method : 0.000690460205078125 time for calcul the mask position with numpy : 0.005913734436035156 nb_pixel_total : 2433 time to create 1 rle with old method : 0.002610445022583008 time for calcul the mask position with numpy : 0.005721330642700195 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002396106719970703 time for calcul the mask position with numpy : 0.0058176517486572266 nb_pixel_total : 217 time to create 1 rle with old method : 0.00026798248291015625 time for calcul the mask position with numpy : 0.00592494010925293 nb_pixel_total : 419 time to create 1 rle with old method : 0.000484466552734375 time for calcul the mask position with numpy : 0.0060291290283203125 nb_pixel_total : 78 time to create 1 rle with old method : 0.00011444091796875 time for calcul the mask position with numpy : 0.005556583404541016 nb_pixel_total : 1733 time to create 1 rle with old method : 0.0020399093627929688 time for calcul the mask position with numpy : 0.006064891815185547 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005753040313720703 time for calcul the mask position with numpy : 0.006120443344116211 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006606578826904297 time for calcul the mask position with numpy : 0.0058269500732421875 nb_pixel_total : 1457 time to create 1 rle with old method : 0.0017323493957519531 time for calcul the mask position with numpy : 0.005945682525634766 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0017457008361816406 time for calcul the mask position with numpy : 0.006023883819580078 nb_pixel_total : 37 time to create 1 rle with old method : 5.53131103515625e-05 time for calcul the mask position with numpy : 0.006083250045776367 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006601810455322266 time for calcul the mask position with numpy : 0.0058133602142333984 nb_pixel_total : 710 time to create 1 rle with old method : 0.0007457733154296875 time for calcul the mask position with numpy : 0.005588054656982422 nb_pixel_total : 10404 time to create 1 rle with old method : 0.011372804641723633 time for calcul the mask position with numpy : 0.005902528762817383 nb_pixel_total : 800 time to create 1 rle with old method : 0.0008418560028076172 time for calcul the mask position with numpy : 0.00565791130065918 nb_pixel_total : 131 time to create 1 rle with old method : 0.00018668174743652344 time for calcul the mask position with numpy : 0.005933523178100586 nb_pixel_total : 1280 time to create 1 rle with old method : 0.0015518665313720703 time for calcul the mask position with numpy : 0.006003618240356445 nb_pixel_total : 631 time to create 1 rle with old method : 0.0007390975952148438 time for calcul the mask position with numpy : 0.005954742431640625 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.0060596466064453125 nb_pixel_total : 9920 time to create 1 rle with old method : 0.011143922805786133 time for calcul the mask position with numpy : 0.006410360336303711 nb_pixel_total : 1639 time to create 1 rle with old method : 0.0017333030700683594 time for calcul the mask position with numpy : 0.005957126617431641 nb_pixel_total : 3931 time to create 1 rle with old method : 0.004347801208496094 time for calcul the mask position with numpy : 0.005736351013183594 nb_pixel_total : 344 time to create 1 rle with old method : 0.0003769397735595703 time for calcul the mask position with numpy : 0.005868196487426758 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006158351898193359 time for calcul the mask position with numpy : 0.0060536861419677734 nb_pixel_total : 52 time to create 1 rle with old method : 0.00017070770263671875 time for calcul the mask position with numpy : 0.0057599544525146484 nb_pixel_total : 38 time to create 1 rle with old method : 8.368492126464844e-05 time for calcul the mask position with numpy : 0.006281852722167969 nb_pixel_total : 125 time to create 1 rle with old method : 0.0001614093780517578 time for calcul the mask position with numpy : 0.005972862243652344 nb_pixel_total : 504 time to create 1 rle with old method : 0.0005919933319091797 time for calcul the mask position with numpy : 0.005941152572631836 nb_pixel_total : 1912 time to create 1 rle with old method : 0.002002716064453125 time for calcul the mask position with numpy : 0.005930662155151367 nb_pixel_total : 97 time to create 1 rle with old method : 0.00014138221740722656 time for calcul the mask position with numpy : 0.006028890609741211 nb_pixel_total : 3091 time to create 1 rle with old method : 0.0035462379455566406 time for calcul the mask position with numpy : 0.006071329116821289 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003714561462402344 time for calcul the mask position with numpy : 0.006682634353637695 nb_pixel_total : 1489 time to create 1 rle with old method : 0.002178192138671875 time for calcul the mask position with numpy : 0.006566524505615234 nb_pixel_total : 1394 time to create 1 rle with old method : 0.001650094985961914 time for calcul the mask position with numpy : 0.0063076019287109375 nb_pixel_total : 447 time to create 1 rle with old method : 0.00055694580078125 time for calcul the mask position with numpy : 0.006111621856689453 nb_pixel_total : 145 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.006499052047729492 nb_pixel_total : 105055 time to create 1 rle with old method : 0.12065744400024414 time for calcul the mask position with numpy : 0.005951642990112305 nb_pixel_total : 6547 time to create 1 rle with old method : 0.0071887969970703125 time for calcul the mask position with numpy : 0.005888938903808594 nb_pixel_total : 2158 time to create 1 rle with old method : 0.0025467872619628906 time for calcul the mask position with numpy : 0.005921125411987305 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005395412445068359 time for calcul the mask position with numpy : 0.005896091461181641 nb_pixel_total : 29 time to create 1 rle with old method : 5.745887756347656e-05 time for calcul the mask position with numpy : 0.006291627883911133 nb_pixel_total : 37341 time to create 1 rle with old method : 0.04337358474731445 time for calcul the mask position with numpy : 0.006294965744018555 nb_pixel_total : 1068 time to create 1 rle with old method : 0.0012907981872558594 time for calcul the mask position with numpy : 0.009202957153320312 nb_pixel_total : 2995 time to create 1 rle with old method : 0.0034973621368408203 time for calcul the mask position with numpy : 0.0060634613037109375 nb_pixel_total : 729 time to create 1 rle with old method : 0.0007901191711425781 time for calcul the mask position with numpy : 0.006192922592163086 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008158683776855469 time for calcul the mask position with numpy : 0.005934238433837891 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002167224884033203 time for calcul the mask position with numpy : 0.009932756423950195 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003190040588378906 time for calcul the mask position with numpy : 0.010174989700317383 nb_pixel_total : 3748 time to create 1 rle with old method : 0.004304647445678711 time for calcul the mask position with numpy : 0.010052919387817383 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007357597351074219 time for calcul the mask position with numpy : 0.010006904602050781 nb_pixel_total : 11 time to create 1 rle with old method : 4.124641418457031e-05 time for calcul the mask position with numpy : 0.010140419006347656 nb_pixel_total : 625 time to create 1 rle with old method : 0.0007488727569580078 time for calcul the mask position with numpy : 0.010195493698120117 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004076957702636719 time for calcul the mask position with numpy : 0.009863853454589844 nb_pixel_total : 872 time to create 1 rle with old method : 0.0010404586791992188 time for calcul the mask position with numpy : 0.009994745254516602 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.00914144515991211 nb_pixel_total : 256 time to create 1 rle with old method : 0.0004355907440185547 time for calcul the mask position with numpy : 0.009639263153076172 nb_pixel_total : 20 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.010997295379638672 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004591941833496094 time for calcul the mask position with numpy : 0.015306234359741211 nb_pixel_total : 210 time to create 1 rle with old method : 0.0004227161407470703 time for calcul the mask position with numpy : 0.0101318359375 nb_pixel_total : 526 time to create 1 rle with old method : 0.0008974075317382812 time for calcul the mask position with numpy : 0.008721590042114258 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004036426544189453 time for calcul the mask position with numpy : 0.00863194465637207 nb_pixel_total : 162 time to create 1 rle with old method : 0.00028586387634277344 create new chi : 1.2685420513153076 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0025055408477783203 batch 1 Loaded 81 chid ids of type : 4230 Number RLEs to save : 9530 TO DO : save crop sub photo not yet done ! save time : 0.5894381999969482 nb_obj : 81 nb_hashtags : 6 time to prepare the origin masks : 1.5423736572265625 time for calcul the mask position with numpy : 0.11040234565734863 nb_pixel_total : 1790736 time to create 1 rle with new method : 0.10304546356201172 time for calcul the mask position with numpy : 0.009784698486328125 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006289482116699219 time for calcul the mask position with numpy : 0.009826898574829102 nb_pixel_total : 6185 time to create 1 rle with old method : 0.006815195083618164 time for calcul the mask position with numpy : 0.010082483291625977 nb_pixel_total : 70266 time to create 1 rle with old method : 0.08116865158081055 time for calcul the mask position with numpy : 0.009754180908203125 nb_pixel_total : 74 time to create 1 rle with old method : 0.00013065338134765625 time for calcul the mask position with numpy : 0.009935617446899414 nb_pixel_total : 392 time to create 1 rle with old method : 0.0004966259002685547 time for calcul the mask position with numpy : 0.009756803512573242 nb_pixel_total : 94 time to create 1 rle with old method : 0.00014400482177734375 time for calcul the mask position with numpy : 0.009631633758544922 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005056858062744141 time for calcul the mask position with numpy : 0.009500265121459961 nb_pixel_total : 95 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.009618759155273438 nb_pixel_total : 826 time to create 1 rle with old method : 0.0009772777557373047 time for calcul the mask position with numpy : 0.009775400161743164 nb_pixel_total : 836 time to create 1 rle with old method : 0.001003265380859375 time for calcul the mask position with numpy : 0.009829044342041016 nb_pixel_total : 262 time to create 1 rle with old method : 0.00031757354736328125 time for calcul the mask position with numpy : 0.0058858394622802734 nb_pixel_total : 2734 time to create 1 rle with old method : 0.0031783580780029297 time for calcul the mask position with numpy : 0.005797386169433594 nb_pixel_total : 350 time to create 1 rle with old method : 0.00042748451232910156 time for calcul the mask position with numpy : 0.0064814090728759766 nb_pixel_total : 1845 time to create 1 rle with old method : 0.0020842552185058594 time for calcul the mask position with numpy : 0.006325244903564453 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002257823944091797 time for calcul the mask position with numpy : 0.006690502166748047 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003752708435058594 time for calcul the mask position with numpy : 0.007617473602294922 nb_pixel_total : 268 time to create 1 rle with old method : 0.00048351287841796875 time for calcul the mask position with numpy : 0.006743907928466797 nb_pixel_total : 702 time to create 1 rle with old method : 0.0012123584747314453 time for calcul the mask position with numpy : 0.006598234176635742 nb_pixel_total : 14 time to create 1 rle with old method : 6.079673767089844e-05 time for calcul the mask position with numpy : 0.006780862808227539 nb_pixel_total : 1281 time to create 1 rle with old method : 0.002221822738647461 time for calcul the mask position with numpy : 0.01196908950805664 nb_pixel_total : 442 time to create 1 rle with old method : 0.0007627010345458984 time for calcul the mask position with numpy : 0.012088775634765625 nb_pixel_total : 43 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.011661767959594727 nb_pixel_total : 485 time to create 1 rle with old method : 0.0008485317230224609 time for calcul the mask position with numpy : 0.01211237907409668 nb_pixel_total : 32 time to create 1 rle with old method : 0.00011920928955078125 time for calcul the mask position with numpy : 0.006741762161254883 nb_pixel_total : 1747 time to create 1 rle with old method : 0.0020487308502197266 time for calcul the mask position with numpy : 0.006244659423828125 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006549358367919922 time for calcul the mask position with numpy : 0.005990028381347656 nb_pixel_total : 15786 time to create 1 rle with old method : 0.017819643020629883 time for calcul the mask position with numpy : 0.006151437759399414 nb_pixel_total : 740 time to create 1 rle with old method : 0.0008494853973388672 time for calcul the mask position with numpy : 0.006874561309814453 nb_pixel_total : 797 time to create 1 rle with old method : 0.0009617805480957031 time for calcul the mask position with numpy : 0.006148099899291992 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003139972686767578 time for calcul the mask position with numpy : 0.006229400634765625 nb_pixel_total : 136 time to create 1 rle with old method : 0.00018715858459472656 time for calcul the mask position with numpy : 0.007124900817871094 nb_pixel_total : 284 time to create 1 rle with old method : 0.000431060791015625 time for calcul the mask position with numpy : 0.006290912628173828 nb_pixel_total : 1926 time to create 1 rle with old method : 0.0023164749145507812 time for calcul the mask position with numpy : 0.006304502487182617 nb_pixel_total : 111 time to create 1 rle with old method : 0.00016546249389648438 time for calcul the mask position with numpy : 0.006132364273071289 nb_pixel_total : 1278 time to create 1 rle with old method : 0.001432657241821289 time for calcul the mask position with numpy : 0.006145000457763672 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006160736083984375 time for calcul the mask position with numpy : 0.006257057189941406 nb_pixel_total : 307 time to create 1 rle with old method : 0.00038623809814453125 time for calcul the mask position with numpy : 0.0059735774993896484 nb_pixel_total : 306 time to create 1 rle with old method : 0.00038170814514160156 time for calcul the mask position with numpy : 0.005925178527832031 nb_pixel_total : 3883 time to create 1 rle with old method : 0.004551887512207031 time for calcul the mask position with numpy : 0.0059397220611572266 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007569789886474609 time for calcul the mask position with numpy : 0.0058345794677734375 nb_pixel_total : 227 time to create 1 rle with old method : 0.000278472900390625 time for calcul the mask position with numpy : 0.009706258773803711 nb_pixel_total : 1083 time to create 1 rle with old method : 0.0013573169708251953 time for calcul the mask position with numpy : 0.010159969329833984 nb_pixel_total : 50 time to create 1 rle with old method : 9.298324584960938e-05 time for calcul the mask position with numpy : 0.00995635986328125 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004334449768066406 time for calcul the mask position with numpy : 0.009697437286376953 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005028247833251953 time for calcul the mask position with numpy : 0.009539604187011719 nb_pixel_total : 1 time to create 1 rle with old method : 2.0265579223632812e-05 time for calcul the mask position with numpy : 0.009517431259155273 nb_pixel_total : 1485 time to create 1 rle with old method : 0.001680612564086914 time for calcul the mask position with numpy : 0.009656906127929688 nb_pixel_total : 2995 time to create 1 rle with old method : 0.003451824188232422 time for calcul the mask position with numpy : 0.00948333740234375 nb_pixel_total : 12 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.010145902633666992 nb_pixel_total : 294 time to create 1 rle with old method : 0.00033545494079589844 time for calcul the mask position with numpy : 0.010112285614013672 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0016231536865234375 time for calcul the mask position with numpy : 0.010097742080688477 nb_pixel_total : 588 time to create 1 rle with old method : 0.0006957054138183594 time for calcul the mask position with numpy : 0.010560989379882812 nb_pixel_total : 133 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.010591268539428711 nb_pixel_total : 26 time to create 1 rle with old method : 6.175041198730469e-05 time for calcul the mask position with numpy : 0.010764598846435547 nb_pixel_total : 103590 time to create 1 rle with old method : 0.11559724807739258 time for calcul the mask position with numpy : 0.010239839553833008 nb_pixel_total : 38330 time to create 1 rle with old method : 0.04107069969177246 time for calcul the mask position with numpy : 0.010012388229370117 nb_pixel_total : 34 time to create 1 rle with old method : 8.535385131835938e-05 time for calcul the mask position with numpy : 0.010006904602050781 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005254745483398438 time for calcul the mask position with numpy : 0.009857892990112305 nb_pixel_total : 2985 time to create 1 rle with old method : 0.003518819808959961 time for calcul the mask position with numpy : 0.009761333465576172 nb_pixel_total : 68 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.009680509567260742 nb_pixel_total : 7 time to create 1 rle with old method : 3.886222839355469e-05 time for calcul the mask position with numpy : 0.009803056716918945 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007860660552978516 time for calcul the mask position with numpy : 0.009864568710327148 nb_pixel_total : 164 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.006033897399902344 nb_pixel_total : 265 time to create 1 rle with old method : 0.00033473968505859375 time for calcul the mask position with numpy : 0.006089448928833008 nb_pixel_total : 3826 time to create 1 rle with old method : 0.0044708251953125 time for calcul the mask position with numpy : 0.006018161773681641 nb_pixel_total : 616 time to create 1 rle with old method : 0.0007407665252685547 time for calcul the mask position with numpy : 0.006061077117919922 nb_pixel_total : 1555 time to create 1 rle with old method : 0.0018188953399658203 time for calcul the mask position with numpy : 0.006085634231567383 nb_pixel_total : 57 time to create 1 rle with old method : 0.00010132789611816406 time for calcul the mask position with numpy : 0.006133317947387695 nb_pixel_total : 940 time to create 1 rle with old method : 0.0013823509216308594 time for calcul the mask position with numpy : 0.009443044662475586 nb_pixel_total : 24 time to create 1 rle with old method : 7.319450378417969e-05 time for calcul the mask position with numpy : 0.0060312747955322266 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003402233123779297 time for calcul the mask position with numpy : 0.005858182907104492 nb_pixel_total : 274 time to create 1 rle with old method : 0.00031638145446777344 time for calcul the mask position with numpy : 0.009259462356567383 nb_pixel_total : 252 time to create 1 rle with old method : 0.00030994415283203125 time for calcul the mask position with numpy : 0.00930929183959961 nb_pixel_total : 228 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.012677907943725586 nb_pixel_total : 46 time to create 1 rle with old method : 9.202957153320312e-05 time for calcul the mask position with numpy : 0.009101390838623047 nb_pixel_total : 10 time to create 1 rle with old method : 3.4332275390625e-05 time for calcul the mask position with numpy : 0.0089874267578125 nb_pixel_total : 43 time to create 1 rle with old method : 8.726119995117188e-05 time for calcul the mask position with numpy : 0.009074211120605469 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.009245872497558594 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007750988006591797 time for calcul the mask position with numpy : 0.00904083251953125 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004398822784423828 time for calcul the mask position with numpy : 0.0077245235443115234 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002002716064453125 create new chi : 1.231844186782837 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.002129077911376953 batch 1 Loaded 82 chid ids of type : 4230 Number RLEs to save : 8897 TO DO : save crop sub photo not yet done ! save time : 0.5329630374908447 map_output_result : {1340531863: (0.0, 'Should be the crop_list due to order', 0.0), 1340531860: (0.0, 'Should be the crop_list due to order', 0.0), 1340531854: (0.0, 'Should be the crop_list due to order', 0.0), 1340531839: (0.0, 'Should be the crop_list due to order', 0.0), 1340531838: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340531863, 1340531860, 1340531854, 1340531839, 1340531838] Looping around the photos to save general results len do output : 5 /1340531863.Didn't retrieve data . /1340531860.Didn't retrieve data . /1340531854.Didn't retrieve data . /1340531839.Didn't retrieve data . /1340531838.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531863', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531860', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531854', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531839', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531838', None, None, None, None, None, '2627713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013912439346313477 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.985896110534668 time spend to save output : 0.014288187026977539 total time spend for step 4 : 18.000184297561646 step5:crop_condition Mon Mar 3 00:21:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 387 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 118 About to insert : list_path_to_insert length 118 new photo from crops ! About to upload 118 photos upload in portfolio : 4869462 init cache_photo without model_param we have 118 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740957691_3649848 we have uploaded 118 photos in the portfolio 4869462 time of upload the photos Elapsed time : 34.45371413230896 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 4869462 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740957726_3649848 we have uploaded 23 photos in the portfolio 4869462 time of upload the photos Elapsed time : 5.484552383422852 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740957732_3649848 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.9782624244689941 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 4869462 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740957733_3649848 we have uploaded 23 photos in the portfolio 4869462 time of upload the photos Elapsed time : 13.445480346679688 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 86 About to insert : list_path_to_insert length 86 new photo from crops ! About to upload 86 photos upload in portfolio : 4869462 init cache_photo without model_param we have 86 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740957749_3649848 we have uploaded 86 photos in the portfolio 4869462 time of upload the photos Elapsed time : 23.26188611984253 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340531863, 1340531860, 1340531854, 1340531839, 1340531838] Looping around the photos to save general results len do output : 253 /1340553397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340553662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531863', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531860', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531854', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531839', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531838', None, None, None, None, None, '2627713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 764 time used for this insertion : 0.06604528427124023 save_final save missing photos in datou_result : time spend for datou_step_exec : 83.16026091575623 time spend to save output : 0.07310914993286133 total time spend for step 5 : 83.23337006568909 step6:thcl Mon Mar 3 00:22:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.004880666732788086 time to convert the images to numpy array : 0.016881227493286133 time to import caffe and check if the image exist : 0.02706766128540039 time to convert the images to numpy array : 0.05979442596435547 time to import caffe and check if the image exist : 0.02240133285522461 time to convert the images to numpy array : 0.07468676567077637 time to import caffe and check if the image exist : 0.02670907974243164 time to convert the images to numpy array : 0.07665634155273438 time to import caffe and check if the image exist : 0.025969266891479492 time to convert the images to numpy array : 0.07867956161499023 time to import caffe and check if the image exist : 0.021376371383666992 time to convert the images to numpy array : 0.08362197875976562 time to import caffe and check if the image exist : 0.024163246154785156 time to convert the images to numpy array : 0.0842597484588623 time to import caffe and check if the image exist : 0.04332995414733887 time to convert the images to numpy array : 0.06856799125671387 time to import caffe and check if the image exist : 0.04050278663635254 time to convert the images to numpy array : 0.07268977165222168 time to import caffe and check if the image exist : 0.03986239433288574 time to convert the images to numpy array : 0.07446765899658203 total time to convert the images to numpy array : 0.5499327182769775 list photo_ids error: [] list photo_ids correct : [1340553477, 1340553478, 1340553479, 1340553480, 1340553481, 1340553482, 1340553483, 1340553484, 1340553485, 1340553486, 1340553487, 1340553488, 1340553489, 1340553490, 1340553491, 1340553492, 1340553493, 1340553494, 1340553495, 1340553496, 1340553497, 1340553498, 1340553499, 1340553500, 1340553501, 1340553502, 1340553644, 1340553645, 1340553646, 1340553647, 1340553648, 1340553649, 1340553650, 1340553651, 1340553652, 1340553653, 1340553654, 1340553655, 1340553656, 1340553657, 1340553658, 1340553659, 1340553660, 1340553661, 1340553662, 1340553423, 1340553424, 1340553425, 1340553427, 1340553428, 1340553429, 1340553430, 1340553431, 1340553432, 1340553433, 1340553434, 1340553435, 1340553436, 1340553437, 1340553438, 1340553440, 1340553441, 1340553442, 1340553443, 1340553444, 1340553445, 1340553446, 1340553447, 1340553448, 1340553449, 1340553450, 1340553503, 1340553504, 1340553505, 1340553506, 1340553507, 1340553508, 1340553509, 1340553510, 1340553511, 1340553512, 1340553513, 1340553514, 1340553515, 1340553516, 1340553518, 1340553519, 1340553520, 1340553521, 1340553522, 1340553523, 1340553524, 1340553525, 1340553526, 1340553527, 1340553528, 1340553529, 1340553397, 1340553398, 1340553399, 1340553400, 1340553401, 1340553402, 1340553403, 1340553404, 1340553405, 1340553406, 1340553407, 1340553408, 1340553409, 1340553410, 1340553411, 1340553412, 1340553413, 1340553414, 1340553415, 1340553416, 1340553417, 1340553418, 1340553419, 1340553420, 1340553421, 1340553422, 1340553559, 1340553560, 1340553561, 1340553562, 1340553563, 1340553564, 1340553565, 1340553566, 1340553567, 1340553568, 1340553569, 1340553576, 1340553577, 1340553578, 1340553579, 1340553580, 1340553581, 1340553582, 1340553583, 1340553584, 1340553586, 1340553587, 1340553588, 1340553589, 1340553590, 1340553591, 1340553530, 1340553531, 1340553532, 1340553533, 1340553534, 1340553535, 1340553536, 1340553537, 1340553538, 1340553540, 1340553541, 1340553542, 1340553543, 1340553544, 1340553546, 1340553547, 1340553548, 1340553549, 1340553550, 1340553552, 1340553553, 1340553554, 1340553555, 1340553556, 1340553557, 1340553558, 1340553592, 1340553593, 1340553594, 1340553595, 1340553596, 1340553597, 1340553598, 1340553599, 1340553600, 1340553601, 1340553602, 1340553603, 1340553604, 1340553605, 1340553606, 1340553607, 1340553608, 1340553609, 1340553610, 1340553611, 1340553612, 1340553613, 1340553614, 1340553615, 1340553616, 1340553617, 1340553451, 1340553452, 1340553453, 1340553454, 1340553455, 1340553456, 1340553457, 1340553458, 1340553459, 1340553460, 1340553461, 1340553462, 1340553463, 1340553464, 1340553465, 1340553466, 1340553467, 1340553468, 1340553469, 1340553470, 1340553471, 1340553472, 1340553473, 1340553474, 1340553475, 1340553476, 1340553618, 1340553619, 1340553620, 1340553621, 1340553622, 1340553623, 1340553624, 1340553625, 1340553626, 1340553627, 1340553628, 1340553629, 1340553630, 1340553631, 1340553632, 1340553633, 1340553634, 1340553635, 1340553636, 1340553637, 1340553638, 1340553639, 1340553640, 1340553641, 1340553642, 1340553643] number of photos to traite : 253 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2732 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2513 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.1454927921295166 time used to do the prediction : 1.0262584686279297 save descriptor for thcl : 3237 time to traite the descriptors : 1.4122083187103271 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340553477 To insert : 1340553478 To insert : 1340553479 To insert : 1340553480 To insert : 1340553481 To insert : 1340553482 To insert : 1340553483 To insert : 1340553484 To insert : 1340553485 To insert : 1340553486 To insert : 1340553487 To insert : 1340553488 To insert : 1340553489 To insert : 1340553490 To insert : 1340553491 To insert : 1340553492 To insert : 1340553493 To insert : 1340553494 To insert : 1340553495 To insert : 1340553496 To insert : 1340553497 To insert : 1340553498 To insert : 1340553499 To insert : 1340553500 To insert : 1340553501 To insert : 1340553502 To insert : 1340553644 To insert : 1340553645 To insert : 1340553646 To insert : 1340553647 To insert : 1340553648 To insert : 1340553649 To insert : 1340553650 To insert : 1340553651 To insert : 1340553652 To insert : 1340553653 To insert : 1340553654 To insert : 1340553655 To insert : 1340553656 To insert : 1340553657 To insert : 1340553658 To insert : 1340553659 To insert : 1340553660 To insert : 1340553661 To insert : 1340553662 To insert : 1340553423 To insert : 1340553424 To insert : 1340553425 To insert : 1340553427 To insert : 1340553428 To insert : 1340553429 To insert : 1340553430 To insert : 1340553431 To insert : 1340553432 To insert : 1340553433 To insert : 1340553434 To insert : 1340553435 To insert : 1340553436 To insert : 1340553437 To insert : 1340553438 To insert : 1340553440 To insert : 1340553441 To insert : 1340553442 To insert : 1340553443 To insert : 1340553444 To insert : 1340553445 To insert : 1340553446 To insert : 1340553447 To insert : 1340553448 To insert : 1340553449 To insert : 1340553450 To insert : 1340553503 To insert : 1340553504 To insert : 1340553505 To insert : 1340553506 To insert : 1340553507 To insert : 1340553508 To insert : 1340553509 To insert : 1340553510 To insert : 1340553511 To insert : 1340553512 To insert : 1340553513 To insert : 1340553514 To insert : 1340553515 To insert : 1340553516 To insert : 1340553518 To insert : 1340553519 To insert : 1340553520 To insert : 1340553521 To insert : 1340553522 To insert : 1340553523 To insert : 1340553524 To insert : 1340553525 To insert : 1340553526 To insert : 1340553527 To insert : 1340553528 To insert : 1340553529 To insert : 1340553397 To insert : 1340553398 To insert : 1340553399 To insert : 1340553400 To insert : 1340553401 To insert : 1340553402 To insert : 1340553403 To insert : 1340553404 To insert : 1340553405 To insert : 1340553406 To insert : 1340553407 To insert : 1340553408 To insert : 1340553409 To insert : 1340553410 To insert : 1340553411 To insert : 1340553412 To insert : 1340553413 To insert : 1340553414 To insert : 1340553415 To insert : 1340553416 To insert : 1340553417 To insert : 1340553418 To insert : 1340553419 To insert : 1340553420 To insert : 1340553421 To insert : 1340553422 To insert : 1340553559 To insert : 1340553560 To insert : 1340553561 To insert : 1340553562 To insert : 1340553563 To insert : 1340553564 To insert : 1340553565 To insert : 1340553566 To insert : 1340553567 To insert : 1340553568 To insert : 1340553569 To insert : 1340553576 To insert : 1340553577 To insert : 1340553578 To insert : 1340553579 To insert : 1340553580 To insert : 1340553581 To insert : 1340553582 To insert : 1340553583 To insert : 1340553584 To insert : 1340553586 To insert : 1340553587 To insert : 1340553588 To insert : 1340553589 To insert : 1340553590 To insert : 1340553591 To insert : 1340553530 To insert : 1340553531 To insert : 1340553532 To insert : 1340553533 To insert : 1340553534 To insert : 1340553535 To insert : 1340553536 To insert : 1340553537 To insert : 1340553538 To insert : 1340553540 To insert : 1340553541 To insert : 1340553542 To insert : 1340553543 To insert : 1340553544 To insert : 1340553546 To insert : 1340553547 To insert : 1340553548 To insert : 1340553549 To insert : 1340553550 To insert : 1340553552 To insert : 1340553553 To insert : 1340553554 To insert : 1340553555 To insert : 1340553556 To insert : 1340553557 To insert : 1340553558 To insert : 1340553592 To insert : 1340553593 To insert : 1340553594 To insert : 1340553595 To insert : 1340553596 To insert : 1340553597 To insert : 1340553598 To insert : 1340553599 To insert : 1340553600 To insert : 1340553601 To insert : 1340553602 To insert : 1340553603 To insert : 1340553604 To insert : 1340553605 To insert : 1340553606 To insert : 1340553607 To insert : 1340553608 To insert : 1340553609 To insert : 1340553610 To insert : 1340553611 To insert : 1340553612 To insert : 1340553613 To insert : 1340553614 To insert : 1340553615 To insert : 1340553616 To insert : 1340553617 To insert : 1340553451 To insert : 1340553452 To insert : 1340553453 To insert : 1340553454 To insert : 1340553455 To insert : 1340553456 To insert : 1340553457 To insert : 1340553458 To insert : 1340553459 To insert : 1340553460 To insert : 1340553461 To insert : 1340553462 To insert : 1340553463 To insert : 1340553464 To insert : 1340553465 To insert : 1340553466 To insert : 1340553467 To insert : 1340553468 To insert : 1340553469 To insert : 1340553470 To insert : 1340553471 To insert : 1340553472 To insert : 1340553473 To insert : 1340553474 To insert : 1340553475 To insert : 1340553476 To insert : 1340553618 To insert : 1340553619 To insert : 1340553620 To insert : 1340553621 To insert : 1340553622 To insert : 1340553623 To insert : 1340553624 To insert : 1340553625 To insert : 1340553626 To insert : 1340553627 To insert : 1340553628 To insert : 1340553629 To insert : 1340553630 To insert : 1340553631 To insert : 1340553632 To insert : 1340553633 To insert : 1340553634 To insert : 1340553635 To insert : 1340553636 To insert : 1340553637 To insert : 1340553638 To insert : 1340553639 To insert : 1340553640 To insert : 1340553641 To insert : 1340553642 To insert : 1340553643 time to insert the descriptors : 53.60285663604736 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 382 time used for this insertion : 0.029140949249267578 save missing photos in datou_result : time spend for datou_step_exec : 61.8039608001709 time spend to save output : 0.07715320587158203 total time spend for step 6 : 61.88111400604248 step7:ventilate_hashtags_in_portfolio Mon Mar 3 00:23:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20957652 get user id for portfolio 20957652 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957652 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','PEHD','pehd','pet_fonce','papier','refus','Tetrapak','Film_plastique','autre','environnement','metal','flou','Carton','PET_clair','PET_fonce','Papier','mal_croppe')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957652 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','PEHD','pehd','pet_fonce','papier','refus','Tetrapak','Film_plastique','autre','environnement','metal','flou','Carton','PET_clair','PET_fonce','Papier','mal_croppe')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957652 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','PEHD','pehd','pet_fonce','papier','refus','Tetrapak','Film_plastique','autre','environnement','metal','flou','Carton','PET_clair','PET_fonce','Papier','mal_croppe')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957652 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','PEHD','pehd','pet_fonce','papier','refus','Tetrapak','Film_plastique','autre','environnement','metal','flou','Carton','PET_clair','PET_fonce','Papier','mal_croppe')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20957856,20957855,20957845,20957857,20957858,20957848,20957849,20957850,20957851,20957852,20957853,20957854,20957859?tags=pet_clair,carton,pehd,pet_fonce,papier,refus,tetrapak,film_plastique,autre,environnement,metal,flou,mal_croppe&datou_id_consolidate=4235&port_consolidate=20957652 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340531863, 1340531860, 1340531854, 1340531839, 1340531838] Looping around the photos to save general results len do output : 1 /20957652. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531863', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531860', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531854', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531839', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531838', None, None, None, None, None, '2627713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013994216918945312 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2937674522399902 time spend to save output : 0.014291763305664062 total time spend for step 7 : 2.3080592155456543 step8:final Mon Mar 3 00:23:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340531863: ('0.226379050188812',), 1340531860: ('0.226379050188812',), 1340531854: ('0.226379050188812',), 1340531839: ('0.226379050188812',), 1340531838: ('0.226379050188812',)} new output for save of step final : {1340531863: ('0.226379050188812',), 1340531860: ('0.226379050188812',), 1340531854: ('0.226379050188812',), 1340531839: ('0.226379050188812',), 1340531838: ('0.226379050188812',)} [1340531863, 1340531860, 1340531854, 1340531839, 1340531838] Looping around the photos to save general results len do output : 5 /1340531863.Didn't retrieve data . /1340531860.Didn't retrieve data . /1340531854.Didn't retrieve data . /1340531839.Didn't retrieve data . /1340531838.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531863', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531860', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531854', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531839', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531838', None, None, None, None, None, '2627713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01235818862915039 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12392902374267578 time spend to save output : 0.012735605239868164 total time spend for step 8 : 0.13666462898254395 step9:velours_tree Mon Mar 3 00:23:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20957856,20957855,20957845,20957857,20957858,20957848,20957849,20957850,20957851,20957852,20957853,20957854,20957859 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957856 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957855 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957845 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957857 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957858 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957848 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957849 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957850 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957851 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957852 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957853 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957854 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957859 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 253 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 4 1 3 1 2 0 2 0 0 3 0 1 2 0 0 0 2 3 5 4 1 1 3 1 1 2 0 2 0 3 0 3 3 2 1 0 0 0 2 2 3 3 2 2 2 4 1 3 0 5 1 2 2 3 0 2 0 0 3 3 1 0 0 0 2 3 2 5 4 1 3 1 3 1 1 2 3 0 2 2 3 0 0 0 3 3 1 1 2 0 0 0 0 2 3 2 4 1 3 1 2 0 2 0 0 3 3 1 0 0 0 0 2 3 3 2 2 3 3 3 2 2 5 3 3 2 2 2 5 3 2 5 3 3 2 2 2 2 2 2 1 1 1 3 1 3 3 3 0 3 2 1 3 3 0 2 1 3 3 0 3 3 0 0 1 0 5 1 4 3 1 0 2 2 1 5 0 2 1 1 2 2 2 5 5 1 4 2 2 3 1 0 2 2 1 5 0 1 1 2 2 5 5 5 3 1 4 3 0 2 0 1 5 1 2 1 2 5 5 5 1 3 0 2 2 2 0 1 3 5 1 1 2 2 2 5 5 1 4 3 1 0 2 2 0 2 1 5 0 1 1 2] Elapsed time: 0.04118490219116211 graph_id used : 81065 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20957856,20957855,20957845,20957857,20957858,20957848,20957849,20957850,20957851,20957852,20957853,20957854,20957859?tags=pet_clair,carton,pehd,pet_fonce,papier,refus,tetrapak,film_plastique,autre,environnement,metal,flou,mal_croppe&datou_id_consolidate=4235&port_consolidate=20957652&tree_id=81065 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340531863, 1340531860, 1340531854, 1340531839, 1340531838] Looping around the photos to save general results len do output : 1 /20957652Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531863', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531860', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531854', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531839', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531838', None, None, None, None, None, '2627713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014658927917480469 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.482022285461426 time spend to save output : 0.1177988052368164 total time spend for step 9 : 16.599821090698242 step10:send_mail_cod Mon Mar 3 00:24:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20957652_03-03-2025_00_24_13.pdf 20957838 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209578381740957853 20957837 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209578371740957854 20957827 imagette209578271740957855 20957839 imagette209578391740957855 20957840 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209578401740957855 20957830 imagette209578301740957856 20957831 imagette209578311740957856 20957832 imagette209578321740957856 20957833 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209578331740957856 20957835 change filename to text .change filename to text .change filename to text .imagette209578351740957857 20957836 imagette209578361740957857 20957841 imagette209578411740957857 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20957652 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20957856,20957855,20957845,20957857,20957858,20957848,20957849,20957850,20957851,20957852,20957853,20957854,20957859?tags=pet_clair,carton,pehd,pet_fonce,papier,refus,tetrapak,film_plastique,autre,environnement,metal,flou,mal_croppe&datou_id_consolidate=4235&port_consolidate=20957652&tree_id=81065 your option no_mail is active, we will not send the real mail to your client args[1340531863] : ((1340531863, -7.493017494540149, 492609224), (1340531863, -0.5627916302410089, 501862349), '0.226379050188812') We are sending mail with results at cod@fotonower.com args[1340531860] : ((1340531860, -7.49966880629878, 492609224), (1340531860, -0.5584008875362302, 501862349), '0.226379050188812') We are sending mail with results at cod@fotonower.com args[1340531854] : ((1340531854, -7.490771693496328, 492609224), (1340531854, -0.5593445476611715, 501862349), '0.226379050188812') We are sending mail with results at cod@fotonower.com args[1340531839] : ((1340531839, -7.492886147534862, 492609224), (1340531839, -0.5594791816654929, 501862349), '0.226379050188812') We are sending mail with results at cod@fotonower.com args[1340531838] : ((1340531838, -7.4933372632378905, 492609224), (1340531838, -0.5589185784438001, 501862349), '0.226379050188812') We are sending mail with results at cod@fotonower.com refus_total : 0.226379050188812 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957652 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957652_03-03-2025_00_24_13.pdf results_Qualipapia_P20957652_03-03-2025_00_24_13.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957652_03-03-2025_00_24_13.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20957652','results_Qualipapia_P20957652_03-03-2025_00_24_13.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957652_03-03-2025_00_24_13.pdf','pdf','','0.19','0.226379050188812') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340531863, 1340531860, 1340531854, 1340531839, 1340531838] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531863', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531860', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531854', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531839', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531838', None, None, None, None, None, '2627713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013696670532226562 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.1109397411346436 time spend to save output : 0.014027595520019531 total time spend for step 10 : 5.124967336654663 step11:split_time_score Mon Mar 3 00:24:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02032025 20957652 Nombre de photos uploadées : 8 / 23040 (0%) 02032025 20957652 Nombre de photos taguées (types de déchets): 8 / 8 (100%) 02032025 20957652 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 5.245208740234375e-06 elapsed_time : order_list_meta_photo_and_scores 8.344650268554688e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004069805145263672 elapsed_time : insert_dashboard_record_day_entry 0.02233600616455078 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957601 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957602 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957603 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957604 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957605 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957606 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957607 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957609 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957610 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957611 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957612 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957613 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957614 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957615 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957616 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957617 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957618 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957619 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957620 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957621 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957622 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957623 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957624 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957625 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957626 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957627 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957628 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957629 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957630 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957631 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957632 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957633 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957634 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957635 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957636 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957637 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957638 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957639 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957640 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957641 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957642 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957643 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957644 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957645 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957646 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957647 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957648 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957649 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957650 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957651 order by id desc limit 1 Qualite : 0.226379050188812 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957652_03-03-2025_00_24_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957652 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957652 AND mptpi.`type`=4230 To do Qualite : 0.21121739094852754 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957653_03-03-2025_00_18_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957653 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957653 AND mptpi.`type`=4230 To do Qualite : 0.22036621398782735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957654_03-03-2025_00_12_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957654 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957654 AND mptpi.`type`=4230 To do Qualite : 0.20524542589930503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957655_03-03-2025_00_17_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957655 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957655 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02032025': {'nb_upload': 8, 'nb_taggue_class': 8, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340531863, 1340531860, 1340531854, 1340531839, 1340531838] Looping around the photos to save general results len do output : 1 /20957652Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531863', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531860', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531854', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531839', None, None, None, None, None, '2627713') ('4234', None, None, None, None, None, None, None, '2627713') ('4234', '20957652', '1340531838', None, None, None, None, None, '2627713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015239953994750977 save_final save missing photos in datou_result : time spend for datou_step_exec : 38.79997253417969 time spend to save output : 0.015398502349853516 total time spend for step 11 : 38.81537103652954 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 55.10user 36.69system 4:31.92elapsed 33%CPU (0avgtext+0avgdata 2501012maxresident)k 1165424inputs+20360outputs (1960major+2897301minor)pagefaults 0swaps