python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 665513 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2637423'] with mtr_portfolio_ids : ['21058682'] and first list_photo_ids : [] new path : /proc/665513/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.5068130493164062 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Wed Mar 5 11:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-05 11:20:32.652096: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-05 11:20:32.679119: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-05 11:20:32.681383: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff8bc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-05 11:20:32.681439: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-05 11:20:32.686476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-05 11:20:33.000500: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x43aa2ab0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-05 11:20:33.000612: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-05 11:20:33.002730: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 11:20:33.003603: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 11:20:33.007244: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 11:20:33.010722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 11:20:33.011344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 11:20:33.015071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 11:20:33.016856: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 11:20:33.026838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 11:20:33.029348: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 11:20:33.029489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 11:20:33.030844: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-05 11:20:33.030874: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-05 11:20:33.030887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-05 11:20:33.033381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9673 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-05 11:20:33.367277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 11:20:33.367371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 11:20:33.367393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 11:20:33.367411: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 11:20:33.367429: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 11:20:33.367447: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 11:20:33.367465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 11:20:33.367482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 11:20:33.369534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 11:20:33.371630: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 11:20:33.371735: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 11:20:33.371767: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 11:20:33.371797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 11:20:33.371826: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 11:20:33.371854: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 11:20:33.371882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 11:20:33.371911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 11:20:33.373981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 11:20:33.374058: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-05 11:20:33.374078: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-05 11:20:33.374093: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-05 11:20:33.376325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9673 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-05 11:20:42.092340: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 11:20:42.378522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.16484 max: 149.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 1257 time to create 1 rle with old method : 0.0022649765014648438 length of segment : 42 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0013148784637451172 length of segment : 49 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 1266 time to create 1 rle with old method : 0.015334606170654297 length of segment : 36 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0010180473327636719 length of segment : 55 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0004763603210449219 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.88359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 408 time to create 1 rle with old method : 0.0008056163787841797 length of segment : 25 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 1773 time to create 1 rle with old method : 0.0035011768341064453 length of segment : 71 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 2016 time to create 1 rle with old method : 0.0038962364196777344 length of segment : 39 time for calcul the mask position with numpy : 0.0001125335693359375 nb_pixel_total : 1065 time to create 1 rle with old method : 0.0021200180053710938 length of segment : 33 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0020265579223632812 length of segment : 33 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 956 time to create 1 rle with old method : 0.0019381046295166016 length of segment : 43 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 4920 time to create 1 rle with old method : 0.009382247924804688 length of segment : 82 time for calcul the mask position with numpy : 0.00022912025451660156 nb_pixel_total : 5813 time to create 1 rle with old method : 0.010864973068237305 length of segment : 176 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 382 time to create 1 rle with old method : 0.0007944107055664062 length of segment : 18 time for calcul the mask position with numpy : 0.0002048015594482422 nb_pixel_total : 5446 time to create 1 rle with old method : 0.009979248046875 length of segment : 101 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 625 time to create 1 rle with old method : 0.0014438629150390625 length of segment : 41 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 1052 time to create 1 rle with old method : 0.002166271209716797 length of segment : 35 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00027489662170410156 length of segment : 29 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0004544258117675781 length of segment : 27 time for calcul the mask position with numpy : 0.00020551681518554688 nb_pixel_total : 5447 time to create 1 rle with old method : 0.010081768035888672 length of segment : 107 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.86406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.0002372264862060547 nb_pixel_total : 2088 time to create 1 rle with old method : 0.004742622375488281 length of segment : 74 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.001092672348022461 length of segment : 39 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1378 time to create 1 rle with old method : 0.0016884803771972656 length of segment : 50 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0006532669067382812 length of segment : 26 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1221 time to create 1 rle with old method : 0.0015838146209716797 length of segment : 32 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1187 time to create 1 rle with old method : 0.0015683174133300781 length of segment : 32 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1226 time to create 1 rle with old method : 0.001644134521484375 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.23125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0007998943328857422 length of segment : 16 time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 3795 time to create 1 rle with old method : 0.006050825119018555 length of segment : 107 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.000766754150390625 length of segment : 26 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005958080291748047 length of segment : 25 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 2703 time to create 1 rle with old method : 0.003648996353149414 length of segment : 114 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.42031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0008070468902587891 length of segment : 18 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 910 time to create 1 rle with old method : 0.0012695789337158203 length of segment : 68 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 1629 time to create 1 rle with old method : 0.002601146697998047 length of segment : 93 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 5105 time to create 1 rle with old method : 0.006643533706665039 length of segment : 56 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.0012140274047851562 length of segment : 46 time for calcul the mask position with numpy : 0.000667572021484375 nb_pixel_total : 50010 time to create 1 rle with old method : 0.0562591552734375 length of segment : 231 Processing 1 images image shape: (400, 400, 3) min: 30.00000 max: 227.00000 molded_images shape: (1, 640, 640, 3) min: -91.50469 max: 105.44766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -93.21953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 2139 time to create 1 rle with old method : 0.004033565521240234 length of segment : 65 time for calcul the mask position with numpy : 9.202957153320312e-05 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0023927688598632812 length of segment : 34 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 720 time to create 1 rle with old method : 0.00142669677734375 length of segment : 39 time for calcul the mask position with numpy : 0.0005033016204833984 nb_pixel_total : 20476 time to create 1 rle with old method : 0.038512229919433594 length of segment : 202 time for calcul the mask position with numpy : 0.00011515617370605469 nb_pixel_total : 2089 time to create 1 rle with old method : 0.0031142234802246094 length of segment : 53 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.000171661376953125 length of segment : 14 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0005514621734619141 length of segment : 19 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.0009515285491943359 length of segment : 23 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0008053779602050781 length of segment : 27 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0004074573516845703 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.25078 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0005242824554443359 length of segment : 16 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.0015406608581542969 length of segment : 20 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 785 time to create 1 rle with old method : 0.001956462860107422 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.98125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 3442 time to create 1 rle with old method : 0.004329681396484375 length of segment : 67 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00042819976806640625 length of segment : 26 time for calcul the mask position with numpy : 0.00010538101196289062 nb_pixel_total : 1916 time to create 1 rle with old method : 0.0024254322052001953 length of segment : 128 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.001920461654663086 length of segment : 41 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 829 time to create 1 rle with old method : 0.0010666847229003906 length of segment : 39 time for calcul the mask position with numpy : 0.0005304813385009766 nb_pixel_total : 24020 time to create 1 rle with old method : 0.035900115966796875 length of segment : 324 time for calcul the mask position with numpy : 0.0006072521209716797 nb_pixel_total : 12680 time to create 1 rle with old method : 0.022777318954467773 length of segment : 261 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 1785 time to create 1 rle with old method : 0.0026040077209472656 length of segment : 179 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 2214 time to create 1 rle with old method : 0.0028808116912841797 length of segment : 171 time for calcul the mask position with numpy : 0.0003266334533691406 nb_pixel_total : 4693 time to create 1 rle with old method : 0.005477428436279297 length of segment : 221 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1026 time to create 1 rle with old method : 0.001405477523803711 length of segment : 61 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 1461 time to create 1 rle with old method : 0.0018391609191894531 length of segment : 71 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010793209075927734 length of segment : 48 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 635 time to create 1 rle with old method : 0.0008747577667236328 length of segment : 43 time for calcul the mask position with numpy : 0.00029015541076660156 nb_pixel_total : 4705 time to create 1 rle with old method : 0.005843400955200195 length of segment : 221 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 860 time to create 1 rle with old method : 0.001168966293334961 length of segment : 46 time for calcul the mask position with numpy : 0.0002541542053222656 nb_pixel_total : 3397 time to create 1 rle with old method : 0.004112958908081055 length of segment : 177 Processing 1 images image shape: (280, 400, 3) min: 27.00000 max: 232.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 116.00234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010361671447753906 nb_pixel_total : 103714 time to create 1 rle with old method : 0.1270124912261963 length of segment : 285 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.63516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 3321 time to create 1 rle with old method : 0.004241943359375 length of segment : 66 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0006413459777832031 length of segment : 36 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0011484622955322266 length of segment : 29 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1103 time to create 1 rle with old method : 0.001354217529296875 length of segment : 83 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 5007 time to create 1 rle with old method : 0.006077766418457031 length of segment : 76 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 632 time to create 1 rle with old method : 0.0008475780487060547 length of segment : 35 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.00037360191345214844 length of segment : 28 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1240 time to create 1 rle with old method : 0.0016379356384277344 length of segment : 41 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1214 time to create 1 rle with old method : 0.0016021728515625 length of segment : 34 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003502368927001953 length of segment : 21 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1325 time to create 1 rle with old method : 0.0017857551574707031 length of segment : 36 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0011551380157470703 length of segment : 40 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 21 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00018358230590820312 length of segment : 8 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.17812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00022125244140625 length of segment : 12 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004892349243164062 length of segment : 25 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 651 time to create 1 rle with old method : 0.0008325576782226562 length of segment : 40 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002028942108154297 length of segment : 13 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0005898475646972656 length of segment : 12 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005714893341064453 length of segment : 54 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.46719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0003094673156738281 length of segment : 16 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0007693767547607422 length of segment : 27 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0007483959197998047 length of segment : 28 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.001298666000366211 length of segment : 40 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1231 time to create 1 rle with old method : 0.0016007423400878906 length of segment : 64 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1450 time to create 1 rle with old method : 0.0018939971923828125 length of segment : 69 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.0002148151397705078 length of segment : 21 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.0002715587615966797 nb_pixel_total : 24077 time to create 1 rle with old method : 0.027395963668823242 length of segment : 204 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005209445953369141 length of segment : 95 length of segment : 0 length of segment : 0 time for calcul the mask position with numpy : 0.0006859302520751953 nb_pixel_total : 74707 time to create 1 rle with old method : 0.08735084533691406 length of segment : 251 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.09453 max: 147.50234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006542205810546875 length of segment : 29 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00022602081298828125 length of segment : 19 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 1067 time to create 1 rle with old method : 0.0014264583587646484 length of segment : 39 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0014214515686035156 length of segment : 38 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0007758140563964844 length of segment : 64 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006680488586425781 length of segment : 45 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1010 time to create 1 rle with old method : 0.001531362533569336 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.76250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005924701690673828 length of segment : 44 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 2206 time to create 1 rle with old method : 0.0028772354125976562 length of segment : 49 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003895759582519531 length of segment : 41 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004265308380126953 length of segment : 18 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1196 time to create 1 rle with old method : 0.0022590160369873047 length of segment : 29 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 848 time to create 1 rle with old method : 0.0015187263488769531 length of segment : 44 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 978 time to create 1 rle with old method : 0.001348257064819336 length of segment : 25 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0007605552673339844 length of segment : 15 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0006468296051025391 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -100.61406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1405 time to create 1 rle with old method : 0.0018231868743896484 length of segment : 35 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005834102630615234 length of segment : 30 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2949 time to create 1 rle with old method : 0.0037398338317871094 length of segment : 55 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 11 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.001191854476928711 length of segment : 31 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0004131793975830078 length of segment : 47 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 965 time to create 1 rle with old method : 0.0016658306121826172 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.45000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005195140838623047 length of segment : 16 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.000762939453125 length of segment : 28 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0007481575012207031 length of segment : 58 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0023102760314941406 length of segment : 130 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 30 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 3938 time to create 1 rle with old method : 0.005141019821166992 length of segment : 88 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1937 time to create 1 rle with old method : 0.0025277137756347656 length of segment : 68 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 22 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 4089 time to create 1 rle with old method : 0.005101919174194336 length of segment : 93 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.83828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0011551380157470703 length of segment : 65 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0014142990112304688 length of segment : 56 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007791519165039062 length of segment : 17 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007843971252441406 length of segment : 19 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.0007183551788330078 length of segment : 61 time for calcul the mask position with numpy : 0.0004391670227050781 nb_pixel_total : 40269 time to create 1 rle with old method : 0.051233768463134766 length of segment : 225 Processing 1 images image shape: (400, 400, 3) min: 33.00000 max: 237.00000 molded_images shape: (1, 640, 640, 3) min: -86.12188 max: 107.14297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -90.23516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1127 time to create 1 rle with old method : 0.0015039443969726562 length of segment : 32 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002524852752685547 length of segment : 20 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 2915 time to create 1 rle with old method : 0.003785848617553711 length of segment : 58 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00012421607971191406 length of segment : 11 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0007076263427734375 length of segment : 49 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004703998565673828 length of segment : 20 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 707 time to create 1 rle with old method : 0.0009281635284423828 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.07500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 3234 time to create 1 rle with old method : 0.004227638244628906 length of segment : 40 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008869171142578125 length of segment : 30 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003437995910644531 length of segment : 17 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0006124973297119141 length of segment : 16 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0008645057678222656 length of segment : 22 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0007617473602294922 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.49688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1701 time to create 1 rle with old method : 0.0021514892578125 length of segment : 112 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0017142295837402344 length of segment : 42 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0010814666748046875 length of segment : 38 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 601 time to create 1 rle with old method : 0.0009148120880126953 length of segment : 43 time for calcul the mask position with numpy : 0.00033545494079589844 nb_pixel_total : 10049 time to create 1 rle with old method : 0.013042688369750977 length of segment : 221 time for calcul the mask position with numpy : 0.00031375885009765625 nb_pixel_total : 11342 time to create 1 rle with old method : 0.013805150985717773 length of segment : 222 time for calcul the mask position with numpy : 0.00037932395935058594 nb_pixel_total : 15861 time to create 1 rle with old method : 0.018978357315063477 length of segment : 247 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008037090301513672 length of segment : 42 time for calcul the mask position with numpy : 0.0004050731658935547 nb_pixel_total : 20984 time to create 1 rle with old method : 0.025676965713500977 length of segment : 188 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.56875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 1680 time to create 1 rle with old method : 0.0024232864379882812 length of segment : 164 time for calcul the mask position with numpy : 0.00014019012451171875 nb_pixel_total : 1927 time to create 1 rle with old method : 0.0025408267974853516 length of segment : 168 time for calcul the mask position with numpy : 0.0003924369812011719 nb_pixel_total : 4627 time to create 1 rle with old method : 0.005799531936645508 length of segment : 216 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0010371208190917969 length of segment : 46 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0017123222351074219 length of segment : 69 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0012333393096923828 length of segment : 59 time for calcul the mask position with numpy : 0.00018787384033203125 nb_pixel_total : 3212 time to create 1 rle with old method : 0.003960609436035156 length of segment : 170 time for calcul the mask position with numpy : 0.00022029876708984375 nb_pixel_total : 4655 time to create 1 rle with old method : 0.007199287414550781 length of segment : 215 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 642 time to create 1 rle with old method : 0.0008590221405029297 length of segment : 42 Processing 1 images image shape: (280, 400, 3) min: 28.00000 max: 224.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 109.90859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0009083747863769531 length of segment : 77 time for calcul the mask position with numpy : 0.0010025501251220703 nb_pixel_total : 104708 time to create 1 rle with old method : 0.11961579322814941 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.24453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 3028 time to create 1 rle with old method : 0.003707408905029297 length of segment : 59 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003566741943359375 length of segment : 28 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0009500980377197266 length of segment : 33 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 843 time to create 1 rle with old method : 0.0011188983917236328 length of segment : 72 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008492469787597656 length of segment : 34 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0006024837493896484 length of segment : 40 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 5252 time to create 1 rle with old method : 0.006340503692626953 length of segment : 83 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.00043463706970214844 length of segment : 21 Processing 1 images image shape: (280, 400, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.90469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00022792816162109375 length of segment : 13 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0005671977996826172 length of segment : 12 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005044937133789062 length of segment : 26 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007588863372802734 length of segment : 36 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005490779876708984 length of segment : 53 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 980 time to create 1 rle with old method : 0.001285552978515625 length of segment : 48 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00018453598022460938 length of segment : 10 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.63125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1346 time to create 1 rle with old method : 0.0018444061279296875 length of segment : 64 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006537437438964844 length of segment : 26 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 29582 time to create 1 rle with old method : 0.03467059135437012 length of segment : 217 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.92266 max: 149.97891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1259 time to create 1 rle with old method : 0.0017137527465820312 length of segment : 34 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1277 time to create 1 rle with old method : 0.0017616748809814453 length of segment : 35 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00019502639770507812 length of segment : 15 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.000720977783203125 length of segment : 71 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006735324859619141 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.82500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 2747 time to create 1 rle with old method : 0.0048961639404296875 length of segment : 55 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0005719661712646484 length of segment : 21 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0007600784301757812 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.74688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 4042 time to create 1 rle with old method : 0.00713348388671875 length of segment : 78 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0009379386901855469 length of segment : 23 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.00040841102600097656 length of segment : 11 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 581 time to create 1 rle with old method : 0.0008602142333984375 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.75469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005245208740234375 length of segment : 17 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 3460 time to create 1 rle with old method : 0.0043849945068359375 length of segment : 100 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005831718444824219 length of segment : 24 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0006303787231445312 length of segment : 31 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0008089542388916016 length of segment : 29 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 2923 time to create 1 rle with old method : 0.0035982131958007812 length of segment : 74 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0011150836944580078 length of segment : 16 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0020117759704589844 length of segment : 33 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.001302957534790039 length of segment : 51 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 1432 time to create 1 rle with old method : 0.002720355987548828 length of segment : 141 time for calcul the mask position with numpy : 0.000179290771484375 nb_pixel_total : 5332 time to create 1 rle with old method : 0.010093927383422852 length of segment : 67 time for calcul the mask position with numpy : 0.0009310245513916016 nb_pixel_total : 49411 time to create 1 rle with old method : 0.06466913223266602 length of segment : 287 time for calcul the mask position with numpy : 0.0005662441253662109 nb_pixel_total : 48886 time to create 1 rle with old method : 0.05554914474487305 length of segment : 319 Processing 1 images image shape: (400, 400, 3) min: 28.00000 max: 226.00000 molded_images shape: (1, 640, 640, 3) min: -94.34844 max: 108.58828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -95.86797 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 437 time to create 1 rle with old method : 0.0007309913635253906 length of segment : 22 time for calcul the mask position with numpy : 0.00012111663818359375 nb_pixel_total : 394 time to create 1 rle with old method : 0.0006749629974365234 length of segment : 16 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 1175 time to create 1 rle with old method : 0.001750946044921875 length of segment : 34 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005452632904052734 length of segment : 61 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 740 time to create 1 rle with old method : 0.0010023117065429688 length of segment : 39 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 2592 time to create 1 rle with old method : 0.0035448074340820312 length of segment : 46 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 33 time to create 1 rle with old method : 0.00013113021850585938 length of segment : 13 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00015783309936523438 length of segment : 8 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00031828880310058594 length of segment : 19 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0005278587341308594 length of segment : 19 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0008909702301025391 length of segment : 30 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.00081634521484375 length of segment : 28 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0005450248718261719 length of segment : 13 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00047969818115234375 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.58672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00037670135498046875 length of segment : 13 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.0009076595306396484 length of segment : 32 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0006771087646484375 length of segment : 18 time for calcul the mask position with numpy : 0.0002810955047607422 nb_pixel_total : 11169 time to create 1 rle with old method : 0.016122102737426758 length of segment : 302 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 1605 time to create 1 rle with old method : 0.0031402111053466797 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.43438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 2027 time to create 1 rle with old method : 0.0033380985260009766 length of segment : 131 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0016252994537353516 length of segment : 38 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.0009596347808837891 length of segment : 36 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.98672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 849 time to create 1 rle with old method : 0.0011250972747802734 length of segment : 48 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 1369 time to create 1 rle with old method : 0.0017781257629394531 length of segment : 162 time for calcul the mask position with numpy : 0.00010919570922851562 nb_pixel_total : 1908 time to create 1 rle with old method : 0.002459287643432617 length of segment : 155 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 4055 time to create 1 rle with old method : 0.004859209060668945 length of segment : 216 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1049 time to create 1 rle with old method : 0.0013499259948730469 length of segment : 47 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1265 time to create 1 rle with old method : 0.0016317367553710938 length of segment : 67 time for calcul the mask position with numpy : 0.0003032684326171875 nb_pixel_total : 4217 time to create 1 rle with old method : 0.0051479339599609375 length of segment : 216 time for calcul the mask position with numpy : 0.0002868175506591797 nb_pixel_total : 3744 time to create 1 rle with old method : 0.004904508590698242 length of segment : 197 Processing 1 images image shape: (280, 400, 3) min: 24.00000 max: 225.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 106.83437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0011701583862304688 nb_pixel_total : 105525 time to create 1 rle with old method : 0.11992931365966797 length of segment : 285 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007719993591308594 length of segment : 73 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.59219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007090568542480469 length of segment : 28 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 2399 time to create 1 rle with old method : 0.0030241012573242188 length of segment : 47 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1529 time to create 1 rle with old method : 0.002626657485961914 length of segment : 65 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 649 time to create 1 rle with old method : 0.001323699951171875 length of segment : 23 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1360 time to create 1 rle with old method : 0.0023403167724609375 length of segment : 62 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.96328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005497932434082031 length of segment : 26 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0008456707000732422 length of segment : 40 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002238750457763672 length of segment : 13 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008883476257324219 length of segment : 33 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.0001647472381591797 length of segment : 9 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00034165382385253906 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.45156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0010750293731689453 length of segment : 30 time for calcul the mask position with numpy : 0.00011610984802246094 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0022499561309814453 length of segment : 82 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0008516311645507812 length of segment : 37 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0010304450988769531 length of segment : 30 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 832 time to create 1 rle with old method : 0.0015981197357177734 length of segment : 44 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.0001010894775390625 length of segment : 22 time for calcul the mask position with numpy : 0.00042128562927246094 nb_pixel_total : 29407 time to create 1 rle with old method : 0.03349876403808594 length of segment : 243 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.04375 max: 150.27578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1280 time to create 1 rle with old method : 0.0017163753509521484 length of segment : 34 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 797 time to create 1 rle with old method : 0.0010695457458496094 length of segment : 54 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1303 time to create 1 rle with old method : 0.0017108917236328125 length of segment : 34 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 725 time to create 1 rle with old method : 0.0010502338409423828 length of segment : 59 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007739067077636719 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.02813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006396770477294922 length of segment : 44 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 2435 time to create 1 rle with old method : 0.003104686737060547 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.81719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 3769 time to create 1 rle with old method : 0.0047016143798828125 length of segment : 58 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006313323974609375 length of segment : 24 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.00040912628173828125 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005140304565429688 length of segment : 16 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005426406860351562 length of segment : 24 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 3622 time to create 1 rle with old method : 0.0045812129974365234 length of segment : 82 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0008094310760498047 length of segment : 29 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 908 time to create 1 rle with old method : 0.0011601448059082031 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.61953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0009860992431640625 length of segment : 17 time for calcul the mask position with numpy : 0.000125885009765625 nb_pixel_total : 7745 time to create 1 rle with old method : 0.009232282638549805 length of segment : 68 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1279 time to create 1 rle with old method : 0.0017173290252685547 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 29.00000 max: 227.00000 molded_images shape: (1, 640, 640, 3) min: -87.74688 max: 106.45937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -94.09453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00025844573974609375 length of segment : 14 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004420280456542969 length of segment : 35 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0015900135040283203 length of segment : 33 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1632 time to create 1 rle with old method : 0.0020754337310791016 length of segment : 56 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.000156402587890625 length of segment : 10 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 2583 time to create 1 rle with old method : 0.0032804012298583984 length of segment : 48 time for calcul the mask position with numpy : 0.0001933574676513672 nb_pixel_total : 9137 time to create 1 rle with old method : 0.011130809783935547 length of segment : 129 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004296302795410156 length of segment : 18 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 52 time to create 1 rle with old method : 0.00013780593872070312 length of segment : 4 Processing 1 images image shape: (400, 400, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.36406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0004534721374511719 length of segment : 18 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1819 time to create 1 rle with old method : 0.002707242965698242 length of segment : 30 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0007150173187255859 length of segment : 19 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005357265472412109 length of segment : 25 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005512237548828125 length of segment : 27 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0009171962738037109 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.04375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1315 time to create 1 rle with old method : 0.0016849040985107422 length of segment : 41 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1917 time to create 1 rle with old method : 0.0024285316467285156 length of segment : 124 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.00036835670471191406 length of segment : 24 time for calcul the mask position with numpy : 0.00018453598022460938 nb_pixel_total : 8889 time to create 1 rle with old method : 0.010526418685913086 length of segment : 216 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009539127349853516 length of segment : 37 time for calcul the mask position with numpy : 0.00048232078552246094 nb_pixel_total : 22742 time to create 1 rle with old method : 0.027484655380249023 length of segment : 367 time for calcul the mask position with numpy : 0.00033283233642578125 nb_pixel_total : 10250 time to create 1 rle with old method : 0.013308286666870117 length of segment : 232 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.74844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 821 time to create 1 rle with old method : 0.0010859966278076172 length of segment : 50 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 2024 time to create 1 rle with old method : 0.002620697021484375 length of segment : 160 time for calcul the mask position with numpy : 0.0002834796905517578 nb_pixel_total : 4619 time to create 1 rle with old method : 0.005913734436035156 length of segment : 220 time for calcul the mask position with numpy : 0.0001227855682373047 nb_pixel_total : 1512 time to create 1 rle with old method : 0.002104043960571289 length of segment : 140 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0015408992767333984 length of segment : 49 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 894 time to create 1 rle with old method : 0.0012025833129882812 length of segment : 48 time for calcul the mask position with numpy : 0.0002377033233642578 nb_pixel_total : 4551 time to create 1 rle with old method : 0.005780220031738281 length of segment : 218 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0017774105072021484 length of segment : 67 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 3327 time to create 1 rle with old method : 0.004148960113525391 length of segment : 175 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 659 time to create 1 rle with old method : 0.0012788772583007812 length of segment : 42 Processing 1 images image shape: (280, 400, 3) min: 26.00000 max: 229.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 113.13906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0012710094451904297 length of segment : 69 time for calcul the mask position with numpy : 0.0010077953338623047 nb_pixel_total : 105167 time to create 1 rle with old method : 0.1249547004699707 length of segment : 285 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.36172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2936 time to create 1 rle with old method : 0.003732442855834961 length of segment : 59 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0012083053588867188 length of segment : 28 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002689361572265625 length of segment : 24 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0009222030639648438 length of segment : 33 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 814 time to create 1 rle with old method : 0.0012154579162597656 length of segment : 42 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0006682872772216797 length of segment : 25 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 4786 time to create 1 rle with old method : 0.005814552307128906 length of segment : 75 time for calcul the mask position with numpy : 0.0004734992980957031 nb_pixel_total : 35284 time to create 1 rle with old method : 0.045287132263183594 length of segment : 203 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 1733 time to create 1 rle with old method : 0.002749919891357422 length of segment : 66 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.000701904296875 length of segment : 29 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005366802215576172 length of segment : 36 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0007393360137939453 length of segment : 24 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0009367465972900391 length of segment : 26 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1198 time to create 1 rle with old method : 0.002182483673095703 length of segment : 58 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1267 time to create 1 rle with old method : 0.002203702926635742 length of segment : 38 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.45547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0006299018859863281 length of segment : 25 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0005030632019042969 length of segment : 33 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00022172927856445312 length of segment : 12 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.0005059242248535156 length of segment : 30 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0010013580322265625 length of segment : 40 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001957416534423828 length of segment : 9 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00020956993103027344 length of segment : 9 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.49062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1407 time to create 1 rle with old method : 0.0023908615112304688 length of segment : 71 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.000652313232421875 length of segment : 27 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00036215782165527344 length of segment : 39 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0012242794036865234 length of segment : 39 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.00064849853515625 length of segment : 28 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009746551513671875 nb_pixel_total : 32106 time to create 1 rle with old method : 0.051500558853149414 length of segment : 241 Detection mask done ! Trying to reset tf kernel 665862 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4111 tf kernel not reseted sub process len(results) : 345 len(list_Values) 345 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 345 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9400 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 345 chid ids of type : 4228 Number RLEs to save : 22472 save missing photos in datou_result : time spend for datou_step_exec : 32.9450249671936 time spend to save output : 4.557644605636597 total time spend for step 1 : 37.5026695728302 step2:brightness Wed Mar 5 11:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741170029_665513_1340991156_31328d18e51e20a3b09ef6f41fe228cf.jpg treat image : temp/1741170029_665513_1340991103_2ac3328c74b53430c4c113ffb70819b6.jpg treat image : temp/1741170029_665513_1340991075_d45f781a42f2f5480a55394211827d8a.jpg treat image : temp/1741170029_665513_1340991021_9ba2dd8bc83e57a2c7337d1f7d73d6bc.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.011866569519042969 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.011508941650390625 save missing photos in datou_result : time spend for datou_step_exec : 1.3256847858428955 time spend to save output : 0.027645587921142578 total time spend for step 2 : 1.353330373764038 step3:blur_detection Wed Mar 5 11:21:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741170029_665513_1340991156_31328d18e51e20a3b09ef6f41fe228cf.jpg resize: (1080, 1920) 1340991156 -7.902102303652417 treat image : temp/1741170029_665513_1340991103_2ac3328c74b53430c4c113ffb70819b6.jpg resize: (1080, 1920) 1340991103 -7.837774141299591 treat image : temp/1741170029_665513_1340991075_d45f781a42f2f5480a55394211827d8a.jpg resize: (1080, 1920) 1340991075 -7.8323077889183805 treat image : temp/1741170029_665513_1340991021_9ba2dd8bc83e57a2c7337d1f7d73d6bc.jpg resize: (1080, 1920) 1340991021 -7.81315020836932 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.011479616165161133 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.011372566223144531 save missing photos in datou_result : time spend for datou_step_exec : 4.8516833782196045 time spend to save output : 0.02708721160888672 total time spend for step 3 : 4.878770589828491 step4:rle_unique_nms_with_priority Wed Mar 5 11:21:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 345 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 99 nb_hashtags : 6 time to prepare the origin masks : 1.2681875228881836 time for calcul the mask position with numpy : 0.3804457187652588 nb_pixel_total : 1710457 time to create 1 rle with new method : 0.2441575527191162 time for calcul the mask position with numpy : 0.010249137878417969 nb_pixel_total : 449 time to create 1 rle with old method : 0.0006928443908691406 time for calcul the mask position with numpy : 0.00996541976928711 nb_pixel_total : 1221 time to create 1 rle with old method : 0.0015516281127929688 time for calcul the mask position with numpy : 0.008932113647460938 nb_pixel_total : 13 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.008752822875976562 nb_pixel_total : 382 time to create 1 rle with old method : 0.00048613548278808594 time for calcul the mask position with numpy : 0.009323358535766602 nb_pixel_total : 50010 time to create 1 rle with old method : 0.06464552879333496 time for calcul the mask position with numpy : 0.00880122184753418 nb_pixel_total : 17 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.010207414627075195 nb_pixel_total : 38 time to create 1 rle with old method : 0.0001456737518310547 time for calcul the mask position with numpy : 0.01101064682006836 nb_pixel_total : 39 time to create 1 rle with old method : 0.00015354156494140625 time for calcul the mask position with numpy : 0.011034011840820312 nb_pixel_total : 1257 time to create 1 rle with old method : 0.0016095638275146484 time for calcul the mask position with numpy : 0.009167909622192383 nb_pixel_total : 1065 time to create 1 rle with old method : 0.001646280288696289 time for calcul the mask position with numpy : 0.010170936584472656 nb_pixel_total : 129 time to create 1 rle with old method : 0.00020956993103027344 time for calcul the mask position with numpy : 0.009006738662719727 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008313655853271484 time for calcul the mask position with numpy : 0.009073257446289062 nb_pixel_total : 77 time to create 1 rle with old method : 0.0001251697540283203 time for calcul the mask position with numpy : 0.00860905647277832 nb_pixel_total : 2016 time to create 1 rle with old method : 0.0024423599243164062 time for calcul the mask position with numpy : 0.009182453155517578 nb_pixel_total : 625 time to create 1 rle with old method : 0.0008089542388916016 time for calcul the mask position with numpy : 0.00872945785522461 nb_pixel_total : 1378 time to create 1 rle with old method : 0.00173187255859375 time for calcul the mask position with numpy : 0.009515047073364258 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003204345703125 time for calcul the mask position with numpy : 0.009157896041870117 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0012464523315429688 time for calcul the mask position with numpy : 0.009584665298461914 nb_pixel_total : 995 time to create 1 rle with old method : 0.0013191699981689453 time for calcul the mask position with numpy : 0.009593486785888672 nb_pixel_total : 5126 time to create 1 rle with old method : 0.007287263870239258 time for calcul the mask position with numpy : 0.009008646011352539 nb_pixel_total : 1773 time to create 1 rle with old method : 0.002490997314453125 time for calcul the mask position with numpy : 0.009368419647216797 nb_pixel_total : 335 time to create 1 rle with old method : 0.000415802001953125 time for calcul the mask position with numpy : 0.00874185562133789 nb_pixel_total : 267 time to create 1 rle with old method : 0.00035119056701660156 time for calcul the mask position with numpy : 0.008867502212524414 nb_pixel_total : 408 time to create 1 rle with old method : 0.0006132125854492188 time for calcul the mask position with numpy : 0.0084991455078125 nb_pixel_total : 956 time to create 1 rle with old method : 0.0011591911315917969 time for calcul the mask position with numpy : 0.009377002716064453 nb_pixel_total : 2088 time to create 1 rle with old method : 0.0026400089263916016 time for calcul the mask position with numpy : 0.00865936279296875 nb_pixel_total : 780 time to create 1 rle with old method : 0.0009658336639404297 time for calcul the mask position with numpy : 0.009218215942382812 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005362033843994141 time for calcul the mask position with numpy : 0.009732484817504883 nb_pixel_total : 432 time to create 1 rle with old method : 0.0008025169372558594 time for calcul the mask position with numpy : 0.009767293930053711 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002918243408203125 time for calcul the mask position with numpy : 0.009432554244995117 nb_pixel_total : 5105 time to create 1 rle with old method : 0.00715947151184082 time for calcul the mask position with numpy : 0.009425640106201172 nb_pixel_total : 910 time to create 1 rle with old method : 0.0011050701141357422 time for calcul the mask position with numpy : 0.010158300399780273 nb_pixel_total : 935 time to create 1 rle with old method : 0.0011730194091796875 time for calcul the mask position with numpy : 0.008637189865112305 nb_pixel_total : 3795 time to create 1 rle with old method : 0.0052945613861083984 time for calcul the mask position with numpy : 0.00946354866027832 nb_pixel_total : 521 time to create 1 rle with old method : 0.0007245540618896484 time for calcul the mask position with numpy : 0.009078264236450195 nb_pixel_total : 888 time to create 1 rle with old method : 0.0011143684387207031 time for calcul the mask position with numpy : 0.009517192840576172 nb_pixel_total : 4920 time to create 1 rle with old method : 0.0058383941650390625 time for calcul the mask position with numpy : 0.008742094039916992 nb_pixel_total : 551 time to create 1 rle with old method : 0.000667572021484375 time for calcul the mask position with numpy : 0.0086212158203125 nb_pixel_total : 2139 time to create 1 rle with old method : 0.0025887489318847656 time for calcul the mask position with numpy : 0.008809089660644531 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.009071588516235352 nb_pixel_total : 582 time to create 1 rle with old method : 0.0007805824279785156 time for calcul the mask position with numpy : 0.010019540786743164 nb_pixel_total : 3442 time to create 1 rle with old method : 0.004036664962768555 time for calcul the mask position with numpy : 0.008530855178833008 nb_pixel_total : 829 time to create 1 rle with old method : 0.0009753704071044922 time for calcul the mask position with numpy : 0.008871793746948242 nb_pixel_total : 19303 time to create 1 rle with old method : 0.02229475975036621 time for calcul the mask position with numpy : 0.010655403137207031 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0015189647674560547 time for calcul the mask position with numpy : 0.009369850158691406 nb_pixel_total : 23085 time to create 1 rle with old method : 0.02729010581970215 time for calcul the mask position with numpy : 0.0084991455078125 nb_pixel_total : 831 time to create 1 rle with old method : 0.0009853839874267578 time for calcul the mask position with numpy : 0.008550167083740234 nb_pixel_total : 45 time to create 1 rle with old method : 9.489059448242188e-05 time for calcul the mask position with numpy : 0.009268522262573242 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002486705780029297 time for calcul the mask position with numpy : 0.009051084518432617 nb_pixel_total : 336 time to create 1 rle with old method : 0.0006420612335205078 time for calcul the mask position with numpy : 0.009862422943115234 nb_pixel_total : 635 time to create 1 rle with old method : 0.002767324447631836 time for calcul the mask position with numpy : 0.01031184196472168 nb_pixel_total : 765 time to create 1 rle with old method : 0.0014171600341796875 time for calcul the mask position with numpy : 0.009723424911499023 nb_pixel_total : 283 time to create 1 rle with old method : 0.0005066394805908203 time for calcul the mask position with numpy : 0.010621070861816406 nb_pixel_total : 1785 time to create 1 rle with old method : 0.0032231807708740234 time for calcul the mask position with numpy : 0.01016092300415039 nb_pixel_total : 300 time to create 1 rle with old method : 0.0006380081176757812 time for calcul the mask position with numpy : 0.009762287139892578 nb_pixel_total : 4693 time to create 1 rle with old method : 0.008043766021728516 time for calcul the mask position with numpy : 0.008885622024536133 nb_pixel_total : 191 time to create 1 rle with old method : 0.00033402442932128906 time for calcul the mask position with numpy : 0.008475542068481445 nb_pixel_total : 123 time to create 1 rle with old method : 0.00024199485778808594 time for calcul the mask position with numpy : 0.008493900299072266 nb_pixel_total : 1916 time to create 1 rle with old method : 0.00214385986328125 time for calcul the mask position with numpy : 0.008338689804077148 nb_pixel_total : 71 time to create 1 rle with old method : 9.369850158691406e-05 time for calcul the mask position with numpy : 0.008109331130981445 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0012650489807128906 time for calcul the mask position with numpy : 0.007984638214111328 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003001689910888672 time for calcul the mask position with numpy : 0.008135557174682617 nb_pixel_total : 1461 time to create 1 rle with old method : 0.0016107559204101562 time for calcul the mask position with numpy : 0.008118391036987305 nb_pixel_total : 720 time to create 1 rle with old method : 0.0007598400115966797 time for calcul the mask position with numpy : 0.008056163787841797 nb_pixel_total : 73 time to create 1 rle with old method : 0.00010633468627929688 time for calcul the mask position with numpy : 0.00792241096496582 nb_pixel_total : 2089 time to create 1 rle with old method : 0.002214193344116211 time for calcul the mask position with numpy : 0.008039712905883789 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005164146423339844 time for calcul the mask position with numpy : 0.007867574691772461 nb_pixel_total : 56 time to create 1 rle with old method : 7.891654968261719e-05 time for calcul the mask position with numpy : 0.012879610061645508 nb_pixel_total : 103714 time to create 1 rle with old method : 0.11948895454406738 time for calcul the mask position with numpy : 0.009308099746704102 nb_pixel_total : 53498 time to create 1 rle with old method : 0.060423851013183594 time for calcul the mask position with numpy : 0.008432149887084961 nb_pixel_total : 106 time to create 1 rle with old method : 0.0001366138458251953 time for calcul the mask position with numpy : 0.008138179779052734 nb_pixel_total : 251 time to create 1 rle with old method : 0.0002956390380859375 time for calcul the mask position with numpy : 0.008228063583374023 nb_pixel_total : 127 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.008285999298095703 nb_pixel_total : 317 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.008267641067504883 nb_pixel_total : 116 time to create 1 rle with old method : 0.00016880035400390625 time for calcul the mask position with numpy : 0.008155345916748047 nb_pixel_total : 651 time to create 1 rle with old method : 0.0007729530334472656 time for calcul the mask position with numpy : 0.008352518081665039 nb_pixel_total : 1214 time to create 1 rle with old method : 0.0013723373413085938 time for calcul the mask position with numpy : 0.008409261703491211 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003905296325683594 time for calcul the mask position with numpy : 0.008334875106811523 nb_pixel_total : 415 time to create 1 rle with old method : 0.00046372413635253906 time for calcul the mask position with numpy : 0.008265018463134766 nb_pixel_total : 632 time to create 1 rle with old method : 0.0007102489471435547 time for calcul the mask position with numpy : 0.00834345817565918 nb_pixel_total : 24077 time to create 1 rle with old method : 0.02657771110534668 time for calcul the mask position with numpy : 0.008424043655395508 nb_pixel_total : 3321 time to create 1 rle with old method : 0.0037560462951660156 time for calcul the mask position with numpy : 0.008356571197509766 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003266334533691406 time for calcul the mask position with numpy : 0.008331298828125 nb_pixel_total : 1240 time to create 1 rle with old method : 0.0013966560363769531 time for calcul the mask position with numpy : 0.008380413055419922 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002830028533935547 time for calcul the mask position with numpy : 0.008402109146118164 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0012717247009277344 time for calcul the mask position with numpy : 0.008374691009521484 nb_pixel_total : 375 time to create 1 rle with old method : 0.00041747093200683594 time for calcul the mask position with numpy : 0.008378267288208008 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001544952392578125 time for calcul the mask position with numpy : 0.008419275283813477 nb_pixel_total : 330 time to create 1 rle with old method : 0.00040984153747558594 time for calcul the mask position with numpy : 0.008409738540649414 nb_pixel_total : 456 time to create 1 rle with old method : 0.0004968643188476562 time for calcul the mask position with numpy : 0.008399724960327148 nb_pixel_total : 19 time to create 1 rle with old method : 3.409385681152344e-05 time for calcul the mask position with numpy : 0.008439064025878906 nb_pixel_total : 865 time to create 1 rle with old method : 0.0009655952453613281 time for calcul the mask position with numpy : 0.008370637893676758 nb_pixel_total : 260 time to create 1 rle with old method : 0.00032973289489746094 time for calcul the mask position with numpy : 0.008384227752685547 nb_pixel_total : 5007 time to create 1 rle with old method : 0.005552053451538086 time for calcul the mask position with numpy : 0.008406400680541992 nb_pixel_total : 1231 time to create 1 rle with old method : 0.0014116764068603516 time for calcul the mask position with numpy : 0.00838923454284668 nb_pixel_total : 414 time to create 1 rle with old method : 0.0004703998565673828 time for calcul the mask position with numpy : 0.00841665267944336 nb_pixel_total : 805 time to create 1 rle with old method : 0.0010066032409667969 time for calcul the mask position with numpy : 0.008400201797485352 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001876354217529297 time for calcul the mask position with numpy : 0.008417367935180664 nb_pixel_total : 132 time to create 1 rle with old method : 0.00015211105346679688 create new chi : 1.9670071601867676 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.015627622604370117 batch 1 Loaded 100 chid ids of type : 4230 Number RLEs to save : 11974 TO DO : save crop sub photo not yet done ! save time : 3.8882627487182617 nb_obj : 89 nb_hashtags : 6 time to prepare the origin masks : 1.977086067199707 time for calcul the mask position with numpy : 0.03608846664428711 nb_pixel_total : 1796191 time to create 1 rle with new method : 0.06393051147460938 time for calcul the mask position with numpy : 0.007322549819946289 nb_pixel_total : 1405 time to create 1 rle with old method : 0.001714468002319336 time for calcul the mask position with numpy : 0.006468296051025391 nb_pixel_total : 259 time to create 1 rle with old method : 0.00036907196044921875 time for calcul the mask position with numpy : 0.006668806076049805 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005803108215332031 time for calcul the mask position with numpy : 0.006412506103515625 nb_pixel_total : 1196 time to create 1 rle with old method : 0.001432180404663086 time for calcul the mask position with numpy : 0.006458282470703125 nb_pixel_total : 478 time to create 1 rle with old method : 0.0006496906280517578 time for calcul the mask position with numpy : 0.00628352165222168 nb_pixel_total : 107 time to create 1 rle with old method : 0.00015735626220703125 time for calcul the mask position with numpy : 0.006395101547241211 nb_pixel_total : 87 time to create 1 rle with old method : 0.00015354156494140625 time for calcul the mask position with numpy : 0.010679483413696289 nb_pixel_total : 40197 time to create 1 rle with old method : 0.047531843185424805 time for calcul the mask position with numpy : 0.010384082794189453 nb_pixel_total : 617 time to create 1 rle with old method : 0.0009305477142333984 time for calcul the mask position with numpy : 0.010604143142700195 nb_pixel_total : 11 time to create 1 rle with old method : 4.935264587402344e-05 time for calcul the mask position with numpy : 0.01209402084350586 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002753734588623047 time for calcul the mask position with numpy : 0.011490345001220703 nb_pixel_total : 1010 time to create 1 rle with old method : 0.001622915267944336 time for calcul the mask position with numpy : 0.01032400131225586 nb_pixel_total : 2206 time to create 1 rle with old method : 0.002561330795288086 time for calcul the mask position with numpy : 0.01018834114074707 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003173351287841797 time for calcul the mask position with numpy : 0.010101318359375 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0016124248504638672 time for calcul the mask position with numpy : 0.010370016098022461 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005450248718261719 time for calcul the mask position with numpy : 0.010242462158203125 nb_pixel_total : 549 time to create 1 rle with old method : 0.0007073879241943359 time for calcul the mask position with numpy : 0.010609865188598633 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002243518829345703 time for calcul the mask position with numpy : 0.006421327590942383 nb_pixel_total : 354 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.007950782775878906 nb_pixel_total : 924 time to create 1 rle with old method : 0.0011980533599853516 time for calcul the mask position with numpy : 0.010175228118896484 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006685256958007812 time for calcul the mask position with numpy : 0.010333061218261719 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002758502960205078 time for calcul the mask position with numpy : 0.010116338729858398 nb_pixel_total : 848 time to create 1 rle with old method : 0.0009903907775878906 time for calcul the mask position with numpy : 0.010448455810546875 nb_pixel_total : 2949 time to create 1 rle with old method : 0.0035834312438964844 time for calcul the mask position with numpy : 0.010361194610595703 nb_pixel_total : 905 time to create 1 rle with old method : 0.0012323856353759766 time for calcul the mask position with numpy : 0.011712074279785156 nb_pixel_total : 286 time to create 1 rle with old method : 0.00036406517028808594 time for calcul the mask position with numpy : 0.010521173477172852 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006163120269775391 time for calcul the mask position with numpy : 0.010492324829101562 nb_pixel_total : 891 time to create 1 rle with old method : 0.001026153564453125 time for calcul the mask position with numpy : 0.010744333267211914 nb_pixel_total : 309 time to create 1 rle with old method : 0.00038909912109375 time for calcul the mask position with numpy : 0.014908790588378906 nb_pixel_total : 3938 time to create 1 rle with old method : 0.005125522613525391 time for calcul the mask position with numpy : 0.01044011116027832 nb_pixel_total : 543 time to create 1 rle with old method : 0.0008389949798583984 time for calcul the mask position with numpy : 0.010874748229980469 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0013756752014160156 time for calcul the mask position with numpy : 0.010349035263061523 nb_pixel_total : 1937 time to create 1 rle with old method : 0.002560853958129883 time for calcul the mask position with numpy : 0.011365175247192383 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005702972412109375 time for calcul the mask position with numpy : 0.013115406036376953 nb_pixel_total : 28 time to create 1 rle with old method : 7.581710815429688e-05 time for calcul the mask position with numpy : 0.01373291015625 nb_pixel_total : 470 time to create 1 rle with old method : 0.000644683837890625 time for calcul the mask position with numpy : 0.013541221618652344 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007393360137939453 time for calcul the mask position with numpy : 0.013195276260375977 nb_pixel_total : 3 time to create 1 rle with old method : 7.963180541992188e-05 time for calcul the mask position with numpy : 0.012517929077148438 nb_pixel_total : 4637 time to create 1 rle with old method : 0.007548809051513672 time for calcul the mask position with numpy : 0.013035774230957031 nb_pixel_total : 6956 time to create 1 rle with old method : 0.009351968765258789 time for calcul the mask position with numpy : 0.013113021850585938 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007386207580566406 time for calcul the mask position with numpy : 0.012754201889038086 nb_pixel_total : 38 time to create 1 rle with old method : 0.00010848045349121094 time for calcul the mask position with numpy : 0.012375593185424805 nb_pixel_total : 601 time to create 1 rle with old method : 0.0007770061492919922 time for calcul the mask position with numpy : 0.01428842544555664 nb_pixel_total : 64 time to create 1 rle with old method : 0.0001270771026611328 time for calcul the mask position with numpy : 0.0122222900390625 nb_pixel_total : 11342 time to create 1 rle with old method : 0.015571355819702148 time for calcul the mask position with numpy : 0.012130260467529297 nb_pixel_total : 670 time to create 1 rle with old method : 0.0010230541229248047 time for calcul the mask position with numpy : 0.012964725494384766 nb_pixel_total : 769 time to create 1 rle with old method : 0.001039266586303711 time for calcul the mask position with numpy : 0.013208150863647461 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0016341209411621094 time for calcul the mask position with numpy : 0.012416839599609375 nb_pixel_total : 786 time to create 1 rle with old method : 0.001096963882446289 time for calcul the mask position with numpy : 0.00787973403930664 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003173351287841797 time for calcul the mask position with numpy : 0.007771492004394531 nb_pixel_total : 3234 time to create 1 rle with old method : 0.004125356674194336 time for calcul the mask position with numpy : 0.008179187774658203 nb_pixel_total : 389 time to create 1 rle with old method : 0.0009560585021972656 time for calcul the mask position with numpy : 0.00783848762512207 nb_pixel_total : 642 time to create 1 rle with old method : 0.001352071762084961 time for calcul the mask position with numpy : 0.007598876953125 nb_pixel_total : 739 time to create 1 rle with old method : 0.0015494823455810547 time for calcul the mask position with numpy : 0.00789785385131836 nb_pixel_total : 161 time to create 1 rle with old method : 0.0004820823669433594 time for calcul the mask position with numpy : 0.008255720138549805 nb_pixel_total : 4627 time to create 1 rle with old method : 0.008868932723999023 time for calcul the mask position with numpy : 0.007915258407592773 nb_pixel_total : 1680 time to create 1 rle with old method : 0.003256559371948242 time for calcul the mask position with numpy : 0.007984161376953125 nb_pixel_total : 126 time to create 1 rle with old method : 0.00035881996154785156 time for calcul the mask position with numpy : 0.007682323455810547 nb_pixel_total : 1701 time to create 1 rle with old method : 0.003360271453857422 time for calcul the mask position with numpy : 0.007904767990112305 nb_pixel_total : 10049 time to create 1 rle with old method : 0.013049602508544922 time for calcul the mask position with numpy : 0.008242368698120117 nb_pixel_total : 1127 time to create 1 rle with old method : 0.001466512680053711 time for calcul the mask position with numpy : 0.00839090347290039 nb_pixel_total : 2889 time to create 1 rle with old method : 0.0039293766021728516 time for calcul the mask position with numpy : 0.008507013320922852 nb_pixel_total : 1364 time to create 1 rle with old method : 0.002676725387573242 time for calcul the mask position with numpy : 0.008130311965942383 nb_pixel_total : 707 time to create 1 rle with old method : 0.0014519691467285156 time for calcul the mask position with numpy : 0.007235527038574219 nb_pixel_total : 316 time to create 1 rle with old method : 0.00058746337890625 time for calcul the mask position with numpy : 0.006925106048583984 nb_pixel_total : 62 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.006921052932739258 nb_pixel_total : 333 time to create 1 rle with old method : 0.0005819797515869141 time for calcul the mask position with numpy : 0.006791591644287109 nb_pixel_total : 146 time to create 1 rle with old method : 0.00027561187744140625 time for calcul the mask position with numpy : 0.006986141204833984 nb_pixel_total : 425 time to create 1 rle with old method : 0.0007085800170898438 time for calcul the mask position with numpy : 0.007611751556396484 nb_pixel_total : 104092 time to create 1 rle with old method : 0.12009382247924805 time for calcul the mask position with numpy : 0.006402254104614258 nb_pixel_total : 241 time to create 1 rle with old method : 0.00030350685119628906 time for calcul the mask position with numpy : 0.00647282600402832 nb_pixel_total : 980 time to create 1 rle with old method : 0.0011303424835205078 time for calcul the mask position with numpy : 0.006252288818359375 nb_pixel_total : 94 time to create 1 rle with old method : 0.00013017654418945312 time for calcul the mask position with numpy : 0.006176948547363281 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006349086761474609 time for calcul the mask position with numpy : 0.006560087203979492 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003561973571777344 time for calcul the mask position with numpy : 0.0064013004302978516 nb_pixel_total : 29582 time to create 1 rle with old method : 0.034615516662597656 time for calcul the mask position with numpy : 0.006384611129760742 nb_pixel_total : 424 time to create 1 rle with old method : 0.0004966259002685547 time for calcul the mask position with numpy : 0.006310701370239258 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007348060607910156 time for calcul the mask position with numpy : 0.006577014923095703 nb_pixel_total : 3028 time to create 1 rle with old method : 0.003464937210083008 time for calcul the mask position with numpy : 0.0065097808837890625 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005345344543457031 time for calcul the mask position with numpy : 0.006389617919921875 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.0065135955810546875 nb_pixel_total : 368 time to create 1 rle with old method : 0.00043582916259765625 time for calcul the mask position with numpy : 0.0063190460205078125 nb_pixel_total : 145 time to create 1 rle with old method : 0.00018095970153808594 time for calcul the mask position with numpy : 0.0064182281494140625 nb_pixel_total : 843 time to create 1 rle with old method : 0.0009729862213134766 time for calcul the mask position with numpy : 0.006228208541870117 nb_pixel_total : 476 time to create 1 rle with old method : 0.0005555152893066406 time for calcul the mask position with numpy : 0.0065195560455322266 nb_pixel_total : 5252 time to create 1 rle with old method : 0.006007671356201172 time for calcul the mask position with numpy : 0.0065996646881103516 nb_pixel_total : 663 time to create 1 rle with old method : 0.0007770061492919922 time for calcul the mask position with numpy : 0.006486177444458008 nb_pixel_total : 1346 time to create 1 rle with old method : 0.001529693603515625 time for calcul the mask position with numpy : 0.006284952163696289 nb_pixel_total : 446 time to create 1 rle with old method : 0.0005369186401367188 create new chi : 1.2597689628601074 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014913082122802734 batch 1 Loaded 90 chid ids of type : 4230 Number RLEs to save : 10945 TO DO : save crop sub photo not yet done ! save time : 1.3512687683105469 nb_obj : 75 nb_hashtags : 6 time to prepare the origin masks : 1.4778282642364502 time for calcul the mask position with numpy : 0.027232885360717773 nb_pixel_total : 1809938 time to create 1 rle with new method : 0.0430607795715332 time for calcul the mask position with numpy : 0.005991458892822266 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003428459167480469 time for calcul the mask position with numpy : 0.006170749664306641 nb_pixel_total : 52 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.005961179733276367 nb_pixel_total : 1259 time to create 1 rle with old method : 0.0014467239379882812 time for calcul the mask position with numpy : 0.005877017974853516 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005168914794921875 time for calcul the mask position with numpy : 0.005938529968261719 nb_pixel_total : 79 time to create 1 rle with old method : 0.00011920928955078125 time for calcul the mask position with numpy : 0.005895853042602539 nb_pixel_total : 148 time to create 1 rle with old method : 0.00022649765014648438 time for calcul the mask position with numpy : 0.006309986114501953 nb_pixel_total : 49270 time to create 1 rle with old method : 0.05389809608459473 time for calcul the mask position with numpy : 0.0063173770904541016 nb_pixel_total : 2747 time to create 1 rle with old method : 0.0030050277709960938 time for calcul the mask position with numpy : 0.005994081497192383 nb_pixel_total : 4607 time to create 1 rle with old method : 0.005365133285522461 time for calcul the mask position with numpy : 0.006100893020629883 nb_pixel_total : 581 time to create 1 rle with old method : 0.0006198883056640625 time for calcul the mask position with numpy : 0.00585174560546875 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005006790161132812 time for calcul the mask position with numpy : 0.006605386734008789 nb_pixel_total : 326 time to create 1 rle with old method : 0.00040149688720703125 time for calcul the mask position with numpy : 0.006380796432495117 nb_pixel_total : 1432 time to create 1 rle with old method : 0.001653909683227539 time for calcul the mask position with numpy : 0.0063741207122802734 nb_pixel_total : 362 time to create 1 rle with old method : 0.000446319580078125 time for calcul the mask position with numpy : 0.006433010101318359 nb_pixel_total : 231 time to create 1 rle with old method : 0.00031280517578125 time for calcul the mask position with numpy : 0.006620168685913086 nb_pixel_total : 4042 time to create 1 rle with old method : 0.006389141082763672 time for calcul the mask position with numpy : 0.007248640060424805 nb_pixel_total : 686 time to create 1 rle with old method : 0.0008449554443359375 time for calcul the mask position with numpy : 0.006139993667602539 nb_pixel_total : 399 time to create 1 rle with old method : 0.00045752525329589844 time for calcul the mask position with numpy : 0.006180524826049805 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006203651428222656 time for calcul the mask position with numpy : 0.0062105655670166016 nb_pixel_total : 5332 time to create 1 rle with old method : 0.005926370620727539 time for calcul the mask position with numpy : 0.006040811538696289 nb_pixel_total : 660 time to create 1 rle with old method : 0.0007677078247070312 time for calcul the mask position with numpy : 0.005857944488525391 nb_pixel_total : 3460 time to create 1 rle with old method : 0.0037567615509033203 time for calcul the mask position with numpy : 0.006180286407470703 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0012595653533935547 time for calcul the mask position with numpy : 0.005995512008666992 nb_pixel_total : 2923 time to create 1 rle with old method : 0.0032176971435546875 time for calcul the mask position with numpy : 0.00587153434753418 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006330013275146484 time for calcul the mask position with numpy : 0.005913496017456055 nb_pixel_total : 404 time to create 1 rle with old method : 0.0004940032958984375 time for calcul the mask position with numpy : 0.006234407424926758 nb_pixel_total : 716 time to create 1 rle with old method : 0.0008327960968017578 time for calcul the mask position with numpy : 0.0066623687744140625 nb_pixel_total : 765 time to create 1 rle with old method : 0.0008778572082519531 time for calcul the mask position with numpy : 0.006474733352661133 nb_pixel_total : 1605 time to create 1 rle with old method : 0.001834869384765625 time for calcul the mask position with numpy : 0.006369590759277344 nb_pixel_total : 549 time to create 1 rle with old method : 0.0006375312805175781 time for calcul the mask position with numpy : 0.0060923099517822266 nb_pixel_total : 1182 time to create 1 rle with old method : 0.001355886459350586 time for calcul the mask position with numpy : 0.006252288818359375 nb_pixel_total : 849 time to create 1 rle with old method : 0.0009951591491699219 time for calcul the mask position with numpy : 0.006195068359375 nb_pixel_total : 156 time to create 1 rle with old method : 0.00020265579223632812 time for calcul the mask position with numpy : 0.006321907043457031 nb_pixel_total : 688 time to create 1 rle with old method : 0.0008447170257568359 time for calcul the mask position with numpy : 0.006400108337402344 nb_pixel_total : 394 time to create 1 rle with old method : 0.00047087669372558594 time for calcul the mask position with numpy : 0.006493806838989258 nb_pixel_total : 1369 time to create 1 rle with old method : 0.0017464160919189453 time for calcul the mask position with numpy : 0.0076847076416015625 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005168914794921875 time for calcul the mask position with numpy : 0.006166696548461914 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010495185852050781 time for calcul the mask position with numpy : 0.0061376094818115234 nb_pixel_total : 4055 time to create 1 rle with old method : 0.006689548492431641 time for calcul the mask position with numpy : 0.006915569305419922 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005421638488769531 time for calcul the mask position with numpy : 0.0065305233001708984 nb_pixel_total : 91 time to create 1 rle with old method : 0.00017023086547851562 time for calcul the mask position with numpy : 0.006147623062133789 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002849102020263672 time for calcul the mask position with numpy : 0.007090568542480469 nb_pixel_total : 621 time to create 1 rle with old method : 0.0007257461547851562 time for calcul the mask position with numpy : 0.006208658218383789 nb_pixel_total : 2027 time to create 1 rle with old method : 0.002298116683959961 time for calcul the mask position with numpy : 0.006646633148193359 nb_pixel_total : 11169 time to create 1 rle with old method : 0.014730215072631836 time for calcul the mask position with numpy : 0.0059740543365478516 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003330707550048828 time for calcul the mask position with numpy : 0.006119966506958008 nb_pixel_total : 193 time to create 1 rle with old method : 0.00038242340087890625 time for calcul the mask position with numpy : 0.0069386959075927734 nb_pixel_total : 8 time to create 1 rle with old method : 7.486343383789062e-05 time for calcul the mask position with numpy : 0.005860567092895508 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0013747215270996094 time for calcul the mask position with numpy : 0.005815982818603516 nb_pixel_total : 2592 time to create 1 rle with old method : 0.003941774368286133 time for calcul the mask position with numpy : 0.0066339969635009766 nb_pixel_total : 1265 time to create 1 rle with old method : 0.0014605522155761719 time for calcul the mask position with numpy : 0.00635075569152832 nb_pixel_total : 740 time to create 1 rle with old method : 0.0008685588836669922 time for calcul the mask position with numpy : 0.006116390228271484 nb_pixel_total : 360 time to create 1 rle with old method : 0.00042438507080078125 time for calcul the mask position with numpy : 0.007107257843017578 nb_pixel_total : 16 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.006192684173583984 nb_pixel_total : 58 time to create 1 rle with old method : 9.012222290039062e-05 time for calcul the mask position with numpy : 0.0073277950286865234 nb_pixel_total : 105525 time to create 1 rle with old method : 0.12108254432678223 time for calcul the mask position with numpy : 0.006376504898071289 nb_pixel_total : 82 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.006060361862182617 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007162094116210938 time for calcul the mask position with numpy : 0.006295919418334961 nb_pixel_total : 29407 time to create 1 rle with old method : 0.03445315361022949 time for calcul the mask position with numpy : 0.006594657897949219 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003147125244140625 time for calcul the mask position with numpy : 0.006242275238037109 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006432533264160156 time for calcul the mask position with numpy : 0.0065767765045166016 nb_pixel_total : 2399 time to create 1 rle with old method : 0.004228115081787109 time for calcul the mask position with numpy : 0.0071828365325927734 nb_pixel_total : 649 time to create 1 rle with old method : 0.0008153915405273438 time for calcul the mask position with numpy : 0.0063784122467041016 nb_pixel_total : 1360 time to create 1 rle with old method : 0.0016007423400878906 time for calcul the mask position with numpy : 0.006730794906616211 nb_pixel_total : 402 time to create 1 rle with old method : 0.00048089027404785156 time for calcul the mask position with numpy : 0.00668644905090332 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002307891845703125 time for calcul the mask position with numpy : 0.006966114044189453 nb_pixel_total : 1529 time to create 1 rle with old method : 0.0018453598022460938 time for calcul the mask position with numpy : 0.007025003433227539 nb_pixel_total : 34 time to create 1 rle with old method : 0.00011491775512695312 time for calcul the mask position with numpy : 0.006836652755737305 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006680488586425781 time for calcul the mask position with numpy : 0.006754398345947266 nb_pixel_total : 62 time to create 1 rle with old method : 9.799003601074219e-05 time for calcul the mask position with numpy : 0.006641387939453125 nb_pixel_total : 1166 time to create 1 rle with old method : 0.0013954639434814453 time for calcul the mask position with numpy : 0.0066738128662109375 nb_pixel_total : 27 time to create 1 rle with old method : 6.031990051269531e-05 time for calcul the mask position with numpy : 0.006603240966796875 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008242130279541016 time for calcul the mask position with numpy : 0.007037162780761719 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004444122314453125 time for calcul the mask position with numpy : 0.006458282470703125 nb_pixel_total : 832 time to create 1 rle with old method : 0.0010728836059570312 create new chi : 0.8635637760162354 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014238357543945312 batch 1 Loaded 76 chid ids of type : 4230 Number RLEs to save : 9641 TO DO : save crop sub photo not yet done ! save time : 0.8215835094451904 nb_obj : 76 nb_hashtags : 6 time to prepare the origin masks : 1.5306346416473389 time for calcul the mask position with numpy : 0.059705495834350586 nb_pixel_total : 1798395 time to create 1 rle with new method : 0.33620572090148926 time for calcul the mask position with numpy : 0.006543636322021484 nb_pixel_total : 42 time to create 1 rle with old method : 0.00010752677917480469 time for calcul the mask position with numpy : 0.007625579833984375 nb_pixel_total : 1280 time to create 1 rle with old method : 0.0017592906951904297 time for calcul the mask position with numpy : 0.007055997848510742 nb_pixel_total : 797 time to create 1 rle with old method : 0.0010750293731689453 time for calcul the mask position with numpy : 0.006989479064941406 nb_pixel_total : 37 time to create 1 rle with old method : 0.00010561943054199219 time for calcul the mask position with numpy : 0.007294893264770508 nb_pixel_total : 562 time to create 1 rle with old method : 0.0008580684661865234 time for calcul the mask position with numpy : 0.007387638092041016 nb_pixel_total : 2435 time to create 1 rle with old method : 0.0027942657470703125 time for calcul the mask position with numpy : 0.007014036178588867 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006239414215087891 time for calcul the mask position with numpy : 0.007456541061401367 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006668567657470703 time for calcul the mask position with numpy : 0.007920980453491211 nb_pixel_total : 362 time to create 1 rle with old method : 0.00047707557678222656 time for calcul the mask position with numpy : 0.008687973022460938 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003886222839355469 time for calcul the mask position with numpy : 0.009032726287841797 nb_pixel_total : 3769 time to create 1 rle with old method : 0.0051724910736083984 time for calcul the mask position with numpy : 0.00805044174194336 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005753040313720703 time for calcul the mask position with numpy : 0.007711887359619141 nb_pixel_total : 498 time to create 1 rle with old method : 0.0007128715515136719 time for calcul the mask position with numpy : 0.008224010467529297 nb_pixel_total : 7745 time to create 1 rle with old method : 0.010686635971069336 time for calcul the mask position with numpy : 0.008284568786621094 nb_pixel_total : 3622 time to create 1 rle with old method : 0.005281925201416016 time for calcul the mask position with numpy : 0.009344339370727539 nb_pixel_total : 1279 time to create 1 rle with old method : 0.0016820430755615234 time for calcul the mask position with numpy : 0.009047508239746094 nb_pixel_total : 908 time to create 1 rle with old method : 0.00142669677734375 time for calcul the mask position with numpy : 0.00914311408996582 nb_pixel_total : 541 time to create 1 rle with old method : 0.0007572174072265625 time for calcul the mask position with numpy : 0.008977174758911133 nb_pixel_total : 153 time to create 1 rle with old method : 0.000270843505859375 time for calcul the mask position with numpy : 0.008995294570922852 nb_pixel_total : 462 time to create 1 rle with old method : 0.0008993148803710938 time for calcul the mask position with numpy : 0.00954580307006836 nb_pixel_total : 1643 time to create 1 rle with old method : 0.00377655029296875 time for calcul the mask position with numpy : 0.009107351303100586 nb_pixel_total : 8889 time to create 1 rle with old method : 0.011895179748535156 time for calcul the mask position with numpy : 0.007360935211181641 nb_pixel_total : 767 time to create 1 rle with old method : 0.0008940696716308594 time for calcul the mask position with numpy : 0.006946086883544922 nb_pixel_total : 1819 time to create 1 rle with old method : 0.0021233558654785156 time for calcul the mask position with numpy : 0.006940364837646484 nb_pixel_total : 1315 time to create 1 rle with old method : 0.0015876293182373047 time for calcul the mask position with numpy : 0.00739598274230957 nb_pixel_total : 86 time to create 1 rle with old method : 0.0002281665802001953 time for calcul the mask position with numpy : 0.008184432983398438 nb_pixel_total : 821 time to create 1 rle with old method : 0.0013873577117919922 time for calcul the mask position with numpy : 0.007179975509643555 nb_pixel_total : 9137 time to create 1 rle with old method : 0.012568473815917969 time for calcul the mask position with numpy : 0.007167816162109375 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.0070781707763671875 nb_pixel_total : 251 time to create 1 rle with old method : 0.00046944618225097656 time for calcul the mask position with numpy : 0.008295297622680664 nb_pixel_total : 21603 time to create 1 rle with old method : 0.03630661964416504 time for calcul the mask position with numpy : 0.006993770599365234 nb_pixel_total : 964 time to create 1 rle with old method : 0.0017020702362060547 time for calcul the mask position with numpy : 0.006765127182006836 nb_pixel_total : 659 time to create 1 rle with old method : 0.0011310577392578125 time for calcul the mask position with numpy : 0.006823539733886719 nb_pixel_total : 138 time to create 1 rle with old method : 0.0003383159637451172 time for calcul the mask position with numpy : 0.006938457489013672 nb_pixel_total : 168 time to create 1 rle with old method : 0.00045418739318847656 time for calcul the mask position with numpy : 0.00743865966796875 nb_pixel_total : 2024 time to create 1 rle with old method : 0.0031697750091552734 time for calcul the mask position with numpy : 0.007622241973876953 nb_pixel_total : 4619 time to create 1 rle with old method : 0.006966829299926758 time for calcul the mask position with numpy : 0.007018566131591797 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002956390380859375 time for calcul the mask position with numpy : 0.006327629089355469 nb_pixel_total : 1917 time to create 1 rle with old method : 0.002171754837036133 time for calcul the mask position with numpy : 0.00662541389465332 nb_pixel_total : 198 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.006417751312255859 nb_pixel_total : 1632 time to create 1 rle with old method : 0.0018808841705322266 time for calcul the mask position with numpy : 0.006369590759277344 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0017969608306884766 time for calcul the mask position with numpy : 0.006769895553588867 nb_pixel_total : 20 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.008100748062133789 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005016326904296875 time for calcul the mask position with numpy : 0.007994890213012695 nb_pixel_total : 2556 time to create 1 rle with old method : 0.005028247833251953 time for calcul the mask position with numpy : 0.010021448135375977 nb_pixel_total : 1300 time to create 1 rle with old method : 0.00151824951171875 time for calcul the mask position with numpy : 0.006560087203979492 nb_pixel_total : 325 time to create 1 rle with old method : 0.00039196014404296875 time for calcul the mask position with numpy : 0.00658106803894043 nb_pixel_total : 153 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.006230592727661133 nb_pixel_total : 1 time to create 1 rle with old method : 2.3126602172851562e-05 time for calcul the mask position with numpy : 0.006203174591064453 nb_pixel_total : 52 time to create 1 rle with old method : 7.891654968261719e-05 time for calcul the mask position with numpy : 0.006735563278198242 nb_pixel_total : 104671 time to create 1 rle with old method : 0.12050151824951172 time for calcul the mask position with numpy : 0.006669282913208008 nb_pixel_total : 30958 time to create 1 rle with old method : 0.03540205955505371 time for calcul the mask position with numpy : 0.0067653656005859375 nb_pixel_total : 409 time to create 1 rle with old method : 0.0004856586456298828 time for calcul the mask position with numpy : 0.006304740905761719 nb_pixel_total : 84 time to create 1 rle with old method : 0.00011777877807617188 time for calcul the mask position with numpy : 0.006296634674072266 nb_pixel_total : 655 time to create 1 rle with old method : 0.0007922649383544922 time for calcul the mask position with numpy : 0.006884098052978516 nb_pixel_total : 32106 time to create 1 rle with old method : 0.03929495811462402 time for calcul the mask position with numpy : 0.0062482357025146484 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004093647003173828 time for calcul the mask position with numpy : 0.006098270416259766 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001735687255859375 time for calcul the mask position with numpy : 0.010054349899291992 nb_pixel_total : 334 time to create 1 rle with old method : 0.00045228004455566406 time for calcul the mask position with numpy : 0.00726318359375 nb_pixel_total : 2936 time to create 1 rle with old method : 0.0033631324768066406 time for calcul the mask position with numpy : 0.006354570388793945 nb_pixel_total : 102 time to create 1 rle with old method : 0.00013327598571777344 time for calcul the mask position with numpy : 0.006530046463012695 nb_pixel_total : 736 time to create 1 rle with old method : 0.0008571147918701172 time for calcul the mask position with numpy : 0.00628352165222168 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005090236663818359 time for calcul the mask position with numpy : 0.0063381195068359375 nb_pixel_total : 137 time to create 1 rle with old method : 0.000213623046875 time for calcul the mask position with numpy : 0.006549835205078125 nb_pixel_total : 526 time to create 1 rle with old method : 0.0007166862487792969 time for calcul the mask position with numpy : 0.0067272186279296875 nb_pixel_total : 146 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.006372690200805664 nb_pixel_total : 248 time to create 1 rle with old method : 0.00034117698669433594 time for calcul the mask position with numpy : 0.006343841552734375 nb_pixel_total : 488 time to create 1 rle with old method : 0.0005657672882080078 time for calcul the mask position with numpy : 0.006517171859741211 nb_pixel_total : 19 time to create 1 rle with old method : 4.124641418457031e-05 time for calcul the mask position with numpy : 0.00664973258972168 nb_pixel_total : 32 time to create 1 rle with old method : 0.00010538101196289062 time for calcul the mask position with numpy : 0.006800174713134766 nb_pixel_total : 814 time to create 1 rle with old method : 0.000982046127319336 time for calcul the mask position with numpy : 0.006460905075073242 nb_pixel_total : 4786 time to create 1 rle with old method : 0.005435943603515625 time for calcul the mask position with numpy : 0.006533622741699219 nb_pixel_total : 1407 time to create 1 rle with old method : 0.0016183853149414062 time for calcul the mask position with numpy : 0.006867647171020508 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006031990051269531 time for calcul the mask position with numpy : 0.008645772933959961 nb_pixel_total : 392 time to create 1 rle with old method : 0.00045561790466308594 time for calcul the mask position with numpy : 0.008402347564697266 nb_pixel_total : 777 time to create 1 rle with old method : 0.0008745193481445312 create new chi : 1.319507122039795 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0015082359313964844 batch 1 Loaded 77 chid ids of type : 4230 Number RLEs to save : 9536 TO DO : save crop sub photo not yet done ! save time : 0.6748027801513672 map_output_result : {1340991156: (0.0, 'Should be the crop_list due to order', 0.0), 1340991103: (0.0, 'Should be the crop_list due to order', 0.0), 1340991075: (0.0, 'Should be the crop_list due to order', 0.0), 1340991021: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340991156, 1340991103, 1340991075, 1340991021] Looping around the photos to save general results len do output : 4 /1340991156.Didn't retrieve data . /1340991103.Didn't retrieve data . /1340991075.Didn't retrieve data . /1340991021.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991156', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991103', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991075', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991021', None, None, None, None, None, '2637423') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014923572540283203 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.989927530288696 time spend to save output : 0.015281438827514648 total time spend for step 4 : 19.00520896911621 step5:crop_condition Wed Mar 5 11:21:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 343 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 115 About to insert : list_path_to_insert length 115 new photo from crops ! About to upload 115 photos upload in portfolio : 4869462 init cache_photo without model_param we have 115 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741170094_665513 we have uploaded 115 photos in the portfolio 4869462 time of upload the photos Elapsed time : 62.71492886543274 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 4869462 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741170158_665513 we have uploaded 30 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.983074426651001 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 4869462 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741170170_665513 we have uploaded 22 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.2902138233184814 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 58 About to insert : list_path_to_insert length 58 new photo from crops ! About to upload 58 photos upload in portfolio : 4869462 init cache_photo without model_param we have 58 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741170178_665513 we have uploaded 58 photos in the portfolio 4869462 time of upload the photos Elapsed time : 19.018011569976807 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340991156, 1340991103, 1340991075, 1340991021] Looping around the photos to save general results len do output : 225 /1340995359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340995999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340996060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991156', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991103', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991075', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991021', None, None, None, None, None, '2637423') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 679 time used for this insertion : 0.0450289249420166 save_final save missing photos in datou_result : time spend for datou_step_exec : 104.7819550037384 time spend to save output : 0.23666858673095703 total time spend for step 5 : 105.01862359046936 step6:thcl Wed Mar 5 11:23:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01203298568725586 time to convert the images to numpy array : 0.06949663162231445 time to import caffe and check if the image exist : 0.01431131362915039 time to convert the images to numpy array : 0.06947517395019531 time to import caffe and check if the image exist : 0.015978336334228516 time to convert the images to numpy array : 0.07326221466064453 time to import caffe and check if the image exist : 0.01593327522277832 time to convert the images to numpy array : 0.08170580863952637 time to import caffe and check if the image exist : 0.020900487899780273 time to convert the images to numpy array : 0.07714319229125977 time to import caffe and check if the image exist : 0.01964569091796875 time to convert the images to numpy array : 0.08475685119628906 time to import caffe and check if the image exist : 0.0284883975982666 time to convert the images to numpy array : 0.07741022109985352 time to import caffe and check if the image exist : 0.031249523162841797 time to convert the images to numpy array : 0.07607173919677734 time to import caffe and check if the image exist : 0.03666210174560547 time to convert the images to numpy array : 0.07118940353393555 time to import caffe and check if the image exist : 0.03333306312561035 time to convert the images to numpy array : 0.07537126541137695 total time to convert the images to numpy array : 0.3452029228210449 list photo_ids error: [] list photo_ids correct : [1340996042, 1340996043, 1340996044, 1340996045, 1340996046, 1340996047, 1340996048, 1340996049, 1340996050, 1340996051, 1340996052, 1340996054, 1340996055, 1340996056, 1340996057, 1340996058, 1340996059, 1340996060, 1340995408, 1340995411, 1340995413, 1340995415, 1340995417, 1340995420, 1340995422, 1340995424, 1340995427, 1340995429, 1340995431, 1340995433, 1340995435, 1340995438, 1340995440, 1340995442, 1340995444, 1340995446, 1340995449, 1340995458, 1340995461, 1340995463, 1340995465, 1340995467, 1340995469, 1340995472, 1340995474, 1340995476, 1340995478, 1340995481, 1340995483, 1340995485, 1340995487, 1340995489, 1340995491, 1340995493, 1340995496, 1340995498, 1340995501, 1340995503, 1340995506, 1340995508, 1340995510, 1340995512, 1340995514, 1340995516, 1340996016, 1340996017, 1340996018, 1340996019, 1340996020, 1340996021, 1340996022, 1340996023, 1340996024, 1340996025, 1340996026, 1340996027, 1340996028, 1340996031, 1340996033, 1340996034, 1340996035, 1340996036, 1340996037, 1340996038, 1340996039, 1340996040, 1340996041, 1340995518, 1340995520, 1340995524, 1340995526, 1340995528, 1340995530, 1340995532, 1340995534, 1340995536, 1340995538, 1340995540, 1340995542, 1340995544, 1340995546, 1340995548, 1340995550, 1340995553, 1340995556, 1340995558, 1340995560, 1340995563, 1340995565, 1340995568, 1340995359, 1340995361, 1340995364, 1340995366, 1340995368, 1340995370, 1340995372, 1340995374, 1340995376, 1340995378, 1340995380, 1340995384, 1340995386, 1340995388, 1340995390, 1340995392, 1340995394, 1340995396, 1340995398, 1340995400, 1340995402, 1340995404, 1340995406, 1340995839, 1340995842, 1340995845, 1340995848, 1340995852, 1340995854, 1340995858, 1340995947, 1340995948, 1340995949, 1340995950, 1340995951, 1340995952, 1340995953, 1340995954, 1340995955, 1340995956, 1340995957, 1340995958, 1340995959, 1340995960, 1340995961, 1340995962, 1340995758, 1340995761, 1340995763, 1340995766, 1340995769, 1340995778, 1340995781, 1340995783, 1340995786, 1340995789, 1340995793, 1340995797, 1340995801, 1340995804, 1340995808, 1340995811, 1340995815, 1340995819, 1340995822, 1340995825, 1340995829, 1340995833, 1340995836, 1340995571, 1340995573, 1340995575, 1340995577, 1340995579, 1340995581, 1340995584, 1340995586, 1340995591, 1340995598, 1340995601, 1340995603, 1340995606, 1340995609, 1340995612, 1340995615, 1340995617, 1340995620, 1340995623, 1340995625, 1340995628, 1340995630, 1340995632, 1340995963, 1340995964, 1340995965, 1340995966, 1340995967, 1340995968, 1340995999, 1340996000, 1340996001, 1340996002, 1340996003, 1340996004, 1340996005, 1340996006, 1340996007, 1340996008, 1340996009, 1340996010, 1340996011, 1340996012, 1340996013, 1340996014, 1340996015] number of photos to traite : 225 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10153 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.2584819793701172 time used to do the prediction : 0.9348759651184082 save descriptor for thcl : 3237 time to traite the descriptors : 1.5563771724700928 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340996042 To insert : 1340996043 To insert : 1340996044 To insert : 1340996045 To insert : 1340996046 To insert : 1340996047 To insert : 1340996048 To insert : 1340996049 To insert : 1340996050 To insert : 1340996051 To insert : 1340996052 To insert : 1340996054 To insert : 1340996055 To insert : 1340996056 To insert : 1340996057 To insert : 1340996058 To insert : 1340996059 To insert : 1340996060 To insert : 1340995408 To insert : 1340995411 To insert : 1340995413 To insert : 1340995415 To insert : 1340995417 To insert : 1340995420 To insert : 1340995422 To insert : 1340995424 To insert : 1340995427 To insert : 1340995429 To insert : 1340995431 To insert : 1340995433 To insert : 1340995435 To insert : 1340995438 To insert : 1340995440 To insert : 1340995442 To insert : 1340995444 To insert : 1340995446 To insert : 1340995449 To insert : 1340995458 To insert : 1340995461 To insert : 1340995463 To insert : 1340995465 To insert : 1340995467 To insert : 1340995469 To insert : 1340995472 To insert : 1340995474 To insert : 1340995476 To insert : 1340995478 To insert : 1340995481 To insert : 1340995483 To insert : 1340995485 To insert : 1340995487 To insert : 1340995489 To insert : 1340995491 To insert : 1340995493 To insert : 1340995496 To insert : 1340995498 To insert : 1340995501 To insert : 1340995503 To insert : 1340995506 To insert : 1340995508 To insert : 1340995510 To insert : 1340995512 To insert : 1340995514 To insert : 1340995516 To insert : 1340996016 To insert : 1340996017 To insert : 1340996018 To insert : 1340996019 To insert : 1340996020 To insert : 1340996021 To insert : 1340996022 To insert : 1340996023 To insert : 1340996024 To insert : 1340996025 To insert : 1340996026 To insert : 1340996027 To insert : 1340996028 To insert : 1340996031 To insert : 1340996033 To insert : 1340996034 To insert : 1340996035 To insert : 1340996036 To insert : 1340996037 To insert : 1340996038 To insert : 1340996039 To insert : 1340996040 To insert : 1340996041 To insert : 1340995518 To insert : 1340995520 To insert : 1340995524 To insert : 1340995526 To insert : 1340995528 To insert : 1340995530 To insert : 1340995532 To insert : 1340995534 To insert : 1340995536 To insert : 1340995538 To insert : 1340995540 To insert : 1340995542 To insert : 1340995544 To insert : 1340995546 To insert : 1340995548 To insert : 1340995550 To insert : 1340995553 To insert : 1340995556 To insert : 1340995558 To insert : 1340995560 To insert : 1340995563 To insert : 1340995565 To insert : 1340995568 To insert : 1340995359 To insert : 1340995361 To insert : 1340995364 To insert : 1340995366 To insert : 1340995368 To insert : 1340995370 To insert : 1340995372 To insert : 1340995374 To insert : 1340995376 To insert : 1340995378 To insert : 1340995380 To insert : 1340995384 To insert : 1340995386 To insert : 1340995388 To insert : 1340995390 To insert : 1340995392 To insert : 1340995394 To insert : 1340995396 To insert : 1340995398 To insert : 1340995400 To insert : 1340995402 To insert : 1340995404 To insert : 1340995406 To insert : 1340995839 To insert : 1340995842 To insert : 1340995845 To insert : 1340995848 To insert : 1340995852 To insert : 1340995854 To insert : 1340995858 To insert : 1340995947 To insert : 1340995948 To insert : 1340995949 To insert : 1340995950 To insert : 1340995951 To insert : 1340995952 To insert : 1340995953 To insert : 1340995954 To insert : 1340995955 To insert : 1340995956 To insert : 1340995957 To insert : 1340995958 To insert : 1340995959 To insert : 1340995960 To insert : 1340995961 To insert : 1340995962 To insert : 1340995758 To insert : 1340995761 To insert : 1340995763 To insert : 1340995766 To insert : 1340995769 To insert : 1340995778 To insert : 1340995781 To insert : 1340995783 To insert : 1340995786 To insert : 1340995789 To insert : 1340995793 To insert : 1340995797 To insert : 1340995801 To insert : 1340995804 To insert : 1340995808 To insert : 1340995811 To insert : 1340995815 To insert : 1340995819 To insert : 1340995822 To insert : 1340995825 To insert : 1340995829 To insert : 1340995833 To insert : 1340995836 To insert : 1340995571 To insert : 1340995573 To insert : 1340995575 To insert : 1340995577 To insert : 1340995579 To insert : 1340995581 To insert : 1340995584 To insert : 1340995586 To insert : 1340995591 To insert : 1340995598 To insert : 1340995601 To insert : 1340995603 To insert : 1340995606 To insert : 1340995609 To insert : 1340995612 To insert : 1340995615 To insert : 1340995617 To insert : 1340995620 To insert : 1340995623 To insert : 1340995625 To insert : 1340995628 To insert : 1340995630 To insert : 1340995632 To insert : 1340995963 To insert : 1340995964 To insert : 1340995965 To insert : 1340995966 To insert : 1340995967 To insert : 1340995968 To insert : 1340995999 To insert : 1340996000 To insert : 1340996001 To insert : 1340996002 To insert : 1340996003 To insert : 1340996004 To insert : 1340996005 To insert : 1340996006 To insert : 1340996007 To insert : 1340996008 To insert : 1340996009 To insert : 1340996010 To insert : 1340996011 To insert : 1340996012 To insert : 1340996013 To insert : 1340996014 To insert : 1340996015 time to insert the descriptors : 61.45515513420105 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 334 time used for this insertion : 0.024709463119506836 save missing photos in datou_result : time spend for datou_step_exec : 69.6429238319397 time spend to save output : 0.07768058776855469 total time spend for step 6 : 69.72060441970825 step7:ventilate_hashtags_in_portfolio Wed Mar 5 11:24:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21058682 get user id for portfolio 21058682 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21058682 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','PET_clair','Film_plastique','pet_fonce','autre','PEHD','metal','Tetrapak','papier','refus','Carton','environnement','mal_croppe','pet_clair','flou','Papier','carton','pehd')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21058682 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','PET_clair','Film_plastique','pet_fonce','autre','PEHD','metal','Tetrapak','papier','refus','Carton','environnement','mal_croppe','pet_clair','flou','Papier','carton','pehd')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21058682 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','PET_clair','Film_plastique','pet_fonce','autre','PEHD','metal','Tetrapak','papier','refus','Carton','environnement','mal_croppe','pet_clair','flou','Papier','carton','pehd')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21058682 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','PET_clair','Film_plastique','pet_fonce','autre','PEHD','metal','Tetrapak','papier','refus','Carton','environnement','mal_croppe','pet_clair','flou','Papier','carton','pehd')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21059732,21059742,21059731,21059733,21059746,21059735,21059736,21059744,21059738,21059745,21059740,21059741,21059743?tags=pet_fonce,pet_clair,film_plastique,autre,pehd,metal,tetrapak,papier,refus,carton,environnement,mal_croppe,flou&datou_id_consolidate=4235&port_consolidate=21058682 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340991156, 1340991103, 1340991075, 1340991021] Looping around the photos to save general results len do output : 1 /21058682. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991156', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991103', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991075', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991021', None, None, None, None, None, '2637423') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012490510940551758 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.371779680252075 time spend to save output : 0.012788534164428711 total time spend for step 7 : 2.384568214416504 step8:final Wed Mar 5 11:24:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340991156: ('0.2117995964934903',), 1340991103: ('0.2117995964934903',), 1340991075: ('0.2117995964934903',), 1340991021: ('0.2117995964934903',)} new output for save of step final : {1340991156: ('0.2117995964934903',), 1340991103: ('0.2117995964934903',), 1340991075: ('0.2117995964934903',), 1340991021: ('0.2117995964934903',)} [1340991156, 1340991103, 1340991075, 1340991021] Looping around the photos to save general results len do output : 4 /1340991156.Didn't retrieve data . /1340991103.Didn't retrieve data . /1340991075.Didn't retrieve data . /1340991021.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991156', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991103', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991075', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991021', None, None, None, None, None, '2637423') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012359619140625 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1251828670501709 time spend to save output : 0.012731075286865234 total time spend for step 8 : 0.13791394233703613 step9:velours_tree Wed Mar 5 11:24:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21059732,21059742,21059731,21059733,21059746,21059735,21059736,21059744,21059738,21059745,21059740,21059741,21059743 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059732 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059742 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059731 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059733 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059746 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059735 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059736 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059744 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059738 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059745 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059740 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059741 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21059743 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 225 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [1 1 1 4 4 4 3 4 2 4 2 4 0 2 2 2 1 2 4 3 2 2 2 2 1 0 2 0 2 2 3 4 1 1 1 1 4 4 4 4 4 4 2 2 2 3 1 1 2 0 3 2 2 2 1 0 2 3 0 3 0 2 0 3 1 4 1 1 4 4 4 2 1 2 2 2 1 1 2 2 1 0 0 2 2 4 1 3 4 2 1 4 4 4 4 4 2 4 4 2 4 2 2 1 1 2 1 2 2 2 1 0 2 4 1 3 3 4 0 0 2 3 3 3 0 5 3 1 3 3 2 2 0 5 1 3 3 3 1 0 1 5 1 3 3 0 2 4 3 4 1 3 1 1 0 1 1 0 0 2 1 0 0 0 3 0 0 5 5 5 4 3 0 0 0 0 0 5 3 0 0 0 0 0 3 0 3 5 5 5 4 2 0 0 0 0 0 0 0 0 3 3 5 4 0 0 2 0 3 0 0 3 0 0 3 5 5 4 0 2 0 0 0 3 0] Elapsed time: 0.04337430000305176 graph_id used : 81537 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21059732,21059742,21059731,21059733,21059746,21059735,21059736,21059744,21059738,21059745,21059740,21059741,21059743?tags=pet_fonce,pet_clair,film_plastique,autre,pehd,metal,tetrapak,papier,refus,carton,environnement,mal_croppe,flou&datou_id_consolidate=4235&port_consolidate=21058682&tree_id=81537 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340991156, 1340991103, 1340991075, 1340991021] Looping around the photos to save general results len do output : 1 /21058682Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991156', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991103', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991075', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991021', None, None, None, None, None, '2637423') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012056589126586914 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.142070293426514 time spend to save output : 0.012511014938354492 total time spend for step 9 : 18.154581308364868 step10:send_mail_cod Wed Mar 5 11:24:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21058682_05-03-2025_11_24_47.pdf 21059712 imagette210597121741170287 21059722 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210597221741170287 21059711 imagette210597111741170288 21059713 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210597131741170288 21059726 imagette210597261741170289 21059715 imagette210597151741170289 21059716 imagette210597161741170289 21059724 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210597241741170289 21059718 imagette210597181741170290 21059725 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210597251741170290 21059721 imagette210597211741170292 21059723 imagette210597231741170292 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21058682 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21059732,21059742,21059731,21059733,21059746,21059735,21059736,21059744,21059738,21059745,21059740,21059741,21059743?tags=pet_fonce,pet_clair,film_plastique,autre,pehd,metal,tetrapak,papier,refus,carton,environnement,mal_croppe,flou&datou_id_consolidate=4235&port_consolidate=21058682&tree_id=81537 your option no_mail is active, we will not send the real mail to your client args[1340991156] : ((1340991156, -7.902102303652417, 492609224), (1340991156, -0.03318930068769847, 2107752395), '0.2117995964934903') We are sending mail with results at cod@fotonower.com args[1340991103] : ((1340991103, -7.837774141299591, 492609224), (1340991103, 0.003658007994972422, 2107752395), '0.2117995964934903') We are sending mail with results at cod@fotonower.com args[1340991075] : ((1340991075, -7.8323077889183805, 492609224), (1340991075, 0.0025150271506166988, 2107752395), '0.2117995964934903') We are sending mail with results at cod@fotonower.com args[1340991021] : ((1340991021, -7.81315020836932, 492609224), (1340991021, 0.0212200693605146, 2107752395), '0.2117995964934903') We are sending mail with results at cod@fotonower.com refus_total : 0.2117995964934903 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21058682 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21058682_05-03-2025_11_24_47.pdf results_Qualipapia_P21058682_05-03-2025_11_24_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21058682_05-03-2025_11_24_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21058682','results_Qualipapia_P21058682_05-03-2025_11_24_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21058682_05-03-2025_11_24_47.pdf','pdf','','0.16','0.2117995964934903') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340991156, 1340991103, 1340991075, 1340991021] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991156', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991103', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991075', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991021', None, None, None, None, None, '2637423') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.014207601547241211 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.519317150115967 time spend to save output : 0.014398336410522461 total time spend for step 10 : 5.533715486526489 step11:split_time_score Wed Mar 5 11:24:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05032025 21058682 Nombre de photos uploadées : 4 / 23040 (0%) 05032025 21058682 Nombre de photos taguées (types de déchets): 4 / 4 (100%) 05032025 21058682 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 8.821487426757812e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.00024580955505371094 elapsed_time : insert_dashboard_record_day_entry 0.02156352996826172 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2117995964934903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21058682_05-03-2025_11_24_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21058682 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21058682 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21058684 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05032025': {'nb_upload': 4, 'nb_taggue_class': 4, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340991156, 1340991103, 1340991075, 1340991021] Looping around the photos to save general results len do output : 1 /21058682Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991156', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991103', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991075', None, None, None, None, None, '2637423') ('4234', None, None, None, None, None, None, None, '2637423') ('4234', '21058682', '1340991021', None, None, None, None, None, '2637423') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.01343679428100586 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.0209095478057861 time spend to save output : 0.013704776763916016 total time spend for step 11 : 1.0346143245697021 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 54.11user 32.46system 4:29.50elapsed 32%CPU (0avgtext+0avgdata 2533860maxresident)k 74152inputs+17344outputs (773major+2556399minor)pagefaults 0swaps